Volume 29 Number 2, February 2025 Special Issue: Indigenous Languages and Less Commonly Taught Languages (LCTLs) with Technology Exploring AI-assistance in L2 Chinese writing with standardized assessment tasks

Exploring AI-assistance in L2 Chinese writing with standardized assessment tasks

Repository record updated on:
Jan. 31, 2025, 7:51 p.m.
Database record updated on:
Feb. 12, 2025, 11:35 p.m.
Last Harvested on:
Feb. 12, 2025, 11:35 p.m.
bitstream:
[['https://scholarspace.manoa.hawaii.edu/bitstreams/c83ed121-42e8-4cce-9a56-78d39846132d/download', '29_02_10125-73615.pdf']]
bitstream_txt:
[['https://scholarspace.manoa.hawaii.edu/bitstreams/7e12276e-7323-4728-900f-8a0b42873f55/download', 'full_text']]
collection:
Volume 29 Number 2, February 2025 Special Issue: Indigenous Languages and Less Commonly Taught Languages (LCTLs) with Technology
contributor.author:
Song, Dan Tang, Alexander Fukin
date.accessioned:
2025-01-29T01:59:44Z
date.available:
2025-01-29T01:59:44Z
date.issued:
2025-02-01
description.abstract:
While many studies have addressed the benefits of technology-assisted L2 writing, limited research has delved into how generative artificial intelligence (GAI) supports students in completing their writing tasks in Mandarin Chinese. In this study, 26 university-level Mandarin Chinese foreign language students completed two writing tasks on two separate days. The writing prompts were from the AP Chinese Language and Culture Exam free response questions. Students were permitted to use ChatGPT for assistance with only one of the given prompts each day. After data analysis, writing scores were compared with and without the use of ChatGPT to discern which aspects of ChatGPT students relied on the most. To maintain the validity and reliability of the scores, students' writing samples were independently evaluated by two professional raters, yielding a high degree of inter-rater reliability. The results indicate that utilizing ChatGPT for assistance consistently resulted in higher scores. Additionally, students primarily sought assistance from ChatGPT for vocabulary-related and translation-related questions. Quantitative and qualitative data were used to analyze students’ perceptions of using GAI to support the students in completing the writing tasks. The current study seeks to bridge existing knowledge gaps and offer empirical data on how GAI tools, like ChatGPT, can develop students’ L2 writing within the Mandarin Chinese language learning context.
endingpage:
189
format.extent:
28
identifier.citation:
Song, D., & Tang, A. F. (2025). Exploring AI-assistance in L2 Chinese writing with standardized assessment tasks. Language Learning & Technology, 29(2), 161–189. https://hdl.handle.net/10125/73615
identifier.issn:
1094-3501
identifier.uri:
https://hdl.handle.net/10125/73615
number:
2
publicationname:
Language Learning & Technology
publisher:
University of Hawaii National Foreign Language Resource Center Center for Language & Technology
rights:
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
rights.uri:
https://creativecommons.org/licenses/by-nc-nd/4.0/
site_url:
/item/10125-73615/
startingpage:
161
subject:
Generative artificial intelligence Language assessment Less commonly taught languages Mandarin Chinese Second language writing
title:
Exploring AI-assistance in L2 Chinese writing with standardized assessment tasks
type:
Article
type.dcmi:
Text
volume:
29