Developing stealth assessments to assess young Chinese learners' L2 reading comprehension

Jan. 29, 2025, 2:02 a.m.
Feb. 12, 2025, 11:35 p.m.
Feb. 12, 2025, 11:35 p.m.
[['https://scholarspace.manoa.hawaii.edu/bitstreams/113af882-70c0-433f-bfdc-205e9a47cebf/download', '29_02_10125-73613.pdf']]
[['https://scholarspace.manoa.hawaii.edu/bitstreams/b9e98f66-7991-44ca-9bb3-90608433e683/download', 'full_text']]
Volume 29 Number 2, February 2025 Special Issue: Indigenous Languages and Less Commonly Taught Languages (LCTLs) with Technology
Poole, Frederick J. Coss, Matthew D. Clarke-Midura, Jody
2025-01-29T01:59:42Z
2025-01-29T01:59:42Z
2025-02-01
This study explored the use of stealth assessments within a digital game to assess second language (L2) Chinese learners’ reading comprehension. Log data tracking learners’ in-game behaviors from a game designed for Chinese dual language immersion classrooms (Poole et al., 2022) were used to construct Bayesian Belief Networks to model reading comprehension. Variables included the use of an in-game glossary for word lookups, time spent reading texts, vocabulary knowledge, text length, response requirements, and the number of repetitions. Networks were first built using class-level gameplay data and subsequently applied to individual students. Results showed significant correlations between students' modeled comprehension and their performance on an external reading comprehension assessment (r = .52) as well as teachers’ informal reading evaluations (r = .66), demonstrating stealth assessments’ potential for unobtrusive reading comprehension measurement. The findings contribute to the understanding of digital game-based learning and assessment in language education, particularly in the context of reading comprehension for non-alphabetic languages like Mandarin Chinese.
130
26
Poole, F. J., Coss, M. D., & Clarke-Midura, J. (2025). Developing stealth assessments to assess young Chinese learners' L2 reading comprehension. Language Learning & Technology, 29(2), 104–131. https://hdl.handle.net/10125/73613
1094-3501
https://hdl.handle.net/10125/73613
2
Language Learning & Technology
University of Hawaii National Foreign Language Resource Center Center for Language & Technology
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
https://creativecommons.org/licenses/by-nc-nd/4.0/
/item/10125-73613/
104
Stealth Assessment Bayesian Belief Networks Reading Comprehension Dual Language Immersion Less commonly taught languages
Developing stealth assessments to assess young Chinese learners' L2 reading comprehension
Article
Text
29