Volume 29 Number 3, October 2025 Special Issue: Multimodality in CALL Language proficiency over nonverbal sound effects in children's eBook incidental word learning

Language proficiency over nonverbal sound effects in children's eBook incidental word learning

Repository record updated on:
Sept. 26, 2025, 5:57 p.m.
Database record updated on:
Oct. 3, 2025, 8:57 p.m.
Last Harvested on:
Oct. 3, 2025, 8:57 p.m.
access-status:
open.access
bitstream:
[['https://scholarspace.manoa.hawaii.edu/bitstreams/0fbc4d4d-48d8-4b1a-a006-27a10cbd3bdc/download', '29_03_10125-73650.pdf']]
bitstream_txt:
[['https://scholarspace.manoa.hawaii.edu/bitstreams/cd55629a-e68d-4506-b479-9b723f0cabdf/download', 'full_text']]
collection:
Volume 29 Number 3, October 2025 Special Issue: Multimodality in CALL
contributor.author:
Sun, He Roberts, Adam Tan, Jessica Leh, Jieying Moh, Yvonne Cui Yun
date.accessioned:
2025-09-26T17:56:40Z
date.available:
2025-09-26T17:56:40Z
date.issued:
2025-10-01
description.abstract:
While multimodal glossing is supported by theories like Mayer’s Cognitive Theory of Multimedia Learning, its effectiveness remains debated due to potential cognitive demands. This study examined how repeated exposures, working memory (WM), and gloss lookup behaviors influence vocabulary retention. Ninety-six Chinese high school students were randomly assigned to four conditions (L2 textual gloss, pictorial gloss, pictorial plus L2 textual gloss, and no gloss). Results showed that (a) repeated exposures to target words enhanced vocabulary learning; (b) repeated exposures to glosses increased processing efficiency (measured by gloss lookup duration); (c) Reading Span was associated with processing efficiency and vocabulary learning; (d) Non-word Repetition’s impact on processing efficiency was reversed with repeated gloss exposures, while its impact on vocabulary learning outcomes was complex; (e) pictorial glosses were associated with the highest processing efficiency, while the Multimodal Gloss Condition showed a significant increase in processing efficiency with repeated exposures, and (f) metacognitive strategy use interacted complexly with cognitive engagement with input. These findings suggest that repeated exposure to glosses can mitigate the cognitive demands of multimodal inputs, offering valuable pedagogical insights for the design of effective glossing strategies in multimedia learning contexts.
endingpage:
156
format.extent:
22
identifier.citation:
Sun, H., Roberts, A., Tan, J., Loh, J., & Moh, Y. C. Y. (2025). Language proficiency over sound effects in children's eBook vocabulary learning. Language Learning & Technology, 29(3), 135–156. https://doi.org/10.64152/10125/73650
identifier.doi:
https://doi.org/10.64152/10125/73650
identifier.issn:
1094-3501
identifier.uri:
https://hdl.handle.net/10125/73650
number:
3
publicationname:
Language Learning & Technology
publisher:
University of Hawaii National Foreign Language Resource Center Center for Language & Technology
rights:
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
rights.uri:
https://creativecommons.org/licenses/by-nc-nd/4.0/
site_url:
/item/10125-73650/
startingpage:
135
subject:
sound effects eBook attention language proficiency
title:
Language proficiency over nonverbal sound effects in children's eBook incidental word learning
type:
Article
volume:
29