Volume 29 Number 3, October 2025 Special Issue: Multimodality in CALL The integration of auditory and textual input in vocabulary learning from subtitled viewing: An eye-tracking study

The integration of auditory and textual input in vocabulary learning from subtitled viewing: An eye-tracking study

Repository record updated on:
Sept. 26, 2025, 5:57 p.m.
Database record updated on:
Oct. 3, 2025, 8:56 p.m.
Last Harvested on:
Oct. 3, 2025, 8:56 p.m.
access-status:
open.access
bitstream:
[['https://scholarspace.manoa.hawaii.edu/bitstreams/964e2f08-2f6d-48e3-ab18-0074fe82afa7/download', '29_03_10125-73648.pdf']]
bitstream_txt:
[['https://scholarspace.manoa.hawaii.edu/bitstreams/a63af71c-2a69-4957-b59f-2a862e2ff774/download', 'full_text']]
collection:
Volume 29 Number 3, October 2025 Special Issue: Multimodality in CALL
contributor.author:
Wang, Andi
date.accessioned:
2025-09-26T17:56:38Z
date.available:
2025-09-26T17:56:38Z
date.issued:
2025-10-01
description.abstract:
Numerous studies have documented the benefits of watching audio-visual materials with on-screen text for L2 vocabulary learning (Montero Perez, 2022). The provision of both auditory and textual input allows learners to link auditory and written forms (or L1 meanings) of unknown words during viewing, which could potentially facilitate vocabulary learning. However, little is known about the dynamics of text-audio synchrony in subtitled viewing and how the processing of written words in relation to the audio may lead to vocabulary learning. Eighty-one intermediate-to-advanced Chinese learners of English watched an English documentary with one of three on-screen texts (i.e., captions, L1 subtitles, and bilingual subtitles), while their eye movements were monitored. Participants’ awareness of 17 unknown words and vocabulary learning gains were assessed via stimulated recalls and three vocabulary tests. Results revealed that captions facilitated text-audio synchronisation, whereas L1 subtitles generally led to reading ahead and skipping. Bilingual subtitles enabled synchronisation of L1 translations with L2 audio but often resulted in skipping L2 forms. Most text-audio processing behaviours led to moderate predicted probabilities of vocabulary learning and participants’ reported awareness, with no significant within-group difference, except for the processing of L2 unknown words in bilingual subtitles.
endingpage:
91
format.extent:
22
identifier.citation:
Wang, A. (2025). The integration of auditory and textual input in incidental vocabulary learning from subtitled viewing: An eye-tracking study. Language Learning & Technology, 29(3), 70–91. https://doi.org/10.64152/10125/73648
identifier.doi:
https://doi.org/10.64152/10125/73648
identifier.issn:
1094-3501
identifier.uri:
https://hdl.handle.net/10125/73648
number:
3
publicationname:
Language Learning & Technology
publisher:
University of Hawaii National Foreign Language Resource Center Center for Language & Technology
rights:
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
rights.uri:
https://creativecommons.org/licenses/by-nc-nd/4.0/
site_url:
/item/10125-73648/
startingpage:
70
subject:
audio-visual materials eye-tracking text-audio synchronisation vocabulary learning
title:
The integration of auditory and textual input in vocabulary learning from subtitled viewing: An eye-tracking study
type:
Article
volume:
29