Volume 29 Number 3, October 2025 Special Issue: Multimodality in CALL Ecological semiotics: Multimodality, multilingualism, and situated language learning in the AI era

Ecological semiotics: Multimodality, multilingualism, and situated language learning in the AI era

Repository record updated on:
Sept. 26, 2025, 5:57 p.m.
Database record updated on:
Oct. 3, 2025, 8:56 p.m.
Last Harvested on:
Oct. 3, 2025, 8:56 p.m.
access-status:
open.access
bitstream:
[['https://scholarspace.manoa.hawaii.edu/bitstreams/ac584552-af38-43b3-8dec-b2941f110aa6/download', '29_03_10125-73645.pdf']]
bitstream_txt:
[['https://scholarspace.manoa.hawaii.edu/bitstreams/7c4120df-5268-4ade-b05b-6db4afe6d2c4/download', 'full_text']]
collection:
Volume 29 Number 3, October 2025 Special Issue: Multimodality in CALL
contributor.author:
Godwin-Jones, Robert
contributor.editor:
Robert Godwin-Jones
date.accessioned:
2025-09-26T17:56:36Z
date.available:
2025-09-26T17:56:36Z
date.issued:
2025-10-01
description.abstract:
Using a variety of media beyond text—audio, video, visual—has long been a common practice in second language learning. Digital media has dramatically increased that opportunity. Multimedia-friendly mobile devices provide access to all media formats, leading to the frequent practice of combining modes. At the same time, social media has increasingly seen a mixing of languages along with the use of images, voice, and video. Studies of multimodal enhancements in second language acquisition (SLA) have generally shown positive learning outcomes, although results vary widely depending on conditions. A variety of theories have been developed in support of the mediating and motivating effects of integrating multimedia into language instruction. Those include different theories of semiotics, the science of signs, as well as the use of ecological theories such as sociomaterialism. The use of learners’ first language (L1) in instructed SLA has been shown to be a valuable scaffolding tool (often in combination with multimodality), leading to the practice of pedagogical translanguaging. Since 2022, the availability of generative artificial intelligence (AI) has been shifting the media landscape. As AI systems steadily improve in multimedia capabilities, existing methods and theories on multimedia integration into SLA may need to be revisited. An approach based on ecological semiotics may prove helpful.
endingpage:
29
format.extent:
23
identifier.citation:
Godwin-Jones, R. (2025). Ecological semiotics: Multimodality, multilingualism, and situated language learning in the AI era. Language Learning & Technology, 29(3), 6–29. https://doi.org/10.64152/10125/73645
identifier.doi:
https://doi.org/10.64152/10125/73645
identifier.issn:
1094-3501
identifier.uri:
https://hdl.handle.net/10125/73645
llt.topic:
Emerging Technologies
number:
3
publicationname:
Language Learning & Technology
publisher:
University of Hawaii National Foreign Language Resource Center Center for Language & Technology
rights:
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
rights.uri:
https://creativecommons.org/licenses/by-nc-nd/4.0/
site_url:
/item/10125-73645/
startingpage:
6
subject:
multimodality semiotics generative AI translanguaging
title:
Ecological semiotics: Multimodality, multilingualism, and situated language learning in the AI era
type:
Column
volume:
29