Automated versus peer assessment: Effects of learners' English public speaking

Repository record updated on:

May 30, 2024, 9:04 a.m.

Database record updated on:

May 31, 2024, 6:38 p.m.

Last Harvested on:

May 31, 2024, 6:38 p.m.

bitstream:

[['https://scholarspace.manoa.hawaii.edu/bitstreams/4675be78-c626-4d6f-9ad5-26d5da437bfe/download', '28_02_10125-73578.pdf']]

bitstream_txt:

[]

collection:

Volume 28 Number 2, June 2024 Special Issue: Artificial Intelligence for Language Learning

contributor.author:

Zheng, Chunping Chen, Xu Zhang, Huayang Chai, Ching Sing

date.accessioned:

2024-05-30T19:01:42Z

date.available:

2024-05-30T19:01:42Z

date.issued:

2024-06-01

description.abstract:

This quasi-experimental research investigates the employment of a formative assessment platform aided by artificial intelligence in an English public speaking course. The platform integrates deep learning, automatic speech recognition, and automatic writing evaluation. It provides automated assessment and immediate feedback on speakers’ public speaking anxiety and their speaking and writing competence. Fifty-two English public speaking learners were randomly assigned to two groups. The control group (G1) undertook self-, peer, and teacher assessment via the platform, while the experimental group (G2) experienced self-, automated, and teacher assessment. The ANCOVA results revealed that students in G1 perceived significantly higher social engagement than those in G2, which indicates that social interaction between learners during peer assessment cannot be substituted by automated assessment. The chi-square analysis showed students’ different concerns regarding online formative assessment. While students in G1 showed concerns for peers’ qualifications and willingness to provide feedback, students in G2 suggested generating more detailed automated feedback to improve self-learning. No significant differences were found in learners’ English public speaking self-efficacy, engagement, or competence. This indicates that automated assessment can serve as an effective strategy for formative assessment and that AI tools may supplement peers as reliable learning companions in the foreseeable future.

endingpage:

228

format.extent:

228

identifier.citation:

Zheng, C., Chen, X., Zhang, H., & Chai, C. S (2024). Automated versus peer assessment: Effects on learners’ English public speaking. Language Learning & Technology, 28(2), 210–228. https://hdl.handle.net/10125/73577

identifier.issn:

1094-3501

identifier.uri:

https://hdl.handle.net/10125/73578

number:

2

publicationname:

Language Learning & Technology

publisher:

University of Hawaii National Foreign Language Resource Center Center for Language & Technology

rights:

Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

rights.uri:

https://creativecommons.org/licenses/by-nc-nd/4.0/

site_url:

/item/10125-73578/

startingpage:

210

subject:

Automated Assessment Peer Assessment English Public Speaking Learner Engagement Self-efficacy

title:

Automated versus peer assessment: Effects of learners' English public speaking

type:

Article

type.dcmi:

Text

volume:

28