The Effectiveness of AI Conversational Agents for Improving Speaking Skills in Taiwanese EFL Learners

Abstract

This research examines the effectiveness of AI conversational agents (AICAs) in improving Taiwanese university English as a Foreign Language (EFL) learners’ speaking proficiency. The study is guided by a mixed-method design over a period of 6 weeks. It focuses on pronunciation, an essential component in speaking enhancement which facilitates clear communication, ultimately aiding in language mastery. The AICA Elsa Speak is the intervention tool which enhances the pronunciation skills of four participants from varying English as a medium of instruction disciplines. This is determined via pre and post intervention pronunciation tests with a focus on articulation, intonation, stress and connected speech. According to the quantitative findings, there is an observable increase in each participant’s mean pre and post intervention pronunciation scores. However, such scores are still not statistically significant (Wilcoxon Signed-Ranks Test, p = 0.059). Qualitative data provided by the weekly reflective journals and pre and post intervention interviews, reported a boost in participants’ confidence and motivation to speak English. Elsa Speak also facilitated substantial feedback which positively impacted students’ error recognition and pronunciation enhancement. Nevertheless, challenges such as misrecognition of accents, highlights the necessity to modify these tools for greater learner satisfaction. This research emphasises that AICAs have the potential to make a tremendous impact on EFL education. Incorporated alongside traditional methods, such technologies can augment learners’ pronunciation skills in formal and informal settings. Future research should investigate their long-term impacts on instruction, their applicability to varied learner demographics, and integrating multimodal features to facilitate an advanced user experience.

Presenters

Kamara Foster
Student, Master's Applied Linguistics , National Kaohsiung University of Science and Technology First Campus, Taiwan

Details

Presentation Type

Innovation Showcase

Theme

2025 Special Focus—Learning from Artificial Intelligence: Pedagogical Futures and Transformative Possibilities

KEYWORDS

AI CONVERSATIONAL AGENTS, PRONUNCIATION PROFICIENCY, TAIWANESE EFL LEARNERS, LANGUAGE LEARNING