AI in informal digital English learning: A meta-analysis of its effectiveness on proficiency, motivation, and self-regulation

Abstract

This meta-analysis examines the efficacy of generative artificial intelligence (GenAI) in second language acquisition within self-directed, out-of-classroom informal contexts. A total of 15 studies meeting the inclusion criteria were identified that examined the impact of GenAI on second-language proficiency, motivation, and self-regulation. GenAI was shown to have significant effects on English proficiency and self-regulation, demonstrating its versatility in enhancing language learning outcomes. However, GenAI failed to show significant effects on learning motivation, and based on this finding we highlight the need to develop measures of motivation that are suitable for GenAI in education. Possible ways to apply GenAI in the informal language learning environment are also discussed based on the included literature.

Keywords

• Generative artificial intelligence
• Informal digital learning of English
• English proficiency
• Learning motivation
• Self-regulation