Leveraging AI-Generated Audio in the Metaverse for Enhanced English Listening Skills: An Innovative Approach

Abstract

Conventional listening tasks often involve synchronous drilling in the classroom setting whereas students would listen to audio clips in workbooks for asynchronous learning. However, the former approach is deemed monotonous by most learners while the latter does not ensure the consistency of audio quality in terms of the speakers’ accents. Hence, researchers have incorporated the elements of Metaverse and Artificial Intelligence (AI) in developing a Google Classroom equipped with AI-generated audio being embedded in a Metaverse. The ADDIE Model is employed throughout the development of MetaListen. MetaListen aims to develop original resources aligned with the Form 5 Curriculum and the SPM listening format to assist students with deficient listening abilities. A quasi-experimental study on a total of 80 students showed that students who employ the following tool of learning exhibit an improvement in their listening scores as well as their learning attitudes pertaining to listening as independent samples t-test conducted indicated a significant difference between the control group (without MetaListen intervention) and treatment group (with MetaListen intervention). MetaListen utilises AI, the Metaverse, and Google Classroom to create a dynamic learning environment that enhances cognitive processing and retention of listening materials. It offers immersive and interactive learning experiences through the Metaverse. Google Classroom in MetaListen is structured and user-friendly that supports differentiated learning and improves listening skills. AI employed in MetaListen, provides consistent, context-relevant learning materials for English listening. MetaListen's scaffolding effectively aids students' learning processes, and the Teacher’s Book with AI-generated prompts enriches the educational experience for both teachers and students, making MetaListen a comprehensive English listening practice tool. Therefore, MetaListen notably enhances English listening skills and fosters a positive shift in student learning attitudes, highlighting its effectiveness and innovation as an educational tool in the English educational settings.