Measurement: Sensors (Jun 2024)
Simulation of performance skills teaching system based on machine vision and sensor audio signal processing
Abstract
In the traditional network media education system, there is little content about skill performance, and the malleability is poor. With the combination of Internet technology, online teaching videos of performance skills began to be promoted on a large scale, and with the help of the Internet, the learning of online performance skills has been updated. The aim of this study is to develop a performance skills teaching system based on machine vision and sensor audio signal processing technology to provide a simulated performance environment and personalized instruction. In this study, multiple sensors were used to capture various movement data during the performance of students. Through the use of sensor technology, the system is able to capture information about students' posture, finger position and force in real time, and analyze posture and movement in combination with machine vision technology. The system can also process and analyze the audio signals in the students' performance to evaluate the accuracy and fluency of the playing technique. The application of sensor technology enables the system to accurately capture students' movements and provide timely feedback. The use of machine vision technology allows the system to accurately analyze the student's posture and movements to provide more targeted guidance. The application of audio signal processing algorithm enables the system to objectively evaluate the students' playing skills and help them improve the accuracy and fluency in the playing process.
