Engagement Assessment for the Educational Web-Service Based on Largest Lyapunov Exponent Calculation for User Reaction Time Series

Abstract

Contemporary digital platforms provide a large number of web services for learning and professional growth. In most cases, educational web services only control access when connecting to resources and platforms. However, for educational and similar resources (internet surveys, online research), which are characterized by interactive interaction with the platform, it is important to assess user engagement in the learning process. A fairly large body of research is devoted to assessing learner engagement based on automatic, semi-automatic, and manual methods. Those methods include self-observation, observation checklists, engagement tracing based on learner reaction time and accuracy, computer vision methods (analysis of facial expressions, gestures, and postures, eye movements), methods for analyzing body sensor data, etc. Computer vision and body sensor methods for assessing engagement give a more complete objective picture of the learner’s state for further analysis in comparison with the methods of engagement tracing based on learner’s reaction time, however, they require the presence of appropriate sensors, which may often not be applicable in a particular context. Sensory observation is explicit to the learner and is an additional stressor, such as knowing the learner is being captured by the webcam while solving a problem. Thus, the further development of the hidden engagement assessment methods is relevant, while new computationally efficient techniques of converting the initial signal about the learner’s reaction time to assess engagement can be applied. On the basis of the hypothesis about the randomness of the dynamics of the time series, the largest Lyapunov exponent can be calculated for the time series formed from the reaction time of learners during prolonged work with web interfaces to assess the learner’s engagement. A feature of the proposed engagement assessment method is the relatively high computational efficiency, absence of high traffic loads in comparison with computer vision as well as secrecy from the learner coupled with no processing of learner’s personal or physical data except the reaction time to questions displayed on the screen. The results of experimental studies on a large amount of data are presented, demonstrating the applicability of the selected technique for learner’s engagement assessment.

Keywords

• engagement assessment
• largest Lyapunov exponent
• reaction time
• clicker
• web service
• involvement