IEEE Access (Jan 2024)

Deep Learning-Based Interactive Dashboard for Enhancing Online Classroom Experience Through Student Emotion Analysis

  • Priyanka Ganesan,
  • Senthil Kumar Jagatheesaperumal,
  • I. Gobhinath,
  • Vishnu Venkatraman,
  • Silvia N. Gaftandzhieva,
  • Rositsa Zh. Doneva

DOI
https://doi.org/10.1109/ACCESS.2024.3421282
Journal volume & issue
Vol. 12
pp. 91140 – 91153

Abstract

Read online

An interactive analytical dashboard that analyzes students’ facial expressions during online lectures is crucial for digital learning platforms. This research addresses the need for educational institutions to analyze individual students’ emotions to improve teaching standards. Given the challenge of occluded facial data, we employ a regenerative Generative Adversarial Network (GAN) to reconstruct these occluded regions. Subsequently, the emotions of the students are predicted and analyzed using our proposed interactive dashboard, which incorporates additional inputs such as subject name and teaching faculty. The dashboard visualizes various charts and analytics to support informed decision-making. We validated our deep learning model using the CK+ dataset, achieving notable accuracy in classifying each type of emotion. Our results demonstrate that the model can effectively interpret student emotions, even in the presence of occlusions, thereby providing educators with precise, real-time emotional insights to tailor their teaching methodologies effectively.

Keywords