PredictEYE: Personalized Time Series Model for Mental State Prediction Using Eye Tracking

Abstract

Mental health is vital for emotional, psychological, and social well-being. Mental illness can affect thoughts, feelings, and behaviors. Early intervention and specialized care can manage major mental illnesses. Predicting mental state accurately can facilitate behavioral changes and promote overall well-being. The paper proposes a novel personalized time series model called PredictEYE, which aims to predict a person’s mental state and identify the specific scene responsible for that mental state. The model achieves this by analyzing individuals’ eye-tracking time series data while watching calm and stressful videos. The model utilizes a deep learning time-series univariate regression model based on Long Short-Term Memory for predicting the future sequence of each feature and a machine learning-based Random Forest algorithm for the mental state prediction. The model’s performance was compared across the state-of-the-art literature survey. The predictEYE model could achieve an accuracy of 86.4% accuracy in predicting mental state. Tailoring eye tracking models to individual differences is more effective in comprehending mental states than models that make comparisons across multiple participants, given eye tracking data’s unique and distinctive idiosyncratic nature. The eye tracking features play a crucial role in predicting the mental state, and the model is adaptable to work with webcam-based eye tracking and can relate to applications where continuous and non-invasive monitoring is required.

Keywords

• Eye tracking
• galvanic skin response
• long short-term memory
• mental state prediction
• time series analysis