Eye-Tracking Image Encoding: Autoencoders for the Crossing of Language Boundaries in Developmental Dyslexia Detection

Abstract

The negative influence of developmental dyslexia on academic performance is a well-documented and researched topic. Although the research focused on developmental dyslexia detection and evaluation is plentiful, the study designs vary to a great degree, making the exchange of obtained knowledge often difficult. This paper focuses on bridging the gap between different study designs by developing a machine learning based pipeline that was evaluated on two completely different eye-tracking datasets (training on one, testing on the other, and vice versa). One dataset included 30 subjects who read text written in Serbian on different color configurations and were tracked with a remote eye-tracker. The second dataset included 185 subjects who read text written in Swedish and recorded eye-tracking data using a goggle-based system. The data from both datasets were converted to grayscale images, using various time window configurations to parse the signals, and to plot the data in a 2D plane. The train images were used to train an Autoencoder neural network, and the images’ reconstruction error was used to create features that describe each instance of both the training and test sets. The train feature set was used to train various machine learning algorithms, which were then evaluated on the testing feature dataset. A classification accuracy of 85.6% was obtained when testing on Serbian readers’ data and 82.9% when testing on Swedish readers. The proposed pipeline was shown to be transferable between the datasets, despite many differences in the experiment design, showing potential in combining various eye-tracking dyslexia studies.

Keywords

• Autoencoder
• classification
• dyslexia
• eye-tracking
• machine learning
• neural network