An IoT-Based Framework for Automated Assessing and Reporting of Light Sensitivities in Children with Autism Spectrum Disorder

Abstract

Identification of light sensitivities, manifesting either as hyper-sensitive (over-stimulating) or hypo-sensitive (under-stimulating) in children with autism spectrum disorder (ASD), is crucial for the development of personalized sensory environments and therapeutic strategies. Traditional methods for identifying light sensitivities often depend on subjective assessments and manual video coding methods, which are time-consuming, and very keen observations are required to capture the diverse sensory responses of children with ASD. This can lead to challenges for clinical practitioners in addressing individual sensory needs effectively. The primary objective of this work is to develop an automated system using Internet of Things (IoT), computer vision, and data mining techniques for assessing visual sensitivities specifically associated with light (color and illumination). For this purpose, an Internet of Things (IoT)-based light sensitivities assessing system (IoT-LSAS) was designed and developed using a visual stimulating device, a bubble tube (BT). The IoT-LSAS integrates various electronic modules for (i) generating colored visual stimuli with different illumination levels and (ii) capturing images to identify children’s emotional responses during sensory stimulation sessions. The system is designed to operate in two different modes: a child control mode (CCM) and a system control mode (SCM). Each mode uses a distinct approach for assessing light sensitivities, where CCM uses a preference-based approach, and SCM uses an emotional response tracking approach. The system was tested on a sample of 20 children with ASD, and the results showed that the IoT-LSAS effectively identified light sensitivities, with a 95% agreement rate in the CCM and a 90% agreement rate in the SCM when compared to the practitioner’s assessment report. These findings suggest that the IoT-LSAS can be used as an alternative to traditional assessment methods for diagnosing light sensitivities in children with ASD, significantly reducing the practitioner’s time required for diagnosis.

Keywords

• autism spectrum disorder
• light sensitivities
• internet of things
• computer vision
• monitoring