Visualizing simultaneous eye-hand movements in a MATLAB dashboard

Abstract

Eye-hand coordination (EHC) is crucial to our daily activities, and its underlying mechanisms are being intensely studied. The analysis of simultaneous eye and hand movements can provide valuable insights into EHC, particularly for individuals struggling with dexterous control, such as might be caused by stroke or traumatic brain injuries. Despite advancements in motion-capture and eye tracking technologies, there is currently no automated method for visualizing concurrent eye- and hand-movement data. To address this need, we have developed a MATLAB-based dashboard designed for near instantaneous analysis and visualization of eye and hand-tracking data. This paper introduces the design of the dashboard and presents experimental results obtained from its application, leveraging simulated data inspired by our recent work in stroke. This testing suggests that our solution has the potential to significantly aid in understanding and investigating EHC by providing side-by-side and time-locked comparison of eye/hand movements along with their timing and spatio-temporal errors, offering novel opportunities for research and clinical applications. • Continuous eye movement data is collected throughout the experiment • Continuous hand movement data is collected throughout the experiment • Combine datasets and display time-locked eye-hand data in a single dashboard

Keywords

• Sensory-motor coordination
• Visualization techniques
• Eye tracking
• Limb tracking