IEEE Access (Jan 2019)

New Tools and Methods in Selection of Air Traffic Controllers Based on Multimodal Psychophysiological Measurements

  • Kresimir Cosic,
  • Sinisa Popovic,
  • Marko Sarlija,
  • Igor Mijic,
  • Mirko Kokot,
  • Ivan Kesedzic,
  • Gary Strangman,
  • Vladimir Ivkovic,
  • Quan Zhang

DOI
https://doi.org/10.1109/ACCESS.2019.2957357
Journal volume & issue
Vol. 7
pp. 174873 – 174888

Abstract

Read online

Comprehensive multimodal psychophysiological measurements and smart data analysis based on wearable and low-cost technologies could enhance traditional air traffic controller (ATC) selection process. Many recent studies in neuro-cognitive science and stress resilience illustrated effectiveness of these multimodal measurements and appropriate metrics in comprehensive assessment of ATCs' mental states, such as cognitive workload, cognitive decline, attention deficit, fatigue, emotional and behavioural problems, etc. Accordingly, this article is focused on innovation efforts in ATC selection protocols based on a set of comprehensive stimuli and corresponding multimodal psychophysiological measurements. The concept of enhancement of ATC selection process presented in this article includes complex physiological, oculometric and speech measurements and appropriate metrics. From these multimodal measurements during specific stimulation tasks, which include different versions of acoustic startle stimuli, airblasts, semantically relevant aversive images and sounds, different versions of Stroop tests, visual tracking test, a complex set of multimodal-multidimensional features is computed as predictors of ATC candidates' future performance, like: stress resilience, workload capacity, attention, visual performance, working memory etc. Such cost-effective, more objective, non-invasive preliminary measurements, lasting no longer than 45 minutes may have good discriminative power and might be used in ATC selection processes as enhancement of current selection procedures. Comprehensive analysis of presented multimodal features during different experimental conditions might also be very useful in selection processes of other stressful professional jobs, like first responders, pilots, astronauts etc.

Keywords