Eye Gaze Controlled Projected Display in Automotive and Military Aviation Environments

Abstract

This paper presents an eye gaze controlled projected display that can be used in aviation and automotive environment as a head up display. We have presented details of the hardware and software used in developing the display and an algorithm to improve performance of point and selection tasks in eye gaze controlled graphical user interface. The algorithm does not require changing layout of an interface; it rather puts a set of hotspots on clickable targets using a Simulated Annealing algorithm. Four user studies involving driving and flight simulators have found that the proposed projected display can improve driving and flying performance and significantly reduce pointing and selection times for secondary mission control tasks compared to existing interaction systems.

Keywords

• eye gaze controlled interface
• projected display
• Simulated Annealing
• Automotive UI
• Aviation UI
• HOTAS
• human computer interaction
• artificial intelligence