Multimodal Technologies and Interaction (Jun 2023)

Mid-Air Gestural Interaction with a Large Fogscreen

  • Vera Remizova,
  • Antti Sand,
  • I. Scott MacKenzie,
  • Oleg Špakov,
  • Katariina Nyyssönen,
  • Ismo Rakkolainen,
  • Anneli Kylliäinen,
  • Veikko Surakka,
  • Yulia Gizatdinova

DOI
https://doi.org/10.3390/mti7070063
Journal volume & issue
Vol. 7, no. 7
p. 63

Abstract

Read online

Projected walk-through fogscreens have been created, but there is little research on the evaluation of the interaction performance with fogscreens. The present study investigated mid-air hand gestures for interaction with a large fogscreen. Participants (N = 20) selected objects from a fogscreen using tapping and dwell-based gestural techniques, with and without vibrotactile/haptic feedback. In terms of Fitts’ law, the throughput was about 1.4 bps to 2.6 bps, suggesting that gestural interaction with a large fogscreen is a suitable and effective input method. Our results also suggest that tapping without haptic feedback has good performance and potential for interaction with a fogscreen, and that tactile feedback is not necessary for effective mid-air interaction. These findings have implications for the design of gestural interfaces suitable for interaction with fogscreens.

Keywords