Multimodal Technologies and Interaction (Jul 2020)

Spot-Presentation of Stereophonic Earcons to Assist Navigation for the Visually Impaired

  • Yuichi Mashiba,
  • Ryunosuke Iwaoka,
  • Hisham E. Bilal Salih,
  • Masayuki Kawamoto,
  • Naoto Wakatsuki,
  • Koichi Mizutani,
  • Keiichi Zempo

DOI
https://doi.org/10.3390/mti4030042
Journal volume & issue
Vol. 4, no. 3
p. 42

Abstract

Read online

This study seeks to demonstrate that a navigation system using stereophonic sound technology is effective in supporting visually impaired people in public spaces. In the proposed method, stereophonic sound is produced by a pair of parametric speakers for a person who comes to a specific position, detected by an RGB-D sensor. The sound is a stereophonic earcon representing the target facility. The recipient can intuitively understand the direction of the target facility. The sound is not audible for anyone except for the person being supported and is not noisy. This system is constructed in a shopping mall, and an experiment is conducted, in which the proposed system and guidance by a tactile map lead to a designated facility. As a result, it is confirmed, that the execution time of the proposed method is reduced. It is also confirmed that the proposed method shows higher performance in terms of the average time required to grasp the direction than the tactile map approach. In the actual environment where this system is supposed to be used, the correct answer rate is over 80%. These results suggest that the proposed method can replace the conventional tactile map as a guidance system.

Keywords