Multimodal Technologies and Interaction (Aug 2023)

Design and Research of a Sound-to-RGB Smart Acoustic Device

  • Zlatin Zlatev,
  • Julieta Ilieva,
  • Daniela Orozova,
  • Galya Shivacheva,
  • Nadezhda Angelova

DOI
https://doi.org/10.3390/mti7080079
Journal volume & issue
Vol. 7, no. 8
p. 79

Abstract

Read online

This paper presents a device that converts sound wave frequencies into colors to assist people with hearing problems in solving accessibility and communication problems in the hearing-impaired community. The device uses a precise mathematical apparatus and carefully selected hardware to achieve accurate conversion of sound to color, supported by specialized automatic processing software suitable for standardization. Experimental evaluation shows excellent performance for frequencies below 1000 Hz, although limitations are encountered at higher frequencies, requiring further investigation into advanced noise filtering and hardware optimization. The device shows promise for various applications, including education, art, and therapy. The study acknowledges its limitations and suggests future research to generalize the models for converting sound frequencies to color and improving usability for a broader range of hearing impairments. Feedback from the hearing-impaired community will play a critical role in further developing the device for practical use. Overall, this innovative device for converting sound to color represents a significant step toward improving accessibility and communication for people with hearing challenges. Continued research offers the potential to overcome challenges and extend the benefits of the device to a variety of areas, ultimately improving the quality of life for people with hearing impairments.

Keywords