Multimodal Technologies and Interaction (Aug 2023)

Exploring a Novel Mexican Sign Language Lexicon Video Dataset

  • Víctor Martínez-Sánchez,
  • Iván Villalón-Turrubiates,
  • Francisco Cervantes-Álvarez,
  • Carlos Hernández-Mejía

DOI
https://doi.org/10.3390/mti7080083
Journal volume & issue
Vol. 7, no. 8
p. 83

Abstract

Read online

This research explores a novel Mexican Sign Language (MSL) lexicon video dataset containing the dynamic gestures most frequently used in MSL. Each gesture consists of a set of different versions of videos under uncontrolled conditions. The MX-ITESO-100 dataset is composed of a lexicon of 100 gestures and 5000 videos from three participants with different grammatical elements. Additionally, the dataset is evaluated in a two-step neural network model as having an accuracy greater than 99% and thus serves as a benchmark for future training of machine learning models in computer vision systems. Finally, this research provides an inclusive environment within society and organizations, in particular for people with hearing impairments.

Keywords