Design and Experimental Validation of an Augmented Reality System With Wireless Integration for Context Aware Enhanced Show Experience in Auditoriums

I. Picallo; A. Vidal-Balea; O. Blanco-Novoa; P. Lopez-Iturri; P. Fraga-Lamas; H. Klaina; T. M. Fernandez-Carames; L. Azpilicueta; F. Falcone

doi:10.1109/ACCESS.2020.3048203

IEEE Access (Jan 2021)

Design and Experimental Validation of an Augmented Reality System With Wireless Integration for Context Aware Enhanced Show Experience in Auditoriums

I. Picallo,
A. Vidal-Balea,
O. Blanco-Novoa,
P. Lopez-Iturri,
P. Fraga-Lamas,
H. Klaina,
T. M. Fernandez-Carames,
L. Azpilicueta,
F. Falcone

Affiliations

I. Picallo: ORCiD; Department of Electric, Electronic and Communication Engineering, Public University of Navarre, Pamplona, Spain
A. Vidal-Balea: ORCiD; Department of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, Coruña, Spain
O. Blanco-Novoa: ORCiD; Department of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, Coruña, Spain
P. Lopez-Iturri: ORCiD; Department of Electric, Electronic and Communication Engineering, Public University of Navarre, Pamplona, Spain
P. Fraga-Lamas: ORCiD; Department of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, Coruña, Spain
H. Klaina: ORCiD; Department of Signal theory and Communications, University of Vigo, Vigo, Spain
T. M. Fernandez-Carames: ORCiD; Department of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, Coruña, Spain
L. Azpilicueta: ORCiD; School of Engineering and Sciences, Tecnologico de Monterrey, Monterrey, Mexico
F. Falcone: ORCiD; Department of Electric, Electronic and Communication Engineering, Public University of Navarre, Pamplona, Spain

DOI: https://doi.org/10.1109/ACCESS.2020.3048203
Journal volume & issue: Vol. 9
pp. 5466 – 5484

Abstract

Read online

The development of multiple cultural and social related activities, such as shows related with the performing arts, conferences or presentations rely on facilities such as auditoriums, theatres and conference sites, which are progressively including multiple technological features in order to enhance user experience. There are still however situations in which user experience is limited owing to lack of environment adaption, such as people with disabilities. In this sense, the adoption of Context Aware paradigms within auditoriums can provide adequate functionalities in order to comply with specific needs. This work is aimed at demonstrating the feasibility in enhancing user experience (e.g., improving the autonomy of disabled people) within auditorium and theatre environments, by means of an Augmented Reality (AR) device (HoloLens smart glasses) with wireless system integration. To carry out the demonstration, different elements to build AR applications are described and tested. First, an intensive measurement campaign was performed in a real auditorium in the city of Pamplona (Baluarte Congress Center) in order to evaluate the feasibility of using Wi-Fi enabled AR devices in a complex wireless propagation scenario. The results show that these environments exhibit high levels of interference, owing to the co-existence and non-coordinated operation of multiple wireless communication systems, such as on site and temporary Wi-Fi access points, wireless microphones or communications systems used by performers, staff and users. Deterministic wireless channel estimation based in volumetric 3D Ray Launching have been obtained for the complete scenario volume, in order to assess quality of service metrics. For illustration purposes, a user-friendly application to help hearing impaired people was developed and its main features were tested in the auditorium. Such an application provides users with a 3D virtual space to visualize useful multimedia content like subtitles or additional information about the show, as well as an integrated call button.

Published in IEEE Access

ISSN: 2169-3536 (Online)
Publisher: IEEE
Country of publisher: United States
LCC subjects: Technology: Electrical engineering. Electronics. Nuclear engineering
Website: https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6287639

About the journal

Abstract

Keywords