Mixed reality-integrated soft wearable biosensing glove for manipulating objects

Jihoon Kim; Allison Bayro; Jaeho Lee; Ira Soltis; Myunghee Kim; Heejin Jeong; Woon-Hong Yeo

Biosensors and Bioelectronics: X (Sep 2023)

Mixed reality-integrated soft wearable biosensing glove for manipulating objects

Jihoon Kim,
Allison Bayro,
Jaeho Lee,
Ira Soltis,
Myunghee Kim,
Heejin Jeong,
Woon-Hong Yeo

Affiliations

Jihoon Kim: George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA; IEN Center for Human-Centric Interfaces and Engineering, Institute for Electronics and Nanotechnology, Georgia Institute of Technology, Atlanta, GA, 30332, USA
Allison Bayro: School of Biological and Health Systems Engineering, Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ, 85287, USA
Jaeho Lee: George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA; IEN Center for Human-Centric Interfaces and Engineering, Institute for Electronics and Nanotechnology, Georgia Institute of Technology, Atlanta, GA, 30332, USA
Ira Soltis: George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA; IEN Center for Human-Centric Interfaces and Engineering, Institute for Electronics and Nanotechnology, Georgia Institute of Technology, Atlanta, GA, 30332, USA
Myunghee Kim: Department of Mechanical and Industrial Engineering, The University of Illinois at Chicago, Chicago, IL, 60607, USA
Heejin Jeong: School of Biological and Health Systems Engineering, Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ, 85287, USA; The Polytechnic School, Ira A. Fulton Schools of Engineering, Arizona State University, Mesa, AZ, 85212, USA; Corresponding author. The Polytechnic School, Ira A. Fulton Schools of Engineering, Arizona State University, Mesa, AZ, 85212, USA.
Woon-Hong Yeo: George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA; IEN Center for Human-Centric Interfaces and Engineering, Institute for Electronics and Nanotechnology, Georgia Institute of Technology, Atlanta, GA, 30332, USA; Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University School of Medicine, Atlanta, GA, 30332, USA; Parker H. Petit Institute for Bioengineering and Biosciences, Institute for Materials, Neural Engineering Center, and Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA, 30332, USA; Corresponding author. George W. Woodruff School of Mechanical Engineering, IEN Center for Human-Centric Interfaces, Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA.

Journal volume & issue: Vol. 14
p. 100343

Abstract

Read online

Recent advances in flexible sensors and wireless electronics have driven the development of lightweight and ergonomic wearable sensing gloves. Such gloves can be employed in mixed reality (MR) environments to give haptic capabilities during interactions with various objects. However, no prior study shows a quantitative measurement of physical user interactions of object manipulation in MR. Here, we report an MR-integrated soft bioelectronic system on a glove for quantifying the changes in the user's pinching tasks. We use nanomanufacturing techniques to fabricate flexible sensors, wireless circuits, and stretchable interconnectors seamlessly integrated with a wearable glove. The wearable biosensing glove with an integrated capacitive pressure sensor evaluates how users interact directly and indirectly interact with objects. The direct mode describes a user's direct touching and manipulating objects in MR. In contrast, in the indirect mode, objects are located far away and touched via a narrow light beam. The virtual object measurement parameters include mass, movement latency, dynamic friction coefficient, angular drag coefficient, and linear drag coefficient. The experimental results with human subjects show positive, linear relationships between pinching force and dynamic friction coefficient and mass parameters during the direct manipulation mode. Collectively, the MR-enabled wearable biosensing glove system offers unique advantages in detecting physical interactions and sensory feedback for various rehabilitation applications and MR human-machine interfaces.

Published in Biosensors and Bioelectronics: X

ISSN: 2590-1370 (Online)
Publisher: Elsevier
Country of publisher: Netherlands
LCC subjects: Technology: Chemical technology: Biotechnology
Website: https://www.journals.elsevier.com/biosensors-and-bioelectronics-x

About the journal

Abstract

Keywords