Exploring the dynamics of user experience and interaction in XR-enhanced robotic surgery: a systematic review

Yaning Li; Yaning Li; Meng Li; Shucheng Zheng; Shucheng Zheng; Luxi Yang; Luxi Yang; Lanqing Peng; Chiyang Fu; Yuexi Chen; Yuexi Chen; Chenxi Wang; Chenxi Wang; Chenyi Chen; Chenyi Chen; Bingyan Li; Boyuan Xiong; Sofia Breschi; Yawei Liu; Yawei Liu; Mohammad Shidujaman; Pietro Piazzolla; Yu Zhang; Elena De Momi; Daan van Eijk

doi:10.3389/frvir.2024.1461105

Frontiers in Virtual Reality (Nov 2024)

Exploring the dynamics of user experience and interaction in XR-enhanced robotic surgery: a systematic review

Yaning Li,
Yaning Li,
Meng Li,
Shucheng Zheng,
Shucheng Zheng,
Luxi Yang,
Luxi Yang,
Lanqing Peng,
Chiyang Fu,
Yuexi Chen,
Yuexi Chen,
Chenxi Wang,
Chenxi Wang,
Chenyi Chen,
Chenyi Chen,
Bingyan Li,
Boyuan Xiong,
Sofia Breschi,
Yawei Liu,
Yawei Liu,
Mohammad Shidujaman,
Pietro Piazzolla,
Yu Zhang,
Elena De Momi,
Daan van Eijk

Affiliations

Yaning Li: Joint School of Design and Innovation, Xi’an Jiaotong University, Xi’an, China
Yaning Li: XJTU-POLIMI Joint School of Design and Innovation, Politecnico di Milano, Milan, Italy
Meng Li: School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
Shucheng Zheng: Joint School of Design and Innovation, Xi’an Jiaotong University, Xi’an, China
Shucheng Zheng: XJTU-POLIMI Joint School of Design and Innovation, Politecnico di Milano, Milan, Italy
Luxi Yang: Joint School of Design and Innovation, Xi’an Jiaotong University, Xi’an, China
Luxi Yang: XJTU-POLIMI Joint School of Design and Innovation, Politecnico di Milano, Milan, Italy
Lanqing Peng: School of Future Technology, Xi’an Jiaotong University, Xi’an, China
Chiyang Fu: School of Future Technology, Xi’an Jiaotong University, Xi’an, China
Yuexi Chen: Joint School of Design and Innovation, Xi’an Jiaotong University, Xi’an, China
Yuexi Chen: XJTU-POLIMI Joint School of Design and Innovation, Politecnico di Milano, Milan, Italy
Chenxi Wang: Joint School of Design and Innovation, Xi’an Jiaotong University, Xi’an, China
Chenxi Wang: XJTU-POLIMI Joint School of Design and Innovation, Politecnico di Milano, Milan, Italy
Chenyi Chen: Joint School of Design and Innovation, Xi’an Jiaotong University, Xi’an, China
Chenyi Chen: XJTU-POLIMI Joint School of Design and Innovation, Politecnico di Milano, Milan, Italy
Bingyan Li: Department of Orthopaedics, The First Affiliated Hospital of Xi’an Jiaotong University, Xi’an Jiaotong University, Xi’an, China
Boyuan Xiong: School of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an, China
Sofia Breschi: Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
Yawei Liu: School of Basic Medicine, Capital Medical University, Beijing, China
Yawei Liu: Luhe Clinical Medical College, Capital Medical University, Beijing, China
Mohammad Shidujaman: 0Department of Computer Science and Engineering, Independent University, Bangladesh, Dhaka, Bangladesh
Pietro Piazzolla: 1Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy
Yu Zhang: School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
Elena De Momi: Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
Daan van Eijk: 2Department of Human-Centered Design, Faculty of Industrial Design Engineering, Delft Technology of University, Delft, Netherlands

DOI: https://doi.org/10.3389/frvir.2024.1461105
Journal volume & issue: Vol. 5

Abstract

Read online

Robotic surgery, also known as robotic-assisted surgery (RAS), has rapidly evolved during the last decade. RAS systems are developed to assist surgeons to perform complex minimally invasive surgeries, and necessitate augmented interfaces for precise execution of these image-guided procedures. Extended Reality (XR) technologies, augmenting the real-world perception via integrating digital contents, show promise in enhancing RAS efficacy in various studies. Despite multiple reviews on technological and medical aspects, the crucial elements of human-robot interaction (HRI) and user experience (UX) remain underexplored. This review fills this gap by elucidating HRI dynamics within XR-aided RAS systems, emphasizing their impact on UX and overall surgical outcomes. By synthesizing existing literature, this systematic review study identifies challenges and opportunities, paving the way for improved XR-enhanced robotic surgery, ultimately enhancing patient care and surgical performance.

Published in Frontiers in Virtual Reality

ISSN: 2673-4192 (Online)
Publisher: Frontiers Media S.A.
Country of publisher: Switzerland
LCC subjects: Science: Mathematics: Instruments and machines: Electronic computers. Computer science
Website: https://www.frontiersin.org/journals/virtual-reality#

About the journal

Abstract

Keywords