Augmented reality in computer-assisted interventions based on patient-specific 3D printed reference

Abstract

Augmented reality (AR) can be an interesting technology for clinical scenarios as an alternative to conventional surgical navigation. However, the registration between augmented data and real-world spaces is a limiting factor. In this study, the authors propose a method based on desktop three-dimensional (3D) printing to create patient-specific tools containing a visual pattern that enables automatic registration. This specific tool fits on the patient only in the location it was designed for, avoiding placement errors. This solution has been developed as a software application running on Microsoft HoloLens. The workflow was validated on a 3D printed phantom replicating the anatomy of a patient presenting an extraosseous Ewing's sarcoma, and then tested during the actual surgical intervention. The application allowed physicians to visualise the skin, bone and tumour location overlaid on the phantom and patient. This workflow could be extended to many clinical applications in the surgical field and also for training and simulation, in cases where hard body structures are involved. Although the authors have tested their workflow on AR head mounted display, they believe that a similar approach can be applied to other devices such as tablets or smartphones.

Keywords

• cancer
• augmented reality
• tumours
• computerised tomography
• medical image processing
• surgery
• bone
• image registration
• paediatrics
• augmented reality
• computer-assisted interventions
• patient-specific 3D printed reference
• real-world spaces
• patient-specific tools
• visual pattern
• automatic registration
• placement errors
• software application
• actual surgical intervention
• tumour location
• surgical field
• extraosseous Ewing sarcoma