Hologram accuracy evaluation of HoloLens 2 for thermal imaging in medical applications

Abstract

Surgical navigation-assisted interventions, providing augmented previously acquired image data to support the physician, are routinely used. Visualization techniques like extended reality (XR) promise improvements because the desired information can be shown where most suitable. The accuracy of such systems is essential for usability in clinical interventions but lacks research. This work shows a system to project thermal data for use in reconstructive surgery and investigates the accuracy of the XR technology. The system consists of a thermal camera (PI450, Optris GmbH, Germany), a depth camera system (D415, Intel Inc., USA), and a HoloLens2 (Microsoft Corp., USA). 5 probands annotated the locations of 9 marker points on a calibration pattern of the real object and the projection in the XR headset. The mean and max residual projection errors were 2.8 and 6.2 mm, respectively. An XR system to superimpose thermal images was shown. The mean projection error of 2.8 mm is sufficient for further exploration of medical applications.

Keywords

• extended reality
• augmented reality
• xr
• ar
• thermal imaging