Biomimetic Intelligence and Robotics (Sep 2023)
Surgical instruments hyalinization: Occlusion removal in minimally invasive endoscopic surgery
Abstract
Minimal invasion is an important trend in surgery. However, the endoscope, as one of the key devices for monitoring the process of minimally invasive surgery, is limited by its size and working space it operates in, which result in a considerably narrow field of view. In particular, when a surgical instrument enters through the tool channel, the instrument occupies most of the area in an endoscopic image. This hampers the surgeon’s field of view and has a negative impact on the surgery. This study proposes a novel method for removing the occlusion caused by surgical instruments in endoscopic images by making foreground occlusions on endoscopic images transparent using image restoration and interframe information filling. Compared with unprocessed images, this method can provide a clearer field of view that is necessary for minimally invasive endoscopic surgeries and improve the quality of surgeries. Clinical endoscopic images are used to verify the feasibility of the proposed method, and the results show that the proposed method improves the visual effect of endoscopic images by removing surgical-instrument occlusions. This demonstrates the considerable potential of the proposed method for use in clinical applications.