Registration of Consecutive Frames From Wireless Capsule Endoscopy for 3D Motion Estimation

Abstract

Wireless Capsule Endoscopy (WCE) is a non-invasive medical procedure devised for painless in vivo inspection of the gastrointestinal (GI) tract. It is especially valuable for the examination of the small intestine since it is difficult to reach by traditional endoscopic procedures. The setup includes a camera with an embedded light source and a circuit capable of acquiring and transmitting the video. The main challenge of this technology is the identification of the position and trajectory of the capsule as it travels through the GI tract, which is particularly relevant during the detection of anomalies in the tissue. Given only the information provided by the recorded images, it is possible to estimate the 3D motion of the camera capsule and provide a full trajectory reconstruction. A critical yet difficult step in this process is the image registration between sequential frames. Therefore, being able to determine accurate correspondences between points, regions or features in two consecutive frames is crucial for the computation of the relative rotation and translation of the capsule. This paper comprises a comparative assessment of methodologies to address this problem with a porcine colon dataset obtained with our experimental setup.

Keywords

• Capsule movement
• deep leaning
• feature extraction
• image-based localization
• optical flow
• wireless capsule endoscopy