Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features

Abstract

When traditional 3D reconstruction techniques were used to reconstruct a scene with hidden and disguised heat source targets, the reconstructed scene could not contain these targets; thus, we could not recognize them. The disadvantages of such problems are particularly acute in the military and remote-sensing areas. For this application problem, the authors proposed a visible/infrared combined 3D reconstruction scheme. The 3D scene containing thermal radiation information could be reconstructed by fusing the data from RGB optical and infrared images combined with computer vision passive optical 3D scene reconstruction technique. Meanwhile, the authors proposed the nonrigid registration of multi-modality images with mixed features to solve the problem that the registration algorithm, which is widely used in traditional passive reconstruction technology, cannot accurately match visible and infrared images. Registration accuracy was improved by approximately 40%, experimental results showed that the visible/infrared combined 3D reconstruction scenes retain the visual reality of the traditional 3D reconstruction, and the hidden targets are highlighted in the scenes, which is conducive to the detection and recognition of interesting targets.

Keywords

• 3D reconstruction
• mixed features
• nonrigid registration
• visible/infrared combined