Rotation-Invariant Siamese Network for Low-Altitude Remote-Sensing Image Registration

Abstract

Multiple-view change caused by small unmanned aerial vehicles (UAVs) monitoring the ground, resulting in image distortion, multiview transformation, and low overlap. Thus, such change has a strong effect on the accuracy of image registration. In this study, we utilize a Siamese network to deal with the complexity registration of low-altitude remote-sensing images. A robust neighbor-guided patch representation is designed to describe feature points based on neighborhood relation reconstruction, and patch selection. The network is trained based on rotation-invariant layer to solve the inevitable rotation, and nonrigid deformation caused by multiview images in low-altitude remote-sensing images. With only three training images involving 4500 putative matches, the experiment results demonstrated that the learned network can process the scenarios of yaw rotation, pitch rotation, mixture, and extreme (e.g., mixture, scaling, and distortion occur simultaneously) of UAV better than other six state-of-the-art methods.

Keywords

• Feature matching
• low-altitude remote sensing
• mismatch removal
• registration
• rotation-invariant