An Efficient Knowledge Distillation-Based Detection Method for Infrared Small Targets

Abstract

Infrared small-target detection is now commonly used in maritime surveillance, flight guidance, and other fields. However, extracting small targets from complex backgrounds remains a challenging task due to the small-target scale and complex imaging environment. Many studies are based on designing model structures to enhance the precision of target detection, and the number of Params and FLOPs has been significantly augmented. In this work, a knowledge distillation-based detection method (KDD) is proposed to overcome this challenge. KDD employs the small-target labeling information provided by a large-scale teacher model to refine the training process of students, thereby improving the performance and becoming lightweight. Specifically, we added efficient local attention (ELA), which can accurately identify areas of interest while avoiding dimensionality reduction. In addition, we also added the group aggregation bridge (GAB) module to connect low-level and high-level features for the fusion of different feature scales. Furthermore, a feature fusion loss was introduced to enhance the precision of target detection. Extensive evaluations have demonstrated that KDD performs better compared to several methods, achieving extremely low Params and FLOPs, as well as higher FPS.

Keywords

• infrared small-target detection
• knowledge distillation
• lightweight
• complex background