Water‐surface infrared small object detection based on spatial feature weighting and class balancing method

Abstract

Abstract Infrared imaging is widely used due to its penetration capability to operate under many weather or lighting condition. However, due to the far distance of aerial view, feature blur, and the scarcity of aerial infrared data, the detection of small infrared targets on the water surface remains a challenging problem. In response to the problem of unclear features, we propose the spatial feature weighting method based on 2D Gaussian distribution. This method increases the weight of the target area by adaptively adjusting the feature activation. Secondly, for the problem of rare aerial perspective infrared data, we propose the cross‐spectral data migration method. By introducing the domain difference loss function to optimize the pseudo‐label selection process, the range of target domain distribution is expanded, and the adaptability of the detector is improved. Finally, in response to the problem of underfitting caused by category imbalance in transfer learning, we propose the class balancing method that effectively reduces the false detection. Extensive experiments were conducted on both benchmark datasets and the self‐built dataset to evaluate the effectiveness and robustness of our method. The proposed method was evaluated with different models and various scenarios, and the results demonstrated the effectiveness.

Keywords

• computer vision
• convolutional neural nets
• feature extraction
• Gaussian distribution
• image processing
• infrared detectors