Decision-level fusion detection method of visible and infrared images under low light conditions

Abstract

Abstract Aiming at the problem of poor effect of object detection with visible images under low light conditions, the decision-level fusion detection method of visible and infrared images is studied. Taking YOLOX as the object detection network based on deep learning, a decision-level fusion detection algorithm of visible and infrared images based on light sensing is proposed. Experiments are carried out on LLVIP dataset, which is a visible-infrared paired dataset for low light vision. Through comparative analysis, it is found that the decision-level fusion algorithm based on Soft-NMS and light sensing obtained the optimal AP value of 69.0%, which is 11.4% higher than the object detection with visible images and 1.1% higher than the object detection with infrared images. The experimental results show that the decision-level fusion algorithm based on Soft-NMS and light sensing can effectively fuse the complementary information of visible and infrared images, and improve the object detection effect under low light conditions.

Keywords

• Visible and infrared images
• Decision-level fusion
• Object detection
• Deep learning
• YOLOX