Deep learning-based spectral reconstruction in camouflaged target detection

Abstract

Camouflaged target detection aims to detect targets that blend into their surroundings, but RGB has difficulty distinguishing between targets and backgrounds. While methods using multispectral image (MSI) can distinguish targets from background via spectral information, they are limited by imaging speed, resolution, and high cost for camouflaged target detection. Here, we propose a novel camouflaged target detection workflow based on reconstructed MSI from RGB image. Specifically, we propose a spectral reconstruction model, S2HFormer, which utilizes the deep neural network to fit the mapping of RGB image to MSI without additional information. And the reconstructed MSI based on S2HFormer achieves higher accuracy in both reconstruction and target detection, outperforming existing methods. Furthermore, we integrate a spectral band selection algorithm to optimize the number of bands used for improving detection efficiency. Experimental results show that the proposed method acquires MSI at 55 frames per second (FPS) and achieves an F-score of 0.925, achieving real-time (24 FPS) MSI acquisition. The evaluation indicates the effectiveness and efficiency of our method for camouflaged target detection.

Keywords

• Multispectral
• Spectral reconstruction
• Camouflaged target detection
• Deep learning
• Remote Sensing