An advanced heat source localization technology for intelligent warehousing: A multi-source fusion image segmentation approach leveraging infrared and visible light data

Abstract

Infrared thermography technology, leveraging its unique ability to capture temperature features, has significantly improved the precision of high-temperature target localization. However, infrared imaging technology is limited by issues such as low image contrast, difficulty in distinguishing object categories, and limited image clarity. To enable intelligent detection of high-temperature objects that may cause fires in warehouses, this paper proposes an innovative method that integrates deep learning image segmentation with infrared and visible light image technology. We developed a new image segmentation model based on improved Fully Convolutional Networks and Deconvolutional Networks, introducing a batch normalization layer to accelerate convergence and employing the PReLU activation function to prevent neuron death, thereby enhancing convergence speed and accuracy. Through a feature dynamic image registration method combining a joint model and a cross-modulation strategy, we achieved efficient image fusion. In addition, a game theory-based strategy was adopted to correct localization results, ensuring accuracy. Experimental results demonstrate that the improved model achieves localization accuracy and precision rates of up to 89.30% and 88.00%, respectively, in real-world warehouse heat source scenarios, representing a significant improvement of 9.90% and 2.85% compared to the pre-improvement model, fully validating its advancement and effectiveness.