Material identification of construction machinery based on multisource sensor information fusion

Abstract

Abstract In order to improve the recognition accuracy of construction machinery and equipment and materials in low contrast scenes, a construction machinery material recognition algorithm based on multisource sensor information fusion is proposed. In the paper, the millimeter wave radar is fused with the camera considering its strong penetration ability in rainy and foggy days and dim environments. Firstly, the spatial coordinates of radar and camera are unified by establishing a spatial fusion model of millimeter wave and camera; then the target acquired by millimeter wave is projected onto the image and the detection frame intersection and ratio model is used to generate the region of interest of the camera; finally, the improved YOLOv2 algorithm is used to identify the region of interest, and in the improved idea, the low‐level information is first connected with the high‐level information in multilayer depth. At the same time, a multiscale feature pyramid network structure is used to achieve recognition of objects of different scales. This model effectively reduces interference from other feature categories while improving the recognition efficiency of the system. The algorithm can effectively improve the recognition accuracy of mechanical materials in low‐contrast scenes, as demonstrated by the validation of different scenes.

Keywords

• multisource information fusion
• radar
• recognition
• vision
• YOLOv2 algorithm