CRGF-YOLO: An Optimized Multi-Scale Feature Fusion Model Based on YOLOv5 for Detection of Steel Surface Defects

Abstract

Abstract The identification of imperfections on steel surfaces is vital for ensuring the quality of industrial products. It requires the capability of real-time detection with high accuracy. This paper proposes the CRGF-YOLO (Contextual Reparameterized Generalized Feature) model based on YOLOv5. In the network, BottleneckCSP structures and depthwise separable convolutions utilizing the structural reparameterization are introduced to reduce the model size and improve performance. In addition, contextual transformer modules are employed as self-attention mechanisms to improve feature representations by capturing long-range dependencies, outperforming conventional convolutional networks. Furthermore, the simplified generalized feature pyramid network is embedded to aggregate multi-scale feature maps and enhance the network’s robustness. Finally, four prediction heads with different sizes are employed to predict defects, which are supported by prior bounding boxes generated using k-means clustering algorithm. The Focal-EIOU (Exponential Intersection over Union) loss function is introduced to improve detection accuracy and expedite model convergence. The improved model achieves a mean average precision (mAP) of 82.2% on the NEU-DET dataset, outperforming the baseline YOLOv5s by 7.7% mAP while maintaining real-time speeds. Comparative evaluations demonstrate CRGF-YOLO’s superior performance over previous state-of-the-art methods like Faster R-CNN (77.4% mAP), YOLOv3 (77.4% mAP), YOLOv7s (72.1% mAP), and YOLOv8s (78.7% mAP) for steel surface defect detection. Overall, this study provides valuable insights and practical guidance for the advancement of defect detection technology.

Keywords

• Defect detection
• YOLO
• Generalized feature pyramid network
• Contextual transformer
• Structural reparameterization