A Pavement Crack Detection Method via Deep Learning and a Binocular-Vision-Based Unmanned Aerial Vehicle

Abstract

This study aims to enhance pavement crack detection methods by integrating unmanned aerial vehicles (UAVs) with deep learning techniques. Current methods encounter challenges such as low accuracy, limited efficiency, and constrained application scenarios. We introduce an innovative approach that employs a UAV equipped with a binocular camera for identifying pavement surface cracks. This method is augmented by a binocular ranging algorithm combined with edge detection and skeleton extraction algorithms, enabling the quantification of crack widths without necessitating a preset shooting distance—a notable limitation in existing UAV crack detection applications. We developed an optimized model to enhance detection accuracy, incorporating the YOLOv5s network with an Efficient Channel Attention (ECA) mechanism. This model features a decoupled head structure, replacing the original coupled head structure to optimize detection performance, and utilizes a Generalized Intersection over Union (GIoU) loss function for refined bounding box predictions. Post identification, images within the bounding boxes are segmented by the Unet++ network to accurately quantify cracks. The efficacy of the proposed method was validated on roads in complex environments, achieving a mean Average Precision (mAP) of 86.32% for crack identification and localization with the improved model. This represents a 5.30% increase in the mAP and a 6.25% increase in recall compared to the baseline network. Quantitative results indicate that the measurement error margin for crack widths was 10%, fulfilling the practical requirements for pavement crack quantification.

Keywords

• pavement crack detection
• YOLOv5s
• U-Net++
• binocular vision
• unmanned aerial vehicle