Pixel-Level Intelligent Segmentation and Measurement Method for Pavement Multiple Damages Based on Mobile Deep Learning

Abstract

Regular damage detection plays an important role in timely pavement maintenance. However, the existing detection methods struggle to efficiently and accurately identify the category and contour of the damage. Therefore, this paper proposes a Road-Mask R-CNN mobile damage detection model to automatically segment and measure multiple pavement damages. First, the optimized k-means clustering algorithm is used to intelligently determine the size and ratio of the anchor. Subsequently, the traditional nonmaximum suppression (NMS) algorithm is replaced by the distance intersection over union nonmaximum suppression (DIoU-NMS) algorithm, which improves the detection accuracy of multiple damages in the same image with a mean average precision (mAP) value of 0.934. Then, a comparative experiment with U-Net, the unimproved Mask R-CNN, MSNet and the unsupervised domain adaptation network (UDA) is carried out to verify the effectiveness of the proposed model. And combined with the segmentation and measurement results, the damage is quantitatively evaluated. Moreover, a webcam damage detection system combined with a workstation and an automatic damage detection system for smartphones is developed to quickly detect multiple types of pavement damage. In addition, on- site experiments are carried out on real pavements to verify the feasibility and effectiveness of the proposed method.

Keywords

• Mobile deep learning
• road-mask R-CNN
• pavement damages
• smartphones