Computer Vision Method for Automatic Detection of Microstructure Defects of Concrete
Alexey N. Beskopylny,
Sergey A. Stel’makh,
Evgenii M. Shcherban’,
Irina Razveeva,
Alexey Kozhakin,
Besarion Meskhi,
Andrei Chernil’nik,
Diana Elshaeva,
Oksana Ananova,
Mikhail Girya,
Timur Nurkhabinov,
Nikita Beskopylny
Affiliations
Alexey N. Beskopylny
Department of Transport Systems, Faculty of Roads and Transport Systems, Don State Technical University, 344003 Rostov-on-Don, Russia
Sergey A. Stel’makh
Department of Unique Buildings and Constructions Engineering, Don State Technical University, 344003 Rostov-on-Don, Russia
Evgenii M. Shcherban’
Department of Engineering Geometry and Computer Graphics, Don State Technical University, 344003 Rostov-on-Don, Russia
Irina Razveeva
Department of Unique Buildings and Constructions Engineering, Don State Technical University, 344003 Rostov-on-Don, Russia
Alexey Kozhakin
Department of Unique Buildings and Constructions Engineering, Don State Technical University, 344003 Rostov-on-Don, Russia
Besarion Meskhi
Department of Life Safety and Environmental Protection, Faculty of Life Safety and Environmental Engineering, Don State Technical University, 344003 Rostov-on-Don, Russia
Andrei Chernil’nik
Department of Unique Buildings and Constructions Engineering, Don State Technical University, 344003 Rostov-on-Don, Russia
Diana Elshaeva
Department of Unique Buildings and Constructions Engineering, Don State Technical University, 344003 Rostov-on-Don, Russia
Oksana Ananova
Department of Marketing and Engineering Economics, Faculty of Innovative Business and Management, Don State Technical University, 344003 Rostov-on-Don, Russia
Mikhail Girya
Department of Unique Buildings and Constructions Engineering, Don State Technical University, 344003 Rostov-on-Don, Russia
Timur Nurkhabinov
Department of Mathematical Theory of Intelligent Systems, Faculty of Mechanics and Mathematics, Lomonosov Moscow State University, Leninskiye Gory, 1, 119991 Moscow, Russia
Nikita Beskopylny
Department of Hardware and Software Engineering, Faculty of IT-Systems and Technology, Don State Technical University, 344003 Rostov-on-Don, Russia
The search for structural and microstructural defects using simple human vision is associated with significant errors in determining voids, large pores, and violations of the integrity and compactness of particle packing in the micro- and macrostructure of concrete. Computer vision methods, in particular convolutional neural networks, have proven to be reliable tools for the automatic detection of defects during visual inspection of building structures. The study’s objective is to create and compare computer vision algorithms that use convolutional neural networks to identify and analyze damaged sections in concrete samples from different structures. Networks of the following architectures were selected for operation: U-Net, LinkNet, and PSPNet. The analyzed images are photos of concrete samples obtained by laboratory tests to assess the quality in terms of the defection of the integrity and compactness of the structure. During the implementation process, changes in quality metrics such as macro-averaged precision, recall, and F1-score, as well as IoU (Jaccard coefficient) and accuracy, were monitored. The best metrics were demonstrated by the U-Net model, supplemented by the cellular automaton algorithm: precision = 0.91, recall = 0.90, F1 = 0.91, IoU = 0.84, and accuracy = 0.90. The developed segmentation algorithms are universal and show a high quality in highlighting areas of interest under any shooting conditions and different volumes of defective zones, regardless of their localization. The automatization of the process of calculating the damage area and a recommendation in the “critical/uncritical” format can be used to assess the condition of concrete of various types of structures, adjust the formulation, and change the technological parameters of production.