IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2023)

An Improved Lightweight Yolo-Fastest V2 for Engineering Vehicle Recognition Fusing Location Enhancement and Adaptive Label Assignment

  • Hairong Zhang,
  • Dongsheng Xu,
  • Dayu Cheng,
  • Xiaoliang Meng,
  • Geng Xu,
  • Wei Liu,
  • Teng Wang

DOI
https://doi.org/10.1109/JSTARS.2023.3249216
Journal volume & issue
Vol. 16
pp. 2450 – 2461

Abstract

Read online

Engineering vehicle recognition based on video surveillance is one of the key technologies to assist illegal land use monitoring. At present, the engineering vehicle recognition mainly adopts the traditional deep learning model with a large number of floating-point operations. So, it cannot be achieved in edge devices with limited computing power and storage in real time. In addition, some lightweight models have problems with inaccurate bounding box locating, low recognition rate, and unreasonable selection of positive training samples for the small object. To solve the problems, the article proposes an improved lightweight Yolo-Fastest V2 for engineering vehicle recognition fusing location enhancement and adaptive label assignment. The location-enhanced feature pyramid network structure combines deep and shallow feature maps to accurately localize bounding boxes. The grouping k-means clustering strategy and adaptive label assignment algorithm select an appropriate anchor for each object based on its shape and Intersection over Union. The study was conducted on Raspberry Pi 4B 2018 using two datasets and different models. Experiments show that our method achieves the optimal combination in speed and accuracy. Specifically, the mAP50 is increased by 7.02% with the speed of 11.24 fps under the engineering vehicle data obtained by video surveillance in a rural area of China.

Keywords