Sensors (Jan 2019)

Deep RetinaNet-Based Detection and Classification of Road Markings by Visible Light Camera Sensors

  • Toan Minh Hoang,
  • Phong Ha Nguyen,
  • Noi Quang Truong,
  • Young Won Lee,
  • Kang Ryoung Park

DOI
https://doi.org/10.3390/s19020281
Journal volume & issue
Vol. 19, no. 2
p. 281

Abstract

Read online

Detection and classification of road markings are a prerequisite for operating autonomous vehicles. Although most studies have focused on the detection of road lane markings, the detection and classification of other road markings, such as arrows and bike markings, have not received much attention. Therefore, we propose a detection and classification method for various types of arrow markings and bike markings on the road in various complex environments using a one-stage deep convolutional neural network (CNN), called RetinaNet. We tested the proposed method in complex road scenarios with three open datasets captured by visible light camera sensors, namely the Malaga urban dataset, the Cambridge dataset, and the Daimler dataset on both a desktop computer and an NVIDIA Jetson TX2 embedded system. Experimental results obtained using the three open databases showed that the proposed RetinaNet-based method outperformed other methods for detection and classification of road markings in terms of both accuracy and processing time.

Keywords