IEEE Access (Jan 2020)

A Deep-Learning-Based Scheme for Detecting Driver Cell-Phone Use

  • Chongchong Jin,
  • Zhongjie Zhu,
  • Yongqiang Bai,
  • Gangyi Jiang,
  • Anqing He

DOI
https://doi.org/10.1109/ACCESS.2020.2968464
Journal volume & issue
Vol. 8
pp. 18580 – 18589

Abstract

Read online

Cell-phone use while driving results in potentially severe safety hazards. In this paper, a scheme for detecting cell-phone use that is based on deep learning is proposed, which can eliminate the potential risk by detecting the driver behavior and issuing an early warning. The proposed scheme consists of two stages: model training and practical testing. In the former, a multi-angle arrangement of cameras is first designed. Then, based on self-established data set, two independent convolutional neural networks (CNNs) are trained by optimizing the size and number of the convolution kernels, which can efficiently recognize cell-phones and hands in real time. In the testing stage, dynamic region extraction and skin color detection are employed as preprocessing to improve the accuracy of target recognition. Then, with the trained CNNs, the detection of cell-phone and hand targets is carried out, and the corresponding early warning is issued based on the distance of the interaction between the cell-phone and the hand. Numerous experiments are conducted and the results demonstrate that the proposed scheme can accurately detect cell-phone use during driving in real time, with a running time of 144 fps and an accuracy of 95.7%.

Keywords