IEEE Access (Jan 2023)

IoT-Based Non-Intrusive Automated Driver Drowsiness Monitoring Framework for Logistics and Public Transport Applications to Enhance Road Safety

  • M. Adil Khan,
  • Tahir Nawaz,
  • Umar S. Khan,
  • Amir Hamza,
  • Nasir Rashid

DOI
https://doi.org/10.1109/ACCESS.2023.3244008
Journal volume & issue
Vol. 11
pp. 14385 – 14397

Abstract

Read online

The exponential growth in road accidents has led to a need for continuous driver monitoring to enhance road safety. Existing techniques rely on vehicle sensor-based and behavior analysis-based approaches, where the behavior analysis-based approaches are generally considered more desirable as they enable reliable detection of a more elaborate set of driver behaviors. They are categorized as intrusive and non-intrusive approaches. Unlike intrusive approaches that generally rely on constant direct human contact with sensors (physiological signals) and are sensitive to artifacts, non-intrusive approaches offer a more effective behavior monitoring using computer vision-based techniques. This paper proposes an end-to-end non-intrusive IoT-based automated framework to monitor driver behaviors, designed specifically for logistic and public transport applications. It consists of an embedded system, edge computing and cloud computing modules, and a mobile phone application, in an attempt to provide a holistic unified solution for drowsiness detection, monitoring, as well as evaluation of drivers. Drowsiness detection is based on detecting sleeping, yawning, and distraction behaviors using an image processing-based technique. To minimize the effects of latency, throughput, and packet losses, edge computing is performed using commercial off-the-shelf embedded boards. Moreover, a cloud-hosted real-time database for remote monitoring on interactive Android mobile application has been set up, where admin can add multiple drivers to get drowsiness notifications along with other useful related information for driver evaluation. An extensive experimental testing has been performed, obtaining encouraging results. An overall accuracy of 96% is achieved along with an enhanced robustness, portability, and usability of the proposed framework.

Keywords