A real-time vehicle safety system by concurrent object detection and head pose estimation via stereo vision
Julio C. Rodriguez-Quiñonez,
Jonathan J. Sanchez-Castro,
Oscar Real-Moreno,
Guillermo Galaviz,
Wendy Flores-Fuentes,
Oleg Sergiyenko,
Moises J. Castro-Toscano,
Daniel Hernandez-Balbuena
Affiliations
Julio C. Rodriguez-Quiñonez
Universidad Autónoma de Baja California, Facultad de Ingeniería, Blvd. Benito Juárez S/N, 21280, Mexicali, Baja California, Mexico; Corresponding author.
Jonathan J. Sanchez-Castro
Universidad Autónoma de Baja California, Facultad de Ingeniería, Blvd. Benito Juárez S/N, 21280, Mexicali, Baja California, Mexico; Corresponding author.
Oscar Real-Moreno
Universidad Autónoma de Baja California, Facultad de Ingeniería, Blvd. Benito Juárez S/N, 21280, Mexicali, Baja California, Mexico
Guillermo Galaviz
Universidad Autónoma de Baja California, Facultad de Ingeniería, Blvd. Benito Juárez S/N, 21280, Mexicali, Baja California, Mexico
Wendy Flores-Fuentes
Universidad Autónoma de Baja California, Facultad de Ingeniería, Blvd. Benito Juárez S/N, 21280, Mexicali, Baja California, Mexico
Oleg Sergiyenko
Instituto de Ingeniería, Universidad Autónoma de Baja California, Calle de la Normal S/N y Blvd. Benito Juárez, Col. Insurgentes Este, 21280, Mexicali, Baja California, Mexico
Moises J. Castro-Toscano
Universidad Autónoma de Baja California, Facultad de Ingeniería, Blvd. Benito Juárez S/N, 21280, Mexicali, Baja California, Mexico
Daniel Hernandez-Balbuena
Universidad Autónoma de Baja California, Facultad de Ingeniería, Blvd. Benito Juárez S/N, 21280, Mexicali, Baja California, Mexico
A considerable number of vehicular accidents occur in low-millage zones like school streets, neighborhoods, and parking lots, among others. Therefore, the proposed work aims to provide a novel ADAS system to warn about dangerous scenarios by analyzing the driver's attention and the corresponding distances between the vehicle and the detected object on the road. This approach is made possible by concurrent Head Pose Estimation (HPE) and Object/Pedestrian Detection. Both approaches have shown independently their viable application in the automotive industry to decrease the number of vehicle collisions. The proposed system takes advantage of stereo vision characteristics for HPE by enabling the computation of the Euler Angles with a low average error for classifying the driver's attention on the road using neural networks. For Object Detection, stereo vision is used to detect the distance between the vehicle and the approaching object; this is made with a state-of-the-art algorithm known as YOLO-R and a fast template matching technique known as SoRA that provides lower processing times. The result is an ADAS system designed to ensure adequate braking time, considering the driver's attention on the road and the distances to objects.