Информатика и автоматизация (Jun 2019)

Context-Based Rider Assistant System for Two Wheeled Self-Balancing Vehicles

  • Jeyeon Kim,
  • Kenta Sato,
  • Naohisa Hashimoto,
  • Alexey Mihajlovich Kashevnik,
  • Kohji Tomita,
  • Seiichi Miyakoshi,
  • Yusuke Takinami,
  • Osamu Matsumoto,
  • Ali Boyali

DOI
https://doi.org/10.15622/sp.2019.18.3.582-613
Journal volume & issue
Vol. 18, no. 3
pp. 583 – 614

Abstract

Read online

Personal mobility devises become more and more popular last years. Gyroscooters, two wheeled self-balancing vehicles, wheelchair, bikes, and scooters help people to solve the first and last mile problems in big cities. To help people with navigation and to increase their safety the intelligent rider assistant systems can be utilized that are used the rider personal smartphone to form the context and provide the rider with the recommendations. We understand the context as any information that characterize current situation. So, the context represents the model of current situation. We assume that rider mounts personal smartphone that allows it to track the rider face using the front-facing camera. Modern smartphones allow to track current situation using such sensors as: GPS / GLONASS, accelerometer, gyroscope, magnetometer, microphone, and video cameras. The proposed rider assistant system uses these sensors to capture the context information about the rider and the vehicle and generates context-oriented recommendations. The proposed system is aimed at dangerous situation detection for the rider, we are considering two dangerous situations: drowsiness and distraction. Using the computer vision methods, we determine parameters of the rider face (eyes, nose, mouth, head pith and rotation angles) and based on analysis of this parameters detect the dangerous situations. The paper presents a comprehensive related work analysis in the topic of intelligent driver assistant systems and recommendation generation, an approach to dangerous situation detection and recommendation generation is proposed, and evaluation of the distraction dangerous state determination for personal mobility device riders.

Keywords