Surround Vehicle Motion Prediction Using LSTM-RNN for Motion Planning of Autonomous Vehicles at Multi-Lane Turn Intersections

Abstract

This paper presents a surround vehicle motion prediction algorithm for multi-lane turn intersections using a Long Short-Term Memory (LSTM)-based Recurrent Neural Network (RNN). The motion predictor is trained using the states of subject and surrounding vehicles, which are collected by sensors mounted on an autonomous vehicle. Data on 484 vehicle trajectories were collected from real traffic situations at multi-lane turn intersections. 11,662 and 4,998 samples acquired from the vehicle trajectories were used to train and evaluate the networks, respectively. A motion planner based on Model Predictive Control (MPC) is designed to determine the longitudinal acceleration command based on the predicted states of surrounding vehicles. The future states of the subject vehicle derived by MPC is used as an input feature to reflect the interaction of subject and target vehicles in LSTM-RNN based motion predictor. The proposed algorithm was evaluated in terms of its accuracy and its effects on the motion planning algorithm based on the driving data sets. The improved prediction accuracy substantially increased safety by bounding the prediction error within the safety margin. The application results of the proposed predictor demonstrate the improved recognition timing of the preceding vehicle and the similarity of longitudinal acceleration with drivers.

Keywords

• Autonomous vehicle
• intersection driving data
• motion prediction
• machine learning
• recurrent neural network
• long short-term memory