Journal of Advanced Transportation (Jan 2020)

Traffic Status Prediction of Arterial Roads Based on the Deep Recurrent Q-Learning

  • Wei Hao,
  • Donglei Rong,
  • Kefu Yi,
  • Qiang Zeng,
  • Zhibo Gao,
  • Wenguang Wu,
  • Chongfeng Wei,
  • Biljana Scepanovic

DOI
https://doi.org/10.1155/2020/8831521
Journal volume & issue
Vol. 2020

Abstract

Read online

With the exponential growth of traffic data and the complexity of traffic conditions, in order to effectively store and analyse data to feed back valid information, this paper proposed an urban road traffic status prediction model based on the optimized deep recurrent Q-Learning method. The model is based on the optimized Long Short-Term Memory (LSTM) algorithm to handle the explosive growth of Q-table data, which not only avoids the gradient explosion and disappearance but also has the efficient storage and analysis. The continuous training and memory storage of the training sets are used to improve the system sensitivity, and then, the test sets are predicted based on the accumulated experience pool to obtain high-precision prediction results. The traffic flow data from Wanjiali Road to Shuangtang Road in Changsha City are tested as a case. The research results show that the prediction of the traffic delay index is within a reasonable interval, and it is significantly better than traditional prediction methods such as the LSTM, K-Nearest Neighbor (KNN), Support Vector Machines (SVM), exponential smoothing method, and Back Propagation (BP) neural network, which shows that the model proposed in this paper has the feasibility of application.