Trajectory Planning for Multiple Autonomous Vehicles at Short‐Distance Tandem Signalized Intersections Based on Rule‐Free Framework

Abstract

High‐level autonomous vehicles (AVs) have more possibilities for improving traffic efficiency. The improvement of traffic efficiency for mixed flow at near‐saturated short‐distance tandem signalized intersections (STSI) needs attention. Most of the existing studies design a generalized control rule for AVs, ignoring the heterogeneity among different AVs. Herein, a multivehicle trajectory planning framework based on a multiagent reinforcement learning (MRL) algorithm is designed to heuristically explore the optimal traffic efficiency of mixed flow at STSI. The core algorithm of this framework is improved from the classical MRL algorithm multi‐agent proximal policy optimization based on the idea of the virtual group instead of designing control rules. The trajectories planned by the framework show outstanding performance in improving throughputs and reducing emissions at the global system level, comparing natural driving, classic adaptive cruise control model and cooperative adaptive cruise control model. The framework can be used to explore optimal traffic efficiency for mixed flow and better heterogeneous rules for high‐level AVs.

Keywords

• autonomous vehicles
• heterogeneity
• multiagent reinforcement learning
• traffic efficiency
• trajectory planning frameworks