Deep-reinforcement-learning-based range-adaptive distributed power control for cellular-V2X

Abstract

A distributed congestion control must be adaptable to varying target communication ranges as cellular V2X (C-V2X) is evolving to support flexible coverage suitable for various service scenarios. This study proposes range-adaptive distributed power control (Ra-DPC) based on deep reinforcement learning (DRL) with the Monte Carlo policy gradient algorithm. A key finding is that the agents learn Ra-DPC more effectively when the cumulative interference power of the subchannels is adopted as the state of the DRL model, rather than the channel busy ratio. The proposed Ra-DPC algorithm performs better in energy efficiency and packet delivery ratio than the existing technologies.

Keywords

• C-V2X
• Distributed congestion control
• Deep reinforcement learning
• Packet delivery ratio
• Power control