Dynamic Pricing Strategy of Electric Vehicle Aggregators Based on DDPG Reinforcement Learning Algorithm

Abstract

The fixed service charge pricing model adopted by traditional electric vehicle aggregators (EVAs) is difficult to effectively guide the demand side resources to respond to the power market price signal. At the same time, real-time pricing strategy can flexibly reflect the situation of market supply and demand, shift the charging load of electric vehicles (EVs), reduce the negative impact of disorderly charging on the stable operation of power systems, and fully tap the economic potential of EVA participating in the power market. Based on the historical behavior data of EVs, this paper considers various market factors such as peak-valley time-of-use tariff, demand-side response mode and deviation balance of spot market to formulate the objective function of EVA comprehensive revenue maximization and establishes a quarter-hourly vehicle-to-grid (V2G) dynamic time-sharing pricing model based on deep deterministic policy gradient (DDPG) reinforcement learning algorithm. The EVA yield difference between peak-valley time-of-use tariff and hourly pricing strategy under the same algorithm is compared through the case studies. The results show that the scheme with higher pricing frequency can guide the charging behavior of users more effectively, tap the economic potential of power market to a greater extent, and calm the load fluctuation of power grid.

Keywords

• Electric vehicle aggregator
• dynamic pricing
• DDPG algorithm
• charging behavior guidance