A Multi-Agent Reinforcement Learning Method for Cooperative Secondary Voltage Control of Microgrids
Tianhao Wang,
Shiqian Ma,
Zhuo Tang,
Tianchun Xiang,
Chaoxu Mu,
Yao Jin
Affiliations
Tianhao Wang
Electric Power Research Institute, State Grid Tianjin Electric Power Company, No. 8, Haitai Huake 4th Road, Huayuan Industrial Zone, Binhai High Tech Zone, Tianjin 300384, China
Shiqian Ma
Electric Power Research Institute, State Grid Tianjin Electric Power Company, No. 8, Haitai Huake 4th Road, Huayuan Industrial Zone, Binhai High Tech Zone, Tianjin 300384, China
Zhuo Tang
School of Electrical and Information Engineering, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin 300072, China
Tianchun Xiang
State Grid Tianjin Electric Power Company, No. 39 Wujing, Guangfu Street, Hebei District, Tianjin 300010, China
Chaoxu Mu
School of Electrical and Information Engineering, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin 300072, China
Yao Jin
State Grid Tianjin Electric Power Company, No. 39 Wujing, Guangfu Street, Hebei District, Tianjin 300010, China
This paper proposes a novel cooperative voltage control strategy for an isolated microgrid based on the multi-agent advantage actor-critic (MA2C) algorithm. The proposed method facilitates the collaborative operation of a distributed energy system (DES) by adopting an attention mechanism to adaptively boost information processing effectiveness through the assignment of importance scores. Additionally, the algorithm we propose, executed through a centralized training and decentralized execution framework, implements secondary control and effectively restores voltage deviation. The introduction of an attention mechanism alleviates the burden of information transmission. Finally, we illustrate the effectiveness of the proposed method through a DES consisting of six energy nodes.