Multi-Target-Aware Energy Orchestration Modeling for Grid 2.0: A Network Virtualization Approach

Abstract

Smart Grid– Grid 2.0, is a promising grid scenario due to its low cost, high reliability, and high security. However, the high-intensity complex task interaction and the differentiated Quality of Service (QoS) requirements pose challenges to the energy orchestration of the dynamic and time-varying smart grid. In addition, Network Virtualization (NV) technology is widely utilized to decouple physical network resources. In this work, based on Virtual Network Embedding (VNE), we propose an energy orchestration strategy to better support the operation and maintenance of Grid 2.0. Specifically, a series of constraint indicators for energy orchestration is first formulated. Second, based on the advantages of Deep Reinforcement Learning (DRL), a five-layer architecture energy orchestration model is proposed. It frequently extracts the grid energy matrix as the state input, adopts two-stage actions to reasonably orchestrate the grid energy, and combines the reward mechanism of DRL to effectively interact with the environment. Finally, we conduct experiments in a simulation environment and demonstrate the advantages of the proposed strategy through analysis and comparison.

Keywords

• Smart grid
• energy orchestration
• virtual network embedding
• deep reinforcement learning