Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid

Abstract

The dramatic increase in the volume of users and services makes scheduling network resources for smart grids a key challenge. Network slicing is an important technology to solve this problem. We introduce edge computing networks into the smart grid to intelligently allocate resources based on users’ quality of service (QoS) and available resources. However, existing heuristic resource scheduling algorithms often lead to resource fragmentation and thus fall into local optima. To this end, we propose a deep reinforcement learning (DRL)-based virtual network embedding algorithm to optimize the resource allocation strategy of smart grids from a network virtualization perspective. We extract the network properties of the smart grid to construct a policy network as a training environment for DRL agents. Finally, DRL derives the probability of each node being embedded based on the extracted attributes of edge computing nodes and completes user request (UR) embedding based on this probability. The experimental results show that the algorithm proposed in this paper has excellent performance with guaranteed low latency, 21% improvement in long-term revenue and 5.6% improvement in UR success rate compared with the other two algorithms.

Keywords

• Deep reinforcement learning
• delay sensitive
• edge computing network
• resource allocation
• smart grid
• user request