Intelligent Decision-Making of Load Balancing Using Deep Reinforcement Learning and Parallel PSO in Cloud Environment

Abstract

Machine learning and parallel processing are extremely commonly used to enhance computing power to induce knowledge from an outsized volume of data. To deal with the problem of complexity and high dimension, machine learning algorithms like Deep Reinforcement Learning (DRL) are used, while parallel processing algorithms like Parallel Particle Swarm Optimization (PPSO) are parallelized to speed up the operation and reduce the processing time to train the neural network. Due to the arrival of a large number of incoming tasks in the cloud environment, load balancing is an important issue. To solve this problem, the datacenter controller or an agent makes an intelligent decision to handle a large number of tasks within a minimum time period or at high speed. In this work, we proposed an effective scheduling algorithm named Deep Reinforcement Learning with Parallel Particle Swarm Optimization (DRLPPSO) to solve the load balancing problem and its various parameters with greater accuracy and high speed. Our experimental results show that our proposed scheduling algorithm increases the reward by 15.7%, 12%, and 13.1% when the task set is 2000 and improves the reward by 17.5%, 12.6%, and 15.3% when the task set is 4000, as compared to the Modified Particle Swarm Optimization (MPSO), Asynchronous Advantage Actor-Critic (A3C), and Deep Q-Network (DQN) techniques.

Keywords

• Load balancing
• deep reinforcement learning
• neural network
• parallel PSO