Predator-Prey Reward Based Q-Learning Coverage Path Planning for Mobile Robot

Abstract

Coverage Path Planning (CPP in short) is a basic problem for mobile robot when facing a variety of applications. $Q$ -Learning based coverage path planning algorithms are beginning to be explored recently. To overcome the problem of traditional $Q$ -Learning of easily falling into local optimum, in this paper, the new-type reward functions originating from Predator-Prey model are introduced into traditional $Q$ -Learning based CPP solution, which introduces a comprehensive reward function that incorporates three rewards including Predation Avoidance Reward Function, Smoothness Reward Function and Boundary Reward Function. In addition, the influence of weighting parameters on the total reward function is discussed. Extensive simulation results and practical experiments verify that the proposed Predator-Prey reward based $Q$ -Learning Coverage Path Planning (PP- $Q$ -Learning based CPP in short) has better performance than traditional BCD and $Q$ -Learning based CPP in terms of repetition ratio and turns number.

Keywords

• Coverage path planning
• predator-prey model
• reinforcement learning
• Q-learning algorithm
• mobile robot