A Hierarchical Path Planning Framework of Plant Protection UAV Based on the Improved D3QN Algorithm and Remote Sensing Image

Abstract

Traditional path planning algorithms often fail to simultaneously ensure operational efficiency, energy constraint compliance, and environmental adaptability in agricultural scenarios, thereby hindering the advancement of precision agriculture. To address these challenges, this study proposes a deep reinforcement learning algorithm, MoE-D3QN, which integrates a Mixture-of-Experts mechanism with a Bi-directional Long Short-Term Memory model. This design enhances the efficiency and robustness of UAV path planning in agricultural environments. Building upon this algorithm, a hierarchical coverage path planning framework is developed. Multi-level task maps are constructed using crop information extracted from Sentinel-2 remote sensing imagery. Additionally, a dynamic energy consumption model and a progressive composite reward function are incorporated to further optimize UAV path planning in complex farmland conditions. Simulation experiments reveal that in the two-level scenario, the MoE-D3QN algorithm achieves a coverage efficiency of 0.8378, representing an improvement of 37.84–63.38% over traditional algorithms and 19.19–63.38% over conventional reinforcement learning methods. The redundancy rate is reduced to 3.23%, which is 38.71–41.94% lower than traditional methods and 4.46–42.77% lower than reinforcement learning counterparts. In the three-level scenario, MoE-D3QN achieves a coverage efficiency of 0.8261, exceeding traditional algorithms by 52.13–71.45% and reinforcement learning approaches by 10.15–50.2%. The redundancy rate is further reduced to 5.26%, which is significantly lower than the 57.89–92.11% observed with traditional methods and the 15.57–18.98% reported for reinforcement learning algorithms. These findings demonstrate that the MoE-D3QN algorithm exhibits high-quality planning performance in complex farmland environments, indicating its strong potential for widespread application in precision agriculture.

Keywords

• precision agriculture
• deep reinforcement learning
• path planning
• Mixture-of-Experts mechanism
• remote sensing