Actuators (Sep 2024)

An Admittance Parameter Optimization Method Based on Reinforcement Learning for Robot Force Control

  • Xiaoyi Hu,
  • Gongping Liu,
  • Peipei Ren,
  • Bing Jia,
  • Yiwen Liang,
  • Longxi Li,
  • Shilin Duan

DOI
https://doi.org/10.3390/act13090354
Journal volume & issue
Vol. 13, no. 9
p. 354

Abstract

Read online

When a robot performs tasks such as assembly or human–robot interaction, it is inevitable for it to collide with the unknown environment, resulting in potential safety hazards. In order to improve the compliance of robots to cope with unknown environments and enhance their intelligence in contact force-sensitive tasks, this paper proposes an improved admittance force control method, which combines classical adaptive control and machine learning methods to make them use their respective advantages in different stages of training and, ultimately, achieve better performance. In addition, this paper proposes an improved Deep Deterministic Policy Gradient (DDPG)-based optimizer, which is combined with the Gaussian process (GP) model to optimize the admittance parameters. In order to verify the feasibility of the algorithm, simulations and experiments are carried out in MATLAB and on a UR10e robot, respectively. The experimental results show that the algorithm improves the convergence speed by 33% in comparison to the general model-free learning method, and has better control performance and robustness. Finally, the adjustment time required by the algorithm is 44% shorter than that of classical adaptive admittance control.

Keywords