Output Resilient Containment Control of Heterogeneous Systems With Active Leaders Using Reinforcement Learning Under Attack Inputs

Abstract

The optimal solution to the distributed output containment control problem of heterogeneous multiple-agent systems (MASs) with unknown active leaders under attack inputs by using data-based off-policy reinforcement learning (RL) is proposed. Assume that the control input of each leader is bounded and non-zero. Moreover, followers are vulnerable to attack signals in real-world application. Firstly, distributed observers are designed such that the state and output of observers fall into the convex hull formed by leaders. Then, the output containment problem is converted into $H_{\infty }$ tracking problem by minimizing value function, Algebraic Riccati equations (AREs) are obtained in solving optimal $H_{\infty }$ tracking problem for each follower, which are computed by a data-based off-policy RL algorithm without using agents’ dynamics. At last, the effectiveness of the algorithm is verified by a simulation example.

Keywords

• Heterogeneous systems
• distributed observer
• algebraic riccati equations (AREs)
• reinforcement learning
• H∞ control%22%2C%22default_operator%22%3A%22AND%22%7D%7D%7D"> <italic xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">H</italic>∞ control