Optimal control of stochastic singular affine systems with Markovian jumps

Abstract

Abstract We consider an optimal control problem for a class of stochastic singular affine systems with Markovian jumps. We establish the existence and uniqueness of the solution to stochastic singular affine systems with Markovian jumps for the first time. Via square completion technique and the generalized Itô’s formula, we derive new kinds of generalized differential Riccati equations (GDREs) and generalized backward differential equations (GBDEs), which give sufficient conditions for the well-posedness of the optimal control problem, and present an explicit representation of optimal control. Also, we discuss the solvability of the GDREs in two cases. As an application, we present a leader-follower differential game to demonstrate the practicability of our results.

Keywords

• Singular affine systems
• Markov jump systems
• Leader-follower differential game