Indefinite Linear-Quadratic Stochastic Control Problem for Jump-Diffusion Models with Random Coefficients: A Completion of Squares Approach

Abstract

In this paper, we study the indefinite linear-quadratic (LQ) stochastic optimal control problem for stochastic differential equations (SDEs) with jump diffusions and random coefficients driven by both the Brownian motion and the (compensated) Poisson process. In our problem setup, the coefficients in the SDE and the objective functional are allowed to be random, and the jump-diffusion part of the SDE depends on the state and control variables. Moreover, the cost parameters in the objective functional need not be (positive) definite matrices. Although the solution to this problem can also be obtained through the stochastic maximum principle or the dynamic programming principle, our approach is simple and direct. In particular, by using the Itô-Wentzell’s formula, together with the integro-type stochastic Riccati differential equation (ISRDE) and the backward SDE (BSDE) with jump diffusions, we obtain the equivalent objective functional that is quadratic in control u under the positive definiteness condition, where the approach is known as the completion of squares method. Then the explicit optimal solution, which is linear in state characterized by the ISRDE and the BSDE jump diffusions, and the associated optimal cost are derived by eliminating the quadratic term of u in the equivalent objective functional. We also verify the optimality of the proposed solution via the verification theorem, which requires solving the stochastic HJB equation, a class of stochastic partial differential equations with jump diffusions.

Keywords

• stochastic systems with jump diffusions and random coefficients
• completion of squares method
• stochastic HJB equation with jump diffusions
• verification theorem