Mathematics (Oct 2020)

Towards Tensor Representation of Controlled Coupled Markov Chains

  • Daniel McInnes,
  • Boris Miller,
  • Gregory Miller,
  • Sergei Schreider

DOI
https://doi.org/10.3390/math8101712
Journal volume & issue
Vol. 8, no. 10
p. 1712

Abstract

Read online

For a controlled system of coupled Markov chains, which share common control parameters, a tensor description is proposed. A control optimality condition in the form of a dynamic programming equation is derived in tensor form. This condition can be reduced to a system of coupled ordinary differential equations and admits an effective numerical solution. As an application example, the problem of the optimal control for a system of water reservoirs with phase and balance constraints is considered.

Keywords