Indefinite Stochastic Linear-Quadratic Optimal Control Problem for a Markov Regime-Switching Model

Abstract

This paper investigates an indefinite stochastic linear-quadratic (SLQ) control problem with parameters subject to Markov regime-switching. Based on the well-posedness of the SLQ problem, we introduce a relaxed compensator that extends SLQ control problems from the positive definite case to the indefinite case. We analyze the corresponding stochastic Hamiltonian system for both unconstrained and constrained control cases under the indefinite framework and derive the corresponding optimal open-loop controls. We further investigate the associated Riccati equations for both unconstrained and constrained control cases and derive the closed-loop feedback forms of optimal controls. We illustrate the theoretical results with an equity-bond asset allocation problem under un-constrained and non-negative control constraints. Numerical simulations validate the effectiveness of the theoretical framework and demonstrate its practical value in solving complex stochastic control problems with Markov regime-switching.