Graph-based Stochastic Control with Constraints: A Unified Approach with Perfect and Imperfect Measurements
Conference Paper
Overview
Identity
Additional Document Info
Other
View All
Overview
abstract
This paper is concerned with the problem of stochastic optimal control (possibly with imperfect measurements) in the presence of constraints. We propose a computationally tractable framework to address this problem. The method lends itself to sampling-based methods where we construct a graph in the state space of the problem, on which a Dynamic Programming (DP) is solved and a closed-loop feedback policy is computed. The constraints are seamlessly incorporated to the control policy selection by including their effect on the transition probabilities of the graph edges. We present a unified framework that is applicable both in the state space (with perfect measurements) and in the information space (with imperfect measurements.) 2013 AACC American Automatic Control Council.