Optimal Control of Markov Processes with Age-Dependent Transition Rates
Journal Article
·
· Applied Mathematics and Optimization
- Indian Institute of Science, Department of Mathematics (India)
We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite horizon average cost problems. Our approach is via the construction of an equivalent semi-Markov decision process. We characterise the value function and optimal controls for both discounted and average cost cases.
- OSTI ID:
- 22092057
- Journal Information:
- Applied Mathematics and Optimization, Vol. 66, Issue 2; Other Information: Copyright (c) 2012 Springer Science+Business Media, LLC; Country of input: International Atomic Energy Agency (IAEA); ISSN 0095-4616
- Country of Publication:
- United States
- Language:
- English
Similar Records
Existence of Risk-Sensitive Optimal Stationary Policies for Controlled Markov Processes
Nearly optimal control of singularly perturbed Markov decision processes in discrete time
Mean-Variance Problems for Finite Horizon Semi-Markov Decision Processes
Journal Article
·
Mon Nov 15 00:00:00 EST 1999
· Applied Mathematics and Optimization
·
OSTI ID:22092057
Nearly optimal control of singularly perturbed Markov decision processes in discrete time
Journal Article
·
Sun Jul 01 00:00:00 EDT 2001
· Applied Mathematics and Optimization
·
OSTI ID:22092057
Mean-Variance Problems for Finite Horizon Semi-Markov Decision Processes
Journal Article
·
Thu Oct 15 00:00:00 EDT 2015
· Applied Mathematics and Optimization
·
OSTI ID:22092057