Nearly optimal control of singularly perturbed Markov decision processes in discrete time
Journal Article
·
· Applied Mathematics and Optimization
This work develops asymptotically optimal controls for discrete-time singularly perturbed Markov decision processes (MDPs) having weak and strong interactions. The focus is on finite-state-space-MDP problems. The state space of the underlying Markov chain can be decomposed into a number of recurrent classes or a number of recurrent classes and a group of transient states. Using a hierarchical control approach, continuous-time limit problems that are much simpler to handle than the original ones are derived. Based on the optimal solutions for the limit problems, nearly optimal decisions for the original problems are obtained. The asymptotic optimality of such controls is proved and the rate of convergence is provided. Infinite horizon problems are considered; both discounted costs and long-run average costs are examined.
- OSTI ID:
- 21067503
- Journal Information:
- Applied Mathematics and Optimization, Journal Name: Applied Mathematics and Optimization Journal Issue: 2 Vol. 44; ISSN 0095-4616
- Country of Publication:
- United States
- Language:
- English
Similar Records
Ergodic Control of a Singularly Perturbed Markov Process in Discrete Time with General State and Compact Action Spaces
Multi-module Markov decision processes
Mean-Variance Problems for Finite Horizon Semi-Markov Decision Processes
Journal Article
·
Sat Nov 14 23:00:00 EST 1998
· Applied Mathematics and Optimization
·
OSTI ID:21064293
Multi-module Markov decision processes
Thesis/Dissertation
·
Tue Dec 31 23:00:00 EST 1985
·
OSTI ID:5915536
Mean-Variance Problems for Finite Horizon Semi-Markov Decision Processes
Journal Article
·
Thu Oct 15 00:00:00 EDT 2015
· Applied Mathematics and Optimization
·
OSTI ID:22722847