| | |
Summary: Delayed Nondeterminism in
Continuous-Time Markov Decision Processes
Martin R. Neuh¨außer1,2
Mari¨elle Stoelinga2
Joost-Pieter Katoen1,2
1
RWTH Aachen University, Germany
2
University of Twente, The Netherlands
FOSSACS 2009, York, United Kingdom
Neuh¨außer, Stoelinga, Katoen (RWTH Aachen) Delayed CTMDPs FOSSACS 2009 1 / 18
Introduction Motivation
Continuous-Time Markov Decision Processes: An Example
Imagine you have to come home by 6 pm.
· On your way, you stop at a red traffic light.
· When it turns green, you have two choices:
· turn left: 1min; traffic jam probability 1
2
.
· turn right: 5min; traffic jam probability 1
|
