Summary: Delayed Nondeterminism in
Continuous-Time Markov Decision Processes
Martin R. Neuh¨außer1,2
RWTH Aachen University, Germany
University of Twente, The Netherlands
FOSSACS 2009, York, United Kingdom
Neuh¨außer, Stoelinga, Katoen (RWTH Aachen) Delayed CTMDPs FOSSACS 2009 1 / 18
Continuous-Time Markov Decision Processes: An Example
Imagine you have to come home by 6 pm.
· On your way, you stop at a red traffic light.
· When it turns green, you have two choices:
· turn left: 1min; traffic jam probability 1
· turn right: 5min; traffic jam probability 1