Summary: Bisimulation and Logical Preservation for
Continuous-Time Markov Decision Processes
Martin R. Neuh¨außer1,2
Joost-Pieter Katoen1,2
1
RWTH Aachen University, Germany
2
University of Twente, The Netherlands
CONCUR 2007, Lisbon, Portugal
Neuh¨außer, Katoen (RWTH Aachen) Bisimulation and Logical Preservation for CTMDPs CONCUR 2007 1 / 23
Introduction Motivation
Repairman's Roulette
Maintenance of a safety critical system:
· System is operational in state up.
· Failures are exponentially distributed:
· Mean delay to next failure 1
µ
.
· Probability for a failure within time t:
· A failure moves the system from up to off .

Source: Ábrahám, Erika - Fachgruppe Informatik, Rheinisch Westfälische Technische Hochschule Aachen (RWTH)

Collections: Computer Technologies and Information Sciences