Fast simulation for slow paths in Markov models

Reijsbergen, Daniël and Boer de, Pieter-Tjerk and Scheinhardt, Werner and Haverkort, Boudewijn (2012) Fast simulation for slow paths in Markov models. In: Ninth International Workshop on Rare Event Simulation, RESIM 2012, 25-27 June 2012, Trondheim, Norway.

Preview

PDF
266Kb

Abstract:	Inspired by applications in the context of stochastic model checking, we are interested in using simulation for estimating the probability of reaching a specific state in a Markov chain after a large amount of time tau has passed. Since this is a rare event, we apply importance sampling. We derive approximate expressions for the sojourn times on a given path in a Markov chain conditional on the sum exceeding tau, and use those expressions to construct a change of measure. Numerical examples show that this change of measure performs very well, leading to high precision estimates in short simulation times.
Item Type:	Conference or Workshop Item
Faculty:	Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:	Design and Analysis of Communication Systems (DACS) Stochastic Operations Research (SOR)
Link to this item:	http://purl.utwente.nl/publications/80763
Export this item as:	BibTeX EndNote HTML Citation Reference Manager

Repository Staff Only: item control page