Fast simulation for slow paths in Markov models
Reijsbergen, Daniël and Boer, PieterTjerk de and Scheinhardt, Werner and Haverkort, Boudewijn (2012) Fast simulation for slow paths in Markov models. In: Ninth International Workshop on Rare Event Simulation, RESIM 2012, 2527 June 2012, Trondheim, Norway (pp. pp. 3638).

PDF
272kB 
Abstract:  Inspired by applications in the context of stochastic model checking, we are interested in using simulation for estimating the probability of reaching a specific state in a Markov chain after a large amount of time tau has passed. Since this is a rare event, we apply importance sampling. We derive approximate expressions for the sojourn times on a given path in a Markov chain conditional on the sum exceeding tau, and use those expressions to construct a change of measure. Numerical examples show that this change of measure performs very well, leading to high precision estimates in short simulation times. 
Item Type:  Conference or Workshop Item 
Faculty:  Electrical Engineering, Mathematics and Computer Science (EEMCS) 
Research Group:  
Link to this item:  http://purl.utwente.nl/publications/80763 
Export this item as:  BibTeX EndNote HTML Citation Reference Manager 
Repository Staff Only: item control page