Smoothed model checking for uncertain Continuous-Time Markov Chains

TitleSmoothed model checking for uncertain Continuous-Time Markov Chains
Publication TypeJournal Article
Year of PublicationIn Press
AuthorsBortolussi L, Milios D, Sanguinetti G
JournalInformation and Computation
KeywordsContinuous-Time Markov Chains, Gaussian Processes, model checking, Uncertainty

Abstract We consider the problem of computing the satisfaction probability of a formula for stochastic models with parametric uncertainty. We show that this satisfaction probability is a smooth function of the model parameters under mild conditions. This enables us to devise a novel Bayesian statistical algorithm which performs model checking simultaneously for all values of the model parameters from observations of truth values of the formula over individual runs of the model at isolated parameter values. This is achieved by exploiting the smoothness of the satisfaction function: by modelling explicitly correlations through a prior distribution over a space of smooth functions (a Gaussian Process), we can condition on observations at individual parameter values to construct an analytical approximation of the function itself. Extensive experiments on non-trivial case studies show that the approach is accurate and considerably faster than naive parameter exploration with standard statistical model checking methods.