Skip to main content

Confluence Reduction for Markov Automata

  • Conference paper
Formal Modeling and Analysis of Timed Systems (FORMATS 2013)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8053))

Abstract

Markov automata are a novel formalism for specifying systems exhibiting nondeterminism, probabilistic choices and Markovian rates. Recently, the process algebra MAPA was introduced to efficiently model such systems. As always, the state space explosion threatens the analysability of the models generated by such specifications. We therefore introduce confluence reduction for Markov automata, a powerful reduction technique to keep these models small. We define the notion of confluence directly on Markov automata, and discuss how to syntactically detect confluence on the MAPA language as well. That way, Markov automata generated by MAPA specifications can be reduced on-the-fly while preserving divergence-sensitive branching bisimulation. Three case studies demonstrate the significance of our approach, with reductions in analysis time up to an order of magnitude.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ajmone Marsan, M., Balbo, G., Conte, G., Donatelli, S., Franceschinis, G.: Modelling with Generalized Stochastic Petri Nets. John Wiley & Sons, Inc. (1994)

    Google ScholarĀ 

  2. Ajmone Marsan, M., Conte, G., Balbo, G.: A class of generalized stochastic Petri nets for the performance evaluation of multiprocessor systems. ACM Transactions on Computer SystemsĀ 2(2), 93ā€“122 (1984)

    ArticleĀ  Google ScholarĀ 

  3. Baier, C., Dā€™Argenio, P.R., GrĆ¶ĆŸer, M.: Partial order reduction for probabilistic branching time. In: QAPL. ENTCS, vol.Ā 153(2), pp. 97ā€“116 (2006)

    Google ScholarĀ 

  4. Baier, C., GrĆ¶ĆŸer, M., Ciesinski, F.: Partial order reduction for probabilistic systems. In: QEST, pp. 230ā€“239 (2004)

    Google ScholarĀ 

  5. Belinfante, A., Rensink, A.: Publishing your prototype tool on the web: PUPTOL, a framework. Technical Report TR-CTIT-13-15, Centre for Telematics and Information Technology, University of Twente (2013)

    Google ScholarĀ 

  6. Blom, S.C.C.: Partial Ļ„-confluence for efficient state space generation. Technical Report SEN-R0123, CWI, Amsterdam (2001)

    Google ScholarĀ 

  7. Blom, S.C.C., van de Pol, J.C.: State space reduction by proving confluence. In: Brinksma, E., Larsen, K.G. (eds.) CAV 2002. LNCS, vol.Ā 2404, pp. 596ā€“609. Springer, Heidelberg (2002)

    ChapterĀ  Google ScholarĀ 

  8. Boudali, H., Crouzen, P., Haverkort, B.R., Kuntz, M., Stoelinga, M.I.A.: Architectural dependability evaluation with arcade. In: DSN, pp. 512ā€“521 (2008)

    Google ScholarĀ 

  9. Boudali, H., Crouzen, P., Stoelinga, M.I.A.: A rigorous, compositional, and extensible framework for dynamic fault tree analysis. IEEE Transactions on Dependable and Secure CompututingĀ 7(2), 128ā€“143 (2010)

    ArticleĀ  Google ScholarĀ 

  10. Bozzano, M., Cimatti, A., Katoen, J.-P., Nguyen, V.Y., Noll, T., Roveri, M.: Safety, dependability and performance analysis of extended AADL models. The Computer JournalĀ 54(5), 754ā€“775 (2011)

    ArticleĀ  Google ScholarĀ 

  11. Dā€™Argenio, P.R., Niebert, P.: Partial order reduction on concurrent probabilistic programs. In: QEST, pp. 240ā€“249 (2004)

    Google ScholarĀ 

  12. Deng, Y., Hennessy, M.: On the semantics of Markov automata. In: Aceto, L., Henzinger, M., Sgall, J. (eds.) ICALP 2011, Part II. LNCS, vol.Ā 6756, pp. 307ā€“318. Springer, Heidelberg (2011)

    ChapterĀ  Google ScholarĀ 

  13. Eisentraut, C., Hermanns, H., Zhang, L.: Concurrency and composition in a stochastic world. In: Gastin, P., Laroussinie, F. (eds.) CONCUR 2010. LNCS, vol.Ā 6269, pp. 21ā€“39. Springer, Heidelberg (2010)

    ChapterĀ  Google ScholarĀ 

  14. Eisentraut, C., Hermanns, H., Zhang, L.: On probabilistic automata in continuous time. In: LICS, pp. 342ā€“351 (2010)

    Google ScholarĀ 

  15. Fokkink, W., Pang, J.: Simplifying Itai-Rodeh leader election for anonymous rings. In: AVoCS. ENTCS, vol.Ā 128(6), pp. 53ā€“68 (2005)

    Google ScholarĀ 

  16. Godefroid, P.: Partial-Order Methods for the Verification of Concurrent Systems. LNCS, vol.Ā 1032. Springer, Heidelberg (1996)

    BookĀ  Google ScholarĀ 

  17. Guck, D., Hatefi, H., Hermanns, H., Katoen, J.-P., Timmer, M.: Modelling, reduction and analysis of Markov automata. In: Joshi, K., Siegle, M., Stoelinga, M., Dā€™Argenio, P.R. (eds.) QEST 2013. LNCS, vol.Ā 8054, pp. 55ā€“71. Springer, Heidelberg (2013)

    Google ScholarĀ 

  18. Hansen, H., Timmer, M.: A comparison of confluence and ample sets in probabilistic and non-probabilistic branching time. In: TCS (to appear, 2013)

    Google ScholarĀ 

  19. Hartmanns, A., Timmer, M.: On-the-fly confluence detection for statistical model checking. In: Brat, G., Rungta, N., Venet, A. (eds.) NFM 2013. LNCS, vol.Ā 7871, pp. 337ā€“351. Springer, Heidelberg (2013)

    ChapterĀ  Google ScholarĀ 

  20. Katoen, J.-P.: GSPNs revisited: Simple semantics and new analysis algorithms. In: ACSD, pp. 6ā€“11 (2012)

    Google ScholarĀ 

  21. Peled, D.: All from one, one for all: on model checking using representatives. In: Courcoubetis, C. (ed.) CAV 1993. LNCS, vol.Ā 697, pp. 409ā€“423. Springer, Heidelberg (1993)

    ChapterĀ  Google ScholarĀ 

  22. Timmer, M.: SCOOP: A tool for symbolic optimisations of probabilistic processes. In: QEST, pp. 149ā€“150 (2011)

    Google ScholarĀ 

  23. Timmer, M., Katoen, J.-P., van de Pol, J.C., Stoelinga, M.I.A.: Efficient modelling and generation of Markov automata. In: Koutny, M., Ulidowski, I. (eds.) CONCUR 2012. LNCS, vol.Ā 7454, pp. 364ā€“379. Springer, Heidelberg (2012)

    ChapterĀ  Google ScholarĀ 

  24. Timmer, M., Stoelinga, M.I.A., van de Pol, J.C.: Confluence reduction for probabilistic systems. In: Abdulla, P.A., Leino, K.R.M. (eds.) TACAS 2011. LNCS, vol.Ā 6605, pp. 311ā€“325. Springer, Heidelberg (2011)

    ChapterĀ  Google ScholarĀ 

  25. Timmer, M., van de Pol, J.C., Stoelinga, M.I.A.: Confluence reduction for Markov automata (extended version). Technical Report TR-CTIT-13-14, Centre for Telematics and Information Technology, University of Twente (2013)

    Google ScholarĀ 

  26. Valmari, A.: Stubborn sets for reduced state space generation. In: Rozenberg, G. (ed.) APN 1989. LNCS, vol.Ā 424, pp. 491ā€“515. Springer, Heidelberg (1990)

    Google ScholarĀ 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

Ā© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Timmer, M., van de Pol, J., Stoelinga, M.I.A. (2013). Confluence Reduction for Markov Automata. In: Braberman, V., Fribourg, L. (eds) Formal Modeling and Analysis of Timed Systems. FORMATS 2013. Lecture Notes in Computer Science, vol 8053. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40229-6_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-40229-6_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40228-9

  • Online ISBN: 978-3-642-40229-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics