Efficient Probabilistic Model Checking for Relational Reachability (Extended Version)

Markov decision processes model systems subject to nondeterministic and probabilistic uncertainty. A plethora of verification techniques addresses variations of reachability properties, such as: Is there a scheduler resolving the nondeterminism such that the probability to reach an error state is ab...

Full description

Saved in:
Bibliographic Details
Main Authors Gerlach, Lina, Winkler, Tobias, Ábrahám, Erika, Bonakdarpour, Borzoo, Junges, Sebastian
Format Journal Article
LanguageEnglish
Published 22.05.2025
Subjects
Online AccessGet full text
DOI10.48550/arxiv.2505.16357

Cover

Abstract Markov decision processes model systems subject to nondeterministic and probabilistic uncertainty. A plethora of verification techniques addresses variations of reachability properties, such as: Is there a scheduler resolving the nondeterminism such that the probability to reach an error state is above a threshold? We consider an understudied extension that relates different reachability probabilities, such as: Is there a scheduler such that two sets of states are reached with different probabilities? These questions appear naturally in the design of randomized algorithms and in various security applications. We provide a tractable algorithm for many variations of this problem, while proving computational hardness of some others. An implementation of our algorithm beats solvers for more general probabilistic hyperlogics by orders of magnitude, on the subset of their benchmarks that are within our fragment.
AbstractList Markov decision processes model systems subject to nondeterministic and probabilistic uncertainty. A plethora of verification techniques addresses variations of reachability properties, such as: Is there a scheduler resolving the nondeterminism such that the probability to reach an error state is above a threshold? We consider an understudied extension that relates different reachability probabilities, such as: Is there a scheduler such that two sets of states are reached with different probabilities? These questions appear naturally in the design of randomized algorithms and in various security applications. We provide a tractable algorithm for many variations of this problem, while proving computational hardness of some others. An implementation of our algorithm beats solvers for more general probabilistic hyperlogics by orders of magnitude, on the subset of their benchmarks that are within our fragment.
Author Junges, Sebastian
Ábrahám, Erika
Bonakdarpour, Borzoo
Winkler, Tobias
Gerlach, Lina
Author_xml – sequence: 1
  givenname: Lina
  surname: Gerlach
  fullname: Gerlach, Lina
  organization: RWTH Aachen University, Aachen, Germany
– sequence: 2
  givenname: Tobias
  surname: Winkler
  fullname: Winkler, Tobias
  organization: RWTH Aachen University, Aachen, Germany
– sequence: 3
  givenname: Erika
  surname: Ábrahám
  fullname: Ábrahám, Erika
  organization: RWTH Aachen University, Aachen, Germany
– sequence: 4
  givenname: Borzoo
  surname: Bonakdarpour
  fullname: Bonakdarpour, Borzoo
  organization: Michigan State University, East Lansing, MI, USA
– sequence: 5
  givenname: Sebastian
  surname: Junges
  fullname: Junges, Sebastian
  organization: Radboud University, Nijmegen, the Netherlands
BackLink https://doi.org/10.48550/arXiv.2505.16357$$DView paper in arXiv
BookMark eNqFzj0PgjAUheEOOvj1A5zsqIMIYtWdYFxMjFFXcim3cmNtTWkM_HuVuDudM7zD02cdYw0yNo7CYLUVIlyAq-kVLEUogmgdi02PXVKlSBIaz4_O5pCTpsqT5AdboOZJifJO5saVdfyEGjxZA_pzQZZt7Bs-TWuPpsCCX9FVn2A2ZF0FusLRbwdsskvPyX7eArKnowe4JvtCshYS_y_erjpAGQ
ContentType Journal Article
Copyright http://creativecommons.org/licenses/by-sa/4.0
Copyright_xml – notice: http://creativecommons.org/licenses/by-sa/4.0
DBID AKY
GOX
DOI 10.48550/arxiv.2505.16357
DatabaseName arXiv Computer Science
arXiv.org
DatabaseTitleList
Database_xml – sequence: 1
  dbid: GOX
  name: arXiv.org
  url: http://arxiv.org/find
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
ExternalDocumentID 2505_16357
GroupedDBID AKY
GOX
ID FETCH-arxiv_primary_2505_163573
IEDL.DBID GOX
IngestDate Tue Jul 22 21:53:50 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-arxiv_primary_2505_163573
OpenAccessLink https://arxiv.org/abs/2505.16357
ParticipantIDs arxiv_primary_2505_16357
PublicationCentury 2000
PublicationDate 2025-05-22
PublicationDateYYYYMMDD 2025-05-22
PublicationDate_xml – month: 05
  year: 2025
  text: 2025-05-22
  day: 22
PublicationDecade 2020
PublicationYear 2025
Score 3.8224485
SecondaryResourceType preprint
Snippet Markov decision processes model systems subject to nondeterministic and probabilistic uncertainty. A plethora of verification techniques addresses variations...
SourceID arxiv
SourceType Open Access Repository
SubjectTerms Computer Science - Logic in Computer Science
Title Efficient Probabilistic Model Checking for Relational Reachability (Extended Version)
URI https://arxiv.org/abs/2505.16357
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV1LSwMxEB7anryIolLfOXjQQ9TNJvs4StlaBB-Ihb0t2TxQEJG1iv57Z5Iteuk1GYYhyWQemfkCcOK8T01uFE8Kb7k01vBCm5IbbfGAlKnyGfUO395ls7m8qVU9ALbshdHd98tXxAduPy7IPp8nBJk2hKEQFFxd39fxcTJAcfX0f3ToY4ahf0ZiugHrvXfHruJ2bMLAvW3BvAowDXi7s4cO1YfKUQkdmdE_ZK9s8uwM5asZuo9sWZuGTB6pzjGiaP-w06pPVrM-wXW2DcfT6mky40GQ5j2iRjQkYxNkTHdghLG9GwPzrc21LRKjc_RLMll63UqrUe9kLp1WuzBexWVv9dQ-rAn6pvZScSEOYLToPt0h2s5FexQW8Be3Y3VU
linkProvider Cornell University
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Efficient+Probabilistic+Model+Checking+for+Relational+Reachability+%28Extended+Version%29&rft.au=Gerlach%2C+Lina&rft.au=Winkler%2C+Tobias&rft.au=%C3%81brah%C3%A1m%2C+Erika&rft.au=Bonakdarpour%2C+Borzoo&rft.date=2025-05-22&rft_id=info:doi/10.48550%2Farxiv.2505.16357&rft.externalDocID=2505_16357