Supermartingale

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 1830 Experts worldwide ranked by ideXlab platform

Krishnendu Chatterjee - One of the best experts on this subject based on the ideXlab platform.

  • algorithmic analysis of qualitative and quantitative termination problems for affine probabilistic programs
    ACM Transactions on Programming Languages and Systems, 2018
    Co-Authors: Krishnendu Chatterjee, Petr Novotný, Rouzbeh Hasheminezhad
    Abstract:

    In this article, we consider the termination problem of probabilistic programs with real-valued variables. The questions concerned are: qualitative ones that ask (i) whether the program terminates with probability 1 (almost-sure termination) and (ii) whether the expected termination time is finite (finite termination); and quantitative ones that ask (i) to approximate the expected termination time (expectation problem) and (ii) to compute a bound B such that the probability not to terminate after B steps decreases exponentially (concentration problem). To solve these questions, we utilize the notion of ranking Supermartingales, which is a powerful approach for proving termination of probabilistic programs. In detail, we focus on algorithmic synthesis of linear ranking-Supermartingales over affine probabilistic programs (Apps) with both angelic and demonic non-determinism. An important subclass of Apps is LRApp which is defined as the class of all Apps over which a linear ranking-Supermartingale exists. Our main contributions are as follows. Firstly, we show that the membership problem of LRApp (i) can be decided in polynomial time for Apps with at most demonic non-determinism, and (ii) is NP-hard and in PSPACE for Apps with angelic non-determinism. Moreover, the NP-hardness result holds already for Apps without probability and demonic non-determinism. Secondly, we show that the concentration problem over LRApp can be solved in the same complexity as for the membership problem of LRApp. Finally, we show that the expectation problem over LRApp can be solved in 2EXPTIME and is PSPACE-hard even for Apps without probability and non-determinism (i.e., deterministic programs). Our experimental results demonstrate the effectiveness of our approach to answer the qualitative and quantitative questions over Apps with at most demonic non-determinism.

  • Termination of Nondeterministic Recursive Probabilistic Programs
    arXiv: Programming Languages, 2017
    Co-Authors: Krishnendu Chatterjee
    Abstract:

    We study the termination problem for nondeterministic recursive probabilistic programs. First, we show that a ranking-Supermartingales-based approach is both sound and complete for bounded terminiation (i.e., bounded expected termination time over all schedulers). Our result also clarifies previous results which claimed that ranking Supermartingales are not a complete approach even for nondeterministic probabilistic programs without recursion. Second, we show that conditionally difference-bounded ranking Supermartingales provide a sound approach for lower bounds of expected termination time. Finally, we show that Supermartingales with lower bounds on conditional absolute difference provide a sound approach for almost-sure termination, along with explicit bounds on tail probabilities of nontermination within a given number of steps. We also present several illuminating counterexamples that establish the necessity of certain prerequisites (such as conditionally difference-bounded condition).

  • POPL - Stochastic invariants for probabilistic termination
    Proceedings of the 44th ACM SIGPLAN Symposium on Principles of Programming Languages - POPL 2017, 2017
    Co-Authors: Krishnendu Chatterjee, Petr Novotný, Ðorđe Žikelić
    Abstract:

    Termination is one of the basic liveness properties, and we study the termination problem for probabilistic programs with real-valued variables. Previous works focused on the qualitative problem that asks whether an input program terminates with probability� 1 (almost-sure termination). A powerful approach for this qualitative problem is the notion of ranking Supermartingales with respect to a given set of invariants. The quantitative problem (probabilistic termination) asks for bounds on the termination probability, and this problem has not been addressed yet. A fundamental and conceptual drawback of the existing approaches to address probabilistic termination is that even though the Supermartingales consider the probabilistic behaviour of the programs, the invariants are obtained completely ignoring the probabilistic aspect (i.e., the invariants are obtained considering all behaviours with no information about the probability). In this work we address the probabilistic termination problem for linear-arithmetic probabilistic programs with nondeterminism. We formally define the notion of stochastic invariants, which are constraints along with a probability bound that the constraints hold. We introduce a concept of repulsing Supermartingales. First, we show that repulsing Supermartingales can be used to obtain bounds on the probability of the stochastic invariants. Second, we show the effectiveness of repulsing Supermartingales in the following three ways: (1)� With a combination of ranking and repulsing Supermartingales we can compute lower bounds on the probability of termination; (2)� repulsing Supermartingales provide witnesses for refutation of almost-sure termination; and (3)� with a combination of ranking and repulsing Supermartingales we can establish persistence properties of probabilistic programs. Along with our conceptual contributions, we establish the following computational results: First, the synthesis of a stochastic invariant which supports some ranking Supermartingale and at the same time admits a repulsing Supermartingale can be achieved via reduction to the existential first-order theory of reals, which generalizes existing results from the non-probabilistic setting. Second, given a program with â strict invariantsâ (e.g., obtained via abstract interpretation) and a stochastic invariant, we can check in polynomial time whether there exists a linear repulsing Supermartingale w.r.t. the stochastic invariant (via reduction to LP). We also present experimental evaluation of our approach on academic examples.

  • Stochastic Invariants for Probabilistic Termination
    arXiv: Programming Languages, 2016
    Co-Authors: Krishnendu Chatterjee, Petr Novotný, Đorđe Žikelić
    Abstract:

    Termination is one of the basic liveness properties, and we study the termination problem for probabilistic programs with real-valued variables. Previous works focused on the qualitative problem that asks whether an input program terminates with probability~1 (almost-sure termination). A powerful approach for this qualitative problem is the notion of ranking Supermartingales with respect to a given set of invariants. The quantitative problem (probabilistic termination) asks for bounds on the termination probability. A fundamental and conceptual drawback of the existing approaches to address probabilistic termination is that even though the Supermartingales consider the probabilistic behavior of the programs, the invariants are obtained completely ignoring the probabilistic aspect. In this work we address the probabilistic termination problem for linear-arithmetic probabilistic programs with nondeterminism. We define the notion of {\em stochastic invariants}, which are constraints along with a probability bound that the constraints hold. We introduce a concept of {\em repulsing Supermartingales}. First, we show that repulsing Supermartingales can be used to obtain bounds on the probability of the stochastic invariants. Second, we show the effectiveness of repulsing Supermartingales in the following three ways: (1)~With a combination of ranking and repulsing Supermartingales we can compute lower bounds on the probability of termination; (2)~repulsing Supermartingales provide witnesses for refutation of almost-sure termination; and (3)~with a combination of ranking and repulsing Supermartingales we can establish persistence properties of probabilistic programs. We also present results on related computational problems and an experimental evaluation of our approach on academic examples.

  • CAV (1) - Termination Analysis of Probabilistic Programs Through Positivstellensatz’s
    Computer Aided Verification, 2016
    Co-Authors: Krishnendu Chatterjee, Amir Kafshdar Goharshady
    Abstract:

    We consider nondeterministic probabilistic programs with the most basic liveness property of termination. We present efficient methods for termination analysis of nondeterministic probabilistic programs with polynomial guards and assignments. Our approach is through synthesis of polynomial ranking Supermartingales, that on one hand significantly generalizes linear ranking Supermartingales and on the other hand is a counterpart of polynomial ranking-functions for proving termination of nonprobabilistic programs. The approach synthesizes polynomial ranking-Supermartingales through Positivstellensatz’s, yielding an efficient method which is not only sound, but also semi-complete over a large subclass of programs. We show experimental results to demonstrate that our approach can handle several classical programs with complex polynomial guards and assignments, and can synthesize efficient quadratic ranking-Supermartingales when a linear one does not exist even for simple affine programs.

Abdelkarem Berkaoui - One of the best experts on this subject based on the ideXlab platform.

Xiaolu Tan - One of the best experts on this subject based on the ideXlab platform.

  • A general Doob-Meyer-Mertens decomposition for g-Supermartingale systems
    Electronic Journal of Probability, 2016
    Co-Authors: Bruno Bouchard, Dylan Possamaï, Xiaolu Tan
    Abstract:

    We provide a general Doob-Meyer decomposition for $g$-Supermartingale systems, which does not require any right-continuity on the system. In particular, it generalizes the Doob-Meyer decomposition of Mertens (1972) for classical Supermartingales, as well as Peng's (1999) version for right-continuous $g$-Supermartingales. As examples of application, we prove an optional decomposition theorem for $g$-Supermartingale systems, and also obtain a general version of the well-known dual formation for BSDEs with constraint on the gains-process, using very simple arguments.

  • A general Doob-Meyer-Mertens decomposition for g-Supermartingale systems
    Electronic Journal of Probability, 2016
    Co-Authors: Bruno Bouchard, Dylan Possamaï, Xiaolu Tan
    Abstract:

    International audienceWe provide a general Doob-Meyer decomposition for g-Supermartingale systems, which does not require any right-continuity on the system, nor that the filtration is quasi left-continuous. In particular, it generalizes the Doob-Meyer decomposition of Mertens [35] for classical Supermartingales, as well as Peng's [40] version for right-continuous g-Supermartingales. As examples of application, we prove an optional decomposition theorem for g-Supermartingale systems, and also obtain a general version of the well-known dual formation for BSDEs with constraint on the gains-process, using very simple arguments

  • A general Doob-Meyer-Mertens decomposition for g-Supermartingale systems
    Electronic Journal of Probability, 2016
    Co-Authors: Bruno Bouchard, Dylan Possamaï, Xiaolu Tan
    Abstract:

    We provide a general Doob-Meyer decomposition for g-Supermartingale systems, which does not require any right-continuity on the system, nor that the filtration is quasi left-continuous. In particular, it generalizes the Doob-Meyer decomposition of Mertens [35] for classical Supermartingales, as well as Peng's [40] version for right-continuous g-Supermartingales. As examples of application, we prove an optional decomposition theorem for g-Supermartingale systems, and also obtain a general version of the well-known dual formation for BSDEs with constraint on the gains-process, using very simple arguments.

Gianluca Cassese - One of the best experts on this subject based on the ideXlab platform.

Yuhu Feng - One of the best experts on this subject based on the ideXlab platform.