Markov Chains

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 53283 Experts worldwide ranked by ideXlab platform

Weiguo Yang - One of the best experts on this subject based on the ideXlab platform.

Abraham J Wyner - One of the best experts on this subject based on the ideXlab platform.

  • variable length Markov Chains
    Annals of Statistics, 1999
    Co-Authors: Peter Buhlmann, Abraham J Wyner
    Abstract:

    We study estimation in the class of stationary variable length Markov Chains (VLMC) on a finite space. The processes in this class are still Markovian of high order, but with memory of variable length yielding a much bigger and structurally richer class of models than ordinary high-order Markov Chains. From an algorithmic view, the VLMC model class has attracted interest in information theory and machine learning, but statistical properties have not yet been explored. Provided that good estimation is available, the additional structural richness of the model class enhances predictive power by finding a better trade-off between model bias and variance and allowing better structural description which can be of specific interest. The latter is exemplified with some DNA data. A version of the tree-structured context algorithm, proposed by Rissanen in an information theoretical set-up is shown to have new good asymptotic properties for estimation in the class of VLMCs. This remains true even when the underlying model increases in dimensionality. Furthermore, consistent estimation of minimal state spaces and mixing properties of fitted models are given. We also propose a new bootstrap scheme based on fitted VLMCs. We show its validity for quite general stationary categorical time series and for a broad range of statistical procedures.

Robert K Brayton - One of the best experts on this subject based on the ideXlab platform.

  • model checking continuous time Markov Chains
    ACM Transactions on Computational Logic (TOCL), 2000
    Co-Authors: Adnan Aziz, Kumud K Sanwal, Vigyan Singhal, Robert K Brayton
    Abstract:

    We present a logical formalism for expressing properties of continuous-time Markov Chains. The semantics for such properties arise as a natural extension of previous work on discrete-time Markov Chains to continuous time. The major result is that the verification problem is decidable; this is shown using results in algebraic and transcendental number theory.

  • verifying continuous time Markov Chains
    Computer Aided Verification, 1996
    Co-Authors: Adnan Aziz, Kumud K Sanwal, Vigyan Singhal, Robert K Brayton
    Abstract:

    We present a logical formalism for expressing properties of continuous time Markov Chains. The semantics for such properties arise as a natural extension of previous work on discrete time Markov Chains to continuous time. The major result is that the verification problem is decidable; this is shown using results in algebraic and transcendental number theory.

Jan Maas - One of the best experts on this subject based on the ideXlab platform.

  • ricci curvature of finite Markov Chains via convexity of the entropy
    Archive for Rational Mechanics and Analysis, 2012
    Co-Authors: Matthias Erbar, Jan Maas
    Abstract:

    We study a new notion of Ricci curvature that applies to Markov Chains on discrete spaces. This notion relies on geodesic convexity of the entropy and is analogous to the one introduced by Lott, Sturm, and Villani for geodesic measure spaces. In order to apply to the discrete setting, the role of the Wasserstein metric is taken over by a different metric, having the property that continuous time Markov Chains are gradient flows of the entropy. Using this notion of Ricci curvature we prove discrete analogues of fundamental results by Bakry–Emery and Otto–Villani. Further, we show that Ricci curvature bounds are preserved under tensorisation. As a special case we obtain the sharp Ricci curvature lower bound for the discrete hypercube.

  • ricci curvature of finite Markov Chains via convexity of the entropy
    arXiv: Metric Geometry, 2011
    Co-Authors: Matthias Erbar, Jan Maas
    Abstract:

    We study a new notion of Ricci curvature that applies to Markov Chains on discrete spaces. This notion relies on geodesic convexity of the entropy and is analogous to the one introduced by Lott, Sturm, and Villani for geodesic measure spaces. In order to apply to the discrete setting, the role of the Wasserstein metric is taken over by a different metric, having the property that continuous time Markov Chains are gradient flows of the entropy. Using this notion of Ricci curvature we prove discrete analogues of fundamental results by Bakry--Emery and Otto--Villani. Furthermore we show that Ricci curvature bounds are preserved under tensorisation. As a special case we obtain the sharp Ricci curvature lower bound for the discrete hypercube.

Francois Dufour - One of the best experts on this subject based on the ideXlab platform.