Categorical probability spaces, ergodic decompositions, and transitions to equilibrium (2310.04267v3)
Abstract: We study a category of probability spaces and measure-preserving Markov kernels up to almost sure equality. This category contains, among its isomorphisms, mod-zero isomorphisms of probability spaces. It also gives an isomorphism between the space of values of a random variable and the sigma-algebra that it generates on the outcome space, reflecting the standard mathematical practice of using the two interchangeably, for example when taking conditional expectations. We show that a number of constructions and results from classical probability theory, mostly involving notions of equilibrium, can be expressed and proven in terms of this category. In particular: - Given a stochastic dynamical system acting on a standard Borel space, we show that the almost surely invariant sigma-algebra can be obtained as a limit and as a colimit; - In the setting above, the almost surely invariant sigma-algebra gives rise, up to isomorphism of our category, to a standard Borel space; - As a corollary, we give a categorical version of the ergodic decomposition theorem for stochastic actions; - As an example, we show how de Finetti's theorem and the Hewitt-Savage and Kolmogorov zero-one laws fit in this limit-colimit picture. This work uses the tools of categorical probability, in particular Markov categories, as well as the theory of dagger categories.
- A categorical semantics of quantum protocols. In 2004 19nd Annual ACM/IEEE Symposium on Logic in Computer Science (LICS). IEEE, [Piscataway], NJ, 2004. arXiv:quant-ph/0402130.
- Cauchy completion in category theory. Cahiers de Topologie et Géométrie Différentielle Catégoriques, 27(2):133–146, 1986.
- David Blackwell. Idempotent Markoff chains. Ann. of Math. (2), 43:560–567, 1942.
- Vladimir I Bogachev. Measure Theory, volume 1. Springer-Verlag, Berlin, Heidelberg, 1. aufl. edition, 2007.
- Disintegration and Bayesian inversion via string diagrams. Math. Structures Comput. Sci., 29:938–971, 2019. arXiv:1709.00322.
- Quantum measurements without sums, pages 567–604. 2007.
- Borel kernels and their approximation, categorically. In MFPS 34: Proceedings of the Thirty-Fourth Conference on the Mathematical Foundations of Programming Semantics, volume 341, pages 91–119, 2018.
- Markov Chains. Springer, 2018.
- Absolute continuity, supports and idempotent splitting in categorical probability, 2023. arXiv:2308.00651.
- de Finetti’s theorem in categorical probability. J. Stoch. Anal., 2(4), 2021. arXiv:2105.02639.
- Representable Markov categories and comparison of statistical experiments in categorical probability. arxiv.org/abs/2010.07416.
- Dilations and information flow axioms in categorical probability. arXiv:2211.02507.
- The d𝑑ditalic_d-separation criterion in categorical probability. J. Mach. Learn. Res., 24(46):1–49, 2023. arXiv:2207.05740.
- Hidden markov models and the bayes filter in categorical probability, 2024. arXiv:2401.14669.
- A probability monad as the colimit of spaces of finite samples. Theory and Applications of Categories, 34(7):170–220, 2019.
- Infinite products and zero-one laws in categorical probability. Compositionality, 2:3, 2020. compositionality-journal.org/papers/compositionality-2-3.
- Tobias Fritz. The law of large numbers in categorical probability. https://www.youtube.com/watch?v=Gvf3H4e7l8s.
- Tobias Fritz. A synthetic approach to Markov kernels, conditional independence and theorems on sufficient statistics. Adv. Math., 370:107239, 2020. arXiv:1908.07021.
- Fabio Gadducci. On The Algebraic Approach To Concurrent Term Rewriting. PhD thesis, 11 1996.
- Michèle Giry. A categorical approach to probability theory. In Categorical aspects of topology and analysis, volume 915 of Lecture Notes in Mathematics. Springer, 1982.
- Categories for Quantum Theory. Oxford University Press, 2019.
- Bart Jacobs. From Probability Monads to Commutative Effectuses. Journ. of Logical and Algebraic Methods in Programming, 2017. In press. Available at http://www.cs.ru.nl/B.Jacobs/PAPERS/probability-monads.pdf.
- Bart Jacobs. Multinomial and hypergeometric distributions in Markov categories. In Proceedings of the Thirty-Seventh Conference on the Mathematical Foundations of Programming Semantics (MFPS, volume 351 of Electron. Notes Theor. Comput. Sci., pages 98–115, 2021. arXiv:2112.14044.
- Bart Jacobs. Sufficient statistics and split idempotents in discrete probability theory. In Proceedings of the Thirty-Eighth Conference on the Mathematical Foundations of Programming Semantics (MFPS XXXVIII), volume 1 of Electron. Notes Theor. Comput. Sci. Elsevier Sci. B. V., Amsterdam, 2023. arXiv:2212.09191.
- C. Jones and J. D. Plotkin. A Probabilistic Powerdomain of Evaluations. Proceedings of the Fourth Annual Symposium of Logics in Computer Science, 1989.
- Martti Karvonen. The Way of the Dagger. PhD thesis, University of Edinburgh, 2018.
- Anders Kock. Commutative monads as a theory of distributions. Theory Appl. Categ., 26:No. 4, 97–131, 2012. arXiv:1108.5952.
- F. W. Lawvere. The category of probabilistic mappings. https://ncatlab.org/nlab/files/lawvereprobability1962.pdf.
- A category-theoretic proof of the ergodic decomposition theorem, 2022. arXiv:2207.07353.
- Probability monads with submonads of deterministic states. In Proceedings of the 37th Annual ACM/IEEE Symposium on Logic in Computer Science, pages 1–13, 2022. arXiv:2204.07003.
- Markov Chains and Stochastic Stability. Springer, 1993.
- Arthur J. Parzygnat. Inverses, disintegrations, and bayesian inversion in quantum Markov categories, 2020. arXiv:2001.08375.
- Paolo Perrone. Categorical Probability and Stochastic Dominance in Metric Spaces. PhD thesis, University of Leipzig, 2018. Submitted. Available at http://personal-homepages.mis.mpg.de/perrone/phdthesis.pdf.
- Paolo Perrone. Lifting couplings in wasserstein spaces, 2021. 2110.06591.
- Peter Selinger. Dagger compact closed categories and completely positive maps: (extended abstract). Electronic Notes in Theoretical Computer Science, 170:139–163, 2007. Proceedings of the 3rd International Workshop on Quantum Programming Languages (QPL 2005).
- Peter Selinger. Idempotents in dagger categories (extended abstract). Electronic Notes in Theoretical Computer Science, 210:107–122, 2008.
- Compositional semantics for probabilistic programs with exact conditioning. In Logic in Computer Science. IEEE, 2021. arXiv:2101.11351.
- Dario Stein. Structural Foundations for Probabilistic Programming Languages. PhD thesis, University of Oxford, 2021. dario-stein.de/thesis.pdf.
- Terence Tao. What’s new. Ergodicity, 254a lecture 9, 2008. Mathematical blog with proofs, https://terrytao.wordpress.com/2008/02/04/254a-lecture-9-ergodicity.
- N. N. Čencov. The categories of mathematical statistics. Dokl. Akad. Nauk SSSR, 164:511–514, 1965. mathnet.ru/rus/dan31602.
- Cédric Villani. Optimal transport: old and new, volume 338 of Grundlehren der mathematischen Wissenschaften. Springer, 2009.
- Tadeusz Świrszcz. Monadic functors and convexity. Bull. Acad. Polon. Sci. Sér. Sci. Math. Astronom. Phys., 22, 1974.
- Noé Ensarguet (1 paper)
- Paolo Perrone (27 papers)