Deterministic Massively Parallel Symmetry Breaking for Sparse Graphs (2301.11205v2)
Abstract: We consider the problem of designing deterministic graph algorithms for the model of Massively Parallel Computation (MPC) that improve with the sparsity of the input graph, as measured by the notion of arboricity. For the problems of maximal independent set (MIS), maximal matching (MM), and vertex coloring, we improve the state of the art as follows. Let $\lambda$ denote the arboricity of the $n$-node input graph with maximum degree $\Delta$. MIS and MM: We develop a deterministic low-space MPC algorithm that reduces the maximum degree to $poly(\lambda)$ in $O(\log \log n)$ rounds, improving and simplifying the randomized $O(\log \log n)$-round $poly(\max(\lambda, \log n))$-degree reduction of Ghaffari, Grunau, Jin [DISC'20]. Our approach when combined with the state-of-the-art $O(\log \Delta + \log \log n)$-round algorithm by Czumaj, Davies, Parter [SPAA'20, TALG'21] leads to an improved deterministic round complexity of $O(\log \lambda + \log \log n)$ for MIS and MM in low-space MPC. We also extend above MIS and MM algorithms to work with linear global memory. Specifically, we show that both problems can be solved in deterministic time $O(\min(\log n, \log \lambda \cdot \log \log n))$, and even in $O(\log \log n)$ time for graphs with arboricity at most $\log{O(1)} \log n$. In this setting, only a $O(\log2 \log n)$-running time bound for trees was known due to Latypov and Uitto [ArXiv'21]. Vertex Coloring: We present a $O(1)$-round deterministic algorithm for the problem of $O(\lambda)$-coloring in linear-memory MPC with relaxed global memory of $n \cdot poly(\lambda)$ that solves the problem after just one single graph partitioning step. This matches the state-of-the-art randomized round complexity by Ghaffari and Sayyadi [ICALP'19] and improves upon the deterministic $O(\lambda{\epsilon})$-round algorithm by Barenboim and Khazanov [CSR'18].
- A fast and simple randomized parallel algorithm for the maximal independent set problem. Journal of Algorithms, 7(4):567–583, 1986.
- The probabilistic method. John Wiley & Sons, 2016.
- Massively parallel computation of matching and mis in sparse graphs. In Proceedings of the 2019 ACM Symposium on Principles of Distributed Computing, PODC ’19, page 481–490, New York, NY, USA, 2019. Association for Computing Machinery.
- Near-optimal massively parallel graph connectivity. In 2019 IEEE 60th Annual Symposium on Foundations of Computer Science (FOCS), pages 1615–1636, 2019.
- Brief announcement: Semi-mapreduce meets congested clique. CoRR, abs/1802.10297, 2018.
- Sublogarithmic distributed mis algorithm for sparse graphs using nash-williams decomposition. Distributed Computing, 22(5):363–379, 2010.
- Deterministic distributed vertex coloring in polylogarithmic time. J. ACM, 58(5), 2011.
- Distributed graph coloring: Fundamentals and recent developments. Synthesis Lectures on Distributed Computing Theory, 4(1):1–171, 2013.
- The locality of distributed symmetry breaking. J. ACM, 63(3), 6 2016.
- Matching and MIS for uniformly sparse graphs in the low-memory MPC model. CoRR, abs/1807.05374, 2018.
- Breaking the linear-memory barrier in 𝖬𝖯𝖢𝖬𝖯𝖢\mathsf{MPC}sansserif_MPC: Fast 𝖬𝖨𝖲𝖬𝖨𝖲\mathsf{MIS}sansserif_MIS on trees with strongly sublinear memory. In Keren Censor-Hillel and Michele Flammini, editors, Structural Information and Communication Complexity, pages 124–138, Cham, 2019. Springer International Publishing.
- Distributed symmetry-breaking algorithms for congested cliques. In Fedor V. Fomin and Vladimir V. Podolskii, editors, Computer Science – Theory and Applications, pages 41–52, Cham, 2018. Springer International Publishing.
- Efficient deterministic distributed coloring with small bandwidth. In Proceedings of the 39th Symposium on Principles of Distributed Computing, PODC ’20, page 243–252, New York, NY, USA, 2020. Association for Computing Machinery.
- M. Bellare and J. Rompel. Randomness-efficient oblivious sampling. In Proceedings 35th Annual Symposium on Foundations of Computer Science, pages 276–287, 1994.
- Deterministic massively parallel connectivity. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, STOC 2022, page 162–175, New York, NY, USA, 2022. Association for Computing Machinery.
- Simple, deterministic, constant-round coloring in the congested clique. In Proceedings of the 39th Symposium on Principles of Distributed Computing, PODC ’20, page 309–318, New York, NY, USA, 2020. Association for Computing Machinery.
- Component stability in low-space massively parallel computation. In Proceedings of the 2021 ACM Symposium on Principles of Distributed Computing, PODC’21, page 481–491, New York, NY, USA, 2021. Association for Computing Machinery.
- Graph sparsification for derandomizing massively parallel computation with low space. ACM Trans. Algorithms, 17(2), 5 2021.
- Improved deterministic (delta+1) coloring in low-space mpc. In Proceedings of the 2021 ACM Symposium on Principles of Distributed Computing, PODC’21, page 469–479, New York, NY, USA, 2021. Association for Computing Machinery.
- The complexity of (delta+1) coloring in congested clique, massively parallel computation, and centralized local computation. In Proceedings of the 2019 ACM Symposium on Principles of Distributed Computing, PODC ’19, page 471–480, New York, NY, USA, 2019. Association for Computing Machinery.
- On the power of two-point based sampling. Journal of Complexity, 5(1):96–106, 1989.
- Derandomizing local distributed algorithms under bandwidth restrictions. Distributed Computing, 33(3):349–366, Jun 2020.
- Round compression for parallel matching algorithms. In Proceedings of the 50th Annual ACM SIGACT Symposium on Theory of Computing, STOC 2018, page 471–484, New York, NY, USA, 2018. Association for Computing Machinery.
- Universal classes of hash functions. Journal of Computer and System Sciences, 18(2):143–154, 1979.
- Mapreduce: Simplified data processing on large clusters. Commun. ACM, 51(1):107–113, 1 2008.
- Families of finite sets in which no set is covered by the union of r others. Israel J. Math, 51(1-2):79–89, 1985.
- Efficient approximation of product distributions. Random Structures & Algorithms, 13(1):1–16, 1998.
- Improved Deterministic Connectivity in Massively Parallel Computation. In Christian Scheideler, editor, 36th International Symposium on Distributed Computing (DISC 2022), volume 246 of Leibniz International Proceedings in Informatics (LIPIcs), pages 22:1–22:17, Dagstuhl, Germany, 2022. Schloss Dagstuhl – Leibniz-Zentrum für Informatik.
- On distributing symmetric streaming computations. ACM Trans. Algorithms, 6(4), 9 2010.
- Improved MPC Algorithms for MIS, Matching, and Coloring on Trees and Beyond. In Hagit Attiya, editor, 34th International Symposium on Distributed Computing (DISC 2020), volume 179 of Leibniz International Proceedings in Informatics (LIPIcs), pages 34:1–34:18, Dagstuhl, Germany, 2020. Schloss Dagstuhl–Leibniz-Zentrum für Informatik.
- Improved massively parallel computation algorithms for mis, matching, and vertex cover. In Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing, PODC ’18, page 129–138, New York, NY, USA, 2018. Association for Computing Machinery.
- Mohsen Ghaffari. An improved distributed algorithm for maximal independent set. In Proceedings of the 2016 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 270–277, 2016.
- Conditional hardness results for massively parallel computation from distributed lower bounds. In 2019 IEEE 60th Annual Symposium on Foundations of Computer Science (FOCS), pages 1650–1663, 2019.
- Simple and Near-Optimal Distributed Coloring for Sparse Graphs. In Andréa W. Richa, editor, 31st International Symposium on Distributed Computing (DISC 2017), volume 91 of Leibniz International Proceedings in Informatics (LIPIcs), pages 20:1–20:14, Dagstuhl, Germany, 2017. Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik.
- Michael T. Goodrich. Communication-efficient parallel sorting. SIAM Journal on Computing, 29(2):416–432, 1999.
- Distributed Arboricity-Dependent Graph Coloring via All-to-All Communication. In Christel Baier, Ioannis Chatzigiannakis, Paola Flocchini, and Stefano Leonardi, editors, 46th International Colloquium on Automata, Languages, and Programming (ICALP 2019), volume 132 of Leibniz International Proceedings in Informatics (LIPIcs), pages 142:1–142:14, Dagstuhl, Germany, 2019. Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik.
- Sorting, searching, and simulation in the mapreduce framework. In Takao Asano, Shin-ichi Nakano, Yoshio Okamoto, and Osamu Watanabe, editors, Algorithms and Computation, pages 374–383, Berlin, Heidelberg, 2011. Springer Berlin Heidelberg.
- Sparsifying distributed algorithms with ramifications in massively parallel computation and centralized local computation. In Proceedings of the 2019 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 1636–1653, 2019.
- Lessons from the congested clique applied to mapreduce. Theoretical Computer Science, 608:268–281, 2015. Structural Information and Communication Complexity.
- Amos Israeli and A. Itai. A fast and simple randomized parallel algorithm for maximal matching. Information Processing Letters, 22(2):77–80, 1986.
- Sample-And-Gather: Fast Ruling Set Algorithms in the Low-Memory MPC Model. In Nitin Saxena and Sunil Simon, editors, 40th IARCS Annual Conference on Foundations of Software Technology and Theoretical Computer Science (FSTTCS 2020), volume 182 of Leibniz International Proceedings in Informatics (LIPIcs), pages 28:1–28:18, Dagstuhl, Germany, 2020. Schloss Dagstuhl–Leibniz-Zentrum für Informatik.
- A model of computation for mapreduce. In Proceedings of the 2010 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 938–948, 2010.
- Toward more localized local algorithms: removing assumptions concerning global knowledge. Distributed Computing, 26(5):289–308, 2013.
- Fabian Kuhn. Weak graph colorings: Distributed algorithms and applications. In Proceedings of the Twenty-First Annual Symposium on Parallelism in Algorithms and Architectures, SPAA ’09, page 138–144, New York, NY, USA, 2009. Association for Computing Machinery.
- Christoph Lenzen. Optimal deterministic routing and sorting on the congested clique. In Proceedings of the 2013 ACM Symposium on Principles of Distributed Computing, PODC ’13, page 42–50, New York, NY, USA, 2013. Association for Computing Machinery.
- Nathan Linial. Locality in distributed graph algorithms. SIAM Journal on Computing, 21(1):193–201, 1992.
- Minimum-weight spanning tree construction in o(log log n) communication rounds. SIAM Journal on Computing, 35(1):120–131, 2005.
- Deterministic 3-coloring of trees in the sublinear MPC model. CoRR, abs/2105.13980, 2021.
- M Luby. A simple parallel algorithm for the maximal independent set problem. In Proceedings of the Seventeenth Annual ACM Symposium on Theory of Computing, STOC ’85, page 1–10, New York, NY, USA, 1985. Association for Computing Machinery.
- Michael Luby. Removing randomness in parallel computation without a processor penalty. Journal of Computer and System Sciences, 47(2):250–286, 1993.
- Pairwise independence and derandomization. Foundations and Trends in Theoretical Computer Science, 1(4):237–301, 2006.
- Brief announcement: Exponential speed-up of local algorithms using non-local communication. In Proceedings of the 29th ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing, PODC ’10, page 295–296, New York, NY, USA, 2010. Association for Computing Machinery.
- Randomized algorithms. Cambridge university press, 1995.
- The probabilistic method yields deterministic parallel algorithms. Journal of Computer and System Sciences, 49(3):478–516, 1994. 30th IEEE Conference on Foundations of Computer Science.
- C. St.J. A. Nash-Williams. Edge-Disjoint Spanning Trees of Finite Graphs. Journal of the London Mathematical Society, s1-36(1):445–450, 01 1961.
- C. St.J. A. Nash-Williams. Decomposition of Finite Graphs Into Forests. Journal of the London Mathematical Society, s1-39(1):12–12, 01 1964.
- Merav Parter. (Delta+1) Coloring in the Congested Clique Model. In Ioannis Chatzigiannakis, Christos Kaklamanis, Dániel Marx, and Donald Sannella, editors, 45th International Colloquium on Automata, Languages, and Programming (ICALP 2018), volume 107 of Leibniz International Proceedings in Informatics (LIPIcs), pages 160:1–160:14, Dagstuhl, Germany, 2018. Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik.
- Brief announcement: Deterministic massively parallel algorithms for ruling sets. In Proceedings of the 2022 ACM Symposium on Principles of Distributed Computing, PODC’22, page 366–368, New York, NY, USA, 2022. Association for Computing Machinery.
- Some simple distributed algorithms for sparse networks. Distributed computing, 14(2):97–100, 2001.
- Randomized (Delta+1)-Coloring in O(log* Delta) Congested Clique Rounds. In Ulrich Schmid and Josef Widder, editors, 32nd International Symposium on Distributed Computing (DISC 2018), volume 121 of Leibniz International Proceedings in Informatics (LIPIcs), pages 39:1–39:18, Dagstuhl, Germany, 2018. Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik.
- Prabhakar Raghavan. Probabilistic construction of deterministic algorithms: Approximating packing integer programs. Journal of Computer and System Sciences, 37(2):130–143, 1988.
- New classes and applications of hash functions. In 20th Annual Symposium on Foundations of Computer Science (sfcs 1979), pages 175–182, 1979.
- Spark: Cluster computing with working sets. In Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing, HotCloud’10, page 10, USA, 2010. USENIX Association.