Predicting Instability in Complex Oscillator Networks: Limitations and Potentials of Network Measures and Machine Learning (2402.17500v1)
Abstract: A central question of network science is how functional properties of systems arise from their structure. For networked dynamical systems, structure is typically quantified with network measures. A functional property that is of theoretical and practical interest for oscillatory systems is the stability of synchrony to localized perturbations. Recently, Graph Neural Networks (GNNs) have been shown to predict this stability successfully; at the same time, network measures have struggled to paint a clear picture. Here we collect 46 relevant network measures and find that no small subset can reliably predict stability. The performance of GNNs can only be matched by combining all network measures and nodewise machine learning. However, unlike GNNs, this approach fails to extrapolate from network ensembles to several real power grid topologies. This suggests that correlations of network measures and function may be misleading, and that GNNs capture the causal relationship between structure and stability substantially better.
- J.A. Acebron, L.L. Bonilla and R. Spigler “Synchronization in Populations of Globally Coupled Oscillators with Inertial Effects” In Physical Review. E, Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics 62, 2000, pp. 3437–3454 DOI: 10.1103/physreve.62.3437
- “The Kuramoto Model: A Simple Paradigm for Synchronization Phenomena” In Reviews of Modern Physics 77.1 American Physical Society, 2005, pp. 137–185 DOI: 10.1103/RevModPhys.77.137
- Kenneth Atz, Francesca Grisoni and Gisbert Schneider “Geometric Deep Learning on Molecular Representations” In Nature Machine Intelligence 3.12 Nature Publishing Group, 2021, pp. 1023–1032 DOI: 10.1038/s42256-021-00418-8
- “Structure Motif–Centric Learning Framework for Inorganic Crystalline Systems” In Science Advances 7.17 American Association for the Advancement of Science, 2021, pp. eabf1754 DOI: 10.1126/sciadv.abf1754
- “Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition” In Sensors (Basel, Switzerland) 22.19, 2022, pp. 7324 DOI: 10.3390/s22197324
- Rico Berner, Serhiy Yanchuk and Eckehard Schöll “What Adaptive Neuronal Networks Teach Us about Power Grids” In Physical Review E 103.4 American Physical Society, 2021, pp. 042315 DOI: 10.1103/PhysRevE.103.042315
- “Generalized Splay States in Phase Oscillator Networks” In Chaos: An Interdisciplinary Journal of Nonlinear Science 31.7, 2021, pp. 073128 DOI: 10.1063/5.0056664
- “Solitary States in Adaptive Nonlocal Oscillator Networks” In The European Physical Journal Special Topics 229.12, 2020, pp. 2183–2203 DOI: 10.1140/epjst/e2020-900253-0
- “Graph Neural Networks with Convolutional ARMA Filters” In IEEE Transactions on Pattern Analysis and Machine Intelligence IEEE Computer Society, 2021, pp. 1–1 DOI: 10.1109/TPAMI.2021.3054830
- Adam Birchfield “ACTIVSg2000: 2000-Bus Synthetic Grid on Footprint of Texas, Visited on Nov. 1, 2021”, 2021 URL: https://electricgrids.engr.tamu.edu/electric-grid-test-cases/activsg2000/
- “Grid Structural Characteristics as Validation Criteria for Synthetic Networks” In IEEE Transactions on Power Systems 32.4, 2017, pp. 3258–3265 DOI: 10.1109/TPWRS.2016.2616385
- “Network Synchronizability Analysis: A Graph-Theoretic Approach” In Chaos: An Interdisciplinary Journal of Nonlinear Science 18.3 American Institute of Physics, 2008, pp. 037102 DOI: 10.1063/1.2965530
- “Deep Learning and Social Network Analysis Elucidate Drivers of HIV Transmission in a High-Incidence Cohort of People Who Inject Drugs” In Science Advances 8.42 American Association for the Advancement of Science, 2022, pp. eabf0158 DOI: 10.1126/sciadv.abf0158
- Timo Dewenter and Alexander K. Hartmann “Large-Deviation Properties of Resilience of Power Grids” In New Journal of Physics 17.1 IOP Publishing, 2015, pp. 015005 DOI: 10.1088/1367-2630/17/1/015005
- “Topology Adaptive Graph Convolutional Networks”, 2017 DOI: 10.48550/arXiv.1710.10370
- Jonas Egerer “Open Source Electricity Model for Germany (ELMOD-DE)”, 2016 URL: https://www.econstor.eu/handle/10419/129782
- Yannick Feld and Alexander K. Hartmann “Large-Deviations of the Basin Stability of Power Grids” In Chaos: An Interdisciplinary Journal of Nonlinear Science 29.11 American Institute of Physics, 2019, pp. 113103 DOI: 10.1063/1.5121415
- Matthias Fey and Jan Eric Lenssen “Fast Graph Representation Learning with PyTorch Geometric” arXiv, 2019 DOI: 10.48550/ARXIV.1903.02428
- Aric Hagberg, Pieter Swart and Daniel S Chult “Exploring Network Structure, Dynamics, and Function Using Networkx”, 2008 URL: https://www.osti.gov/biblio/960616
- “Network-Induced Multistability through Lossy Coupling and Exotic Solitary States” In Nature Communications 11.1 Nature Publishing Group, 2020, pp. 592 DOI: 10.1038/s41467-020-14417-7
- “Survivability of Deterministic Dynamical Systems” In Scientific Reports 6.1 Nature Publishing Group, 2016, pp. 29654 DOI: 10.1038/srep29654
- “Cluster Explosive Synchronization in Complex Networks” In Physical Review Letters 110.21 American Physical Society, 2013, pp. 218701 DOI: 10.1103/PhysRevLett.110.218701
- “Second Order Centrality: Distributed Assessment of Nodes Criticity in Complex Networks” In Computer Communications 34.5, Special Issue: Complex Networks, 2011, pp. 619–628 DOI: 10.1016/j.comcom.2010.06.007
- Heetae Kim and Sang Hoon Lee “Relational Flexibility of Network Elements Based on Inconsistent Community Detection” In Physical Review E 100.2 American Physical Society, 2019, pp. 022311 DOI: 10.1103/PhysRevE.100.022311
- Heetae Kim, Sang Hoon Lee and Petter Holme “Building Blocks of the Basin Stability of Power Grids” In Physical Review E 93.6 American Physical Society, 2016, pp. 062318 DOI: 10.1103/PhysRevE.93.062318
- Heetae Kim, Sang Hoon Lee and Petter Holme “Community Consistency Determines the Stability Transition Window of Power-Grid Nodes” In New Journal of Physics 17.11 IOP Publishing, 2015, pp. 113005 DOI: 10.1088/1367-2630/17/11/113005
- “On Structural and Dynamical Factors Determining the Integrated Basin Instability of Power-Grid Nodes” In Chaos: An Interdisciplinary Journal of Nonlinear Science 29.10 American Institute of Physics, 2019, pp. 103132 DOI: 10.1063/1.5115532
- Thomas N. Kipf and Max Welling “Semi-Supervised Classification with Graph Convolutional Networks”, 2017 DOI: arXiv:1609.02907
- Johannes Kruse, Benjamin Schäfer and Dirk Witthaut “Revealing Drivers and Risks for Power Grid Frequency Stability with Explainable AI” In Patterns 2.11, 2021, pp. 100365 DOI: 10.1016/j.patter.2021.100365
- Yoshiki Kuramoto “Chemical Oscillations, Waves, and Turbulence” 19, Springer Series in Synergetics Berlin, Heidelberg: Springer, 1984 DOI: 10.1007/978-3-642-69689-3
- Yoshiki Kuramoto “Self-Entrainment of a Population of Coupled Non-Linear Oscillators” In International Symposium on Mathematical Problems in Theoretical Physics 1975 Berlin, Heidelberg: Springer, 1975, pp. 420–422 DOI: 10.1007/BFb0013365
- “Explainability in Graph Neural Networks: An Experimental Survey”, 2022 arXiv: http://arxiv.org/abs/2203.09258
- “Tune: A Research Platform for Distributed Model Selection and Training”, 2018 DOI: 10.48550/arXiv.1807.05118
- “Comparison of Handcrafted Features and Convolutional Neural Networks for Liver MR Image Adequacy Assessment” In Scientific Reports 10.1 Nature Publishing Group, 2020, pp. 20336 DOI: 10.1038/s41598-020-77264-y
- Michael Lindner “Applying Modeling, Simulation and Machine Learning for the Renewable Energy Transition”, 2023 DOI: 10.14279/depositonce-18257
- “Explaining the Explainers in Graph Neural Networks: A Comparative Study”, 2023 DOI: 10.48550/arXiv.2210.15304
- Scott M. Lundberg, Gabriel G. Erion and Su-In Lee “Consistent Individualized Feature Attribution for Tree Ensembles”, 2019 DOI: 10.48550/arXiv.1802.03888
- Scott M. Lundberg and Su-In Lee “A Unified Approach to Interpreting Model Predictions” In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17 Red Hook, NY, USA: Curran Associates Inc., 2017, pp. 4768–4777
- “Matching Pursuits with Time-Frequency Dictionaries” In IEEE Transactions on Signal Processing 41.12, 1993, pp. 3397–3415 DOI: 10.1109/78.258082
- “How Basin Stability Complements the Linear-Stability Paradigm” In Nature Physics 9.2 Nature Publishing Group, 2013, pp. 89–92 DOI: 10.1038/nphys2516
- “How Dead Ends Undermine Power Grid Stability” In Nature Communications 5.1 Nature Publishing Group, 2014, pp. 3969 DOI: 10.1038/ncomms4969
- Seyedmahdad Mirsamadi, Emad Barsoum and Cha Zhang “Automatic Speech Emotion Recognition Using Recurrent Neural Networks with Local Attention” In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2017, pp. 2227–2231 DOI: 10.1109/ICASSP.2017.7952552
- “Ray: A Distributed Framework for Emerging AI Applications”, 2018 arXiv: http://arxiv.org/abs/1712.05889
- “Predicting Basin Stability of Power Grids Using Graph Neural Networks” In New Journal of Physics 24.4 IOP Publishing, 2022, pp. 043041 DOI: 10.1088/1367-2630/ac54c9
- “Toward Dynamic Stability Assessment of Power Grid Topologies Using Graph Neural Networks” In Chaos: An Interdisciplinary Journal of Nonlinear Science 33.10, 2023, pp. 103103 DOI: 10.1063/5.0160915
- “Towards Dynamic Stability Analysis of Sustainable Power Grids Using Graph Neural Networks” NeurIPS 2022 Workshop on Tackling Climate Change with Machine Learning, 2022 DOI: 10.48550/arXiv.2212.11130
- “Deciphering the Imprint of Topology on Nonlinear Dynamical Network Stability” In New Journal of Physics 19.3 IOP Publishing, 2017, pp. 033029 DOI: 10.1088/1367-2630/aa6321
- “PyTorch: An Imperative Style, High-Performance Deep Learning Library” In Advances in Neural Information Processing Systems 32 Curran Associates, Inc., 2019, pp. 8024–8035 URL: http://papers.neurips.cc/paper/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf
- “Cluster Synchronization and Isolated Desynchronization in Complex Networks with Symmetries” In Nature Communications 5.1 Nature Publishing Group, 2014, pp. 4079 DOI: 10.1038/ncomms5079
- Arkady Pikovsky, Michael Rosenblum and Jürgen Kurths “Synchronization: A Universal Concept in Nonlinear Sciences”, Cambridge Nonlinear Science Series Cambridge: Cambridge University Press, 2001 DOI: 10.1017/CBO9780511755743
- “Efficient Catalyst Screening Using Graph Neural Networks to Predict Strain Effects on Adsorption Energy” In Science Advances 8.47 American Association for the Advancement of Science, 2022 DOI: 10.1126/sciadv.abq5944
- “The Kuramoto Model in Complex Networks” In Physics Reports 610, The Kuramoto Model in Complex Networks, 2016, pp. 1–98 DOI: 10.1016/j.physrep.2015.10.008
- “Dynamically Induced Cascading Failures in Power Grids” In Nature Communications 9.1 Nature Publishing Group, 2018, pp. 1975 DOI: 10.1038/s41467-018-04287-5
- “Crystal Graph Attention Networks for the Prediction of Stable Materials” In Science Advances 7.49 American Association for the Advancement of Science, 2021, pp. eabi7948 DOI: 10.1126/sciadv.abi7948
- “Higher-Order Explanations of Graph Neural Networks via Relevant Walks” In IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, pp. 1–1 DOI: 10.1109/TPAMI.2021.3115452
- Malte Schröder, Marc Timme and Dirk Witthaut “A Universal Order Parameter for Synchrony in Networks of Limit Cycle Oscillators” In Chaos: An Interdisciplinary Journal of Nonlinear Science 27.7 American Institute of Physics, 2017, pp. 073119 DOI: 10.1063/1.4995963
- Paul Schultz “Luap-Pik-Tree-Node-Classification”, 2021 URL: https://github.com/luap-pik/tree-node-classification
- Paul Schultz, Jobst Heitzig and Jürgen Kurths “A Random Growth Model for Power Grids and Other Spatially Embedded Infrastructure Networks” In The European Physical Journal Special Topics 223.12, 2014, pp. 2593–2610 DOI: 10.1140/epjst/e2014-02279-6
- Paul Schultz, Jobst Heitzig and Jürgen Kurths “Detours around Basin Stability in Power Networks” In New Journal of Physics 16.12, 2014, pp. 125001 DOI: 10.1088/1367-2630/16/12/125001
- “Comparison of Hand-Craft Feature Based SVM and CNN Based Deep Learning Framework for Automatic Polyp Classification” In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2017, pp. 3277–3280 DOI: 10.1109/EMBC.2017.8037556
- Steven H. Strogatz “From Kuramoto to Crawford: Exploring the Onset of Synchronization in Populations of Coupled Oscillators” In Physica D: Nonlinear Phenomena 143.1, 2000, pp. 1–20 DOI: 10.1016/S0167-2789(00)00094-4
- Halgurd Taher, Simona Olmi and Eckehard Schöll “Enhancing Power Grid Synchronization and Stability through Time-Delayed Feedback Control” In Physical Review E 100.6 American Physical Society, 2019, pp. 062306 DOI: 10.1103/PhysRevE.100.062306
- Peter A. Tass “Phase Resetting in Medicine and Biology: Stochastic Modelling and Data Analysis” Springer Science & Business Media, 2007
- “Predicting Dynamic Stability from Static Features in Power Grid Models Using Machine Learning” In Chaos: An Interdisciplinary Journal of Nonlinear Science 34.1, 2024, pp. 013139 DOI: 10.1063/5.0175372
- Liudmila Tumash, Simona Olmi and Eckehard Schöll “Stability and Control of Power Grids with Diluted Network Topology” In Chaos: An Interdisciplinary Journal of Nonlinear Science 29.12, 2019, pp. 123105 DOI: 10.1063/1.5111686
- M. Tyloo, L. Pagnier and P. Jacquod “The Key Player Problem in Complex Oscillator Networks and Electric Power Grids: Resistance Centralities Identify Local Vulnerabilities” In Science Advances 5.11 American Association for the Advancement of Science, 2019, pp. eaaw8359 DOI: 10.1126/sciadv.aaw8359
- “A Network Approach for Power Grid Robustness against Cascading Failures” In 2015 7th International Workshop on Reliable Networks Design and Modeling (RNDM), 2015, pp. 208–214 DOI: 10.1109/RNDM.2015.7325231
- “Collective Nonlinear Dynamics and Self-Organization in Decentralized Power Grids” In Reviews of Modern Physics 94.1 American Physical Society, 2022, pp. 015005 DOI: 10.1103/RevModPhys.94.015005
- “Critical Links and Nonlocal Rerouting in Complex Supply Networks” In Physical Review Letters 116.13 American Physical Society, 2016, pp. 138701 DOI: 10.1103/PhysRevLett.116.138701
- “Modular Architecture Facilitates Noise-Driven Control of Synchrony in Neuronal Networks” In Science Advances 9.34 American Association for the Advancement of Science, 2023, pp. eade1755 DOI: 10.1126/sciadv.ade1755
- “Power-Grid Stability Predictions Using Transferable Machine Learning” In Chaos: An Interdisciplinary Journal of Nonlinear Science 31.12 American Institute of Physics, 2021, pp. 123127 DOI: 10.1063/5.0058001
- “Explainability in Graph Neural Networks: A Taxonomic Survey”, 2022 DOI: 10.48550/arXiv.2012.15445
- Mohammad Reza Zare, David Olayemi Alebiosu and Sheng Long Lee “Comparison of Handcrafted Features and Deep Learning in Classification of Medical X-ray Images” In 2018 Fourth International Conference on Information Retrieval and Knowledge Management (CAMP), 2018, pp. 1–5 DOI: 10.1109/INFRKM.2018.8464688
- Changsong Zhou, Adilson E. Motter and Jürgen Kurths “Universality in the Synchronization of Weighted Random Networks” In Physical Review Letters 96.3 American Physical Society, 2006, pp. 034101 DOI: 10.1103/PhysRevLett.96.034101