Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Predicting Instability in Complex Oscillator Networks: Limitations and Potentials of Network Measures and Machine Learning (2402.17500v1)

Published 27 Feb 2024 in nlin.AO, cs.LG, and cs.SI

Abstract: A central question of network science is how functional properties of systems arise from their structure. For networked dynamical systems, structure is typically quantified with network measures. A functional property that is of theoretical and practical interest for oscillatory systems is the stability of synchrony to localized perturbations. Recently, Graph Neural Networks (GNNs) have been shown to predict this stability successfully; at the same time, network measures have struggled to paint a clear picture. Here we collect 46 relevant network measures and find that no small subset can reliably predict stability. The performance of GNNs can only be matched by combining all network measures and nodewise machine learning. However, unlike GNNs, this approach fails to extrapolate from network ensembles to several real power grid topologies. This suggests that correlations of network measures and function may be misleading, and that GNNs capture the causal relationship between structure and stability substantially better.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (74)
  1. J.A. Acebron, L.L. Bonilla and R. Spigler “Synchronization in Populations of Globally Coupled Oscillators with Inertial Effects” In Physical Review. E, Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics 62, 2000, pp. 3437–3454 DOI: 10.1103/physreve.62.3437
  2. “The Kuramoto Model: A Simple Paradigm for Synchronization Phenomena” In Reviews of Modern Physics 77.1 American Physical Society, 2005, pp. 137–185 DOI: 10.1103/RevModPhys.77.137
  3. Kenneth Atz, Francesca Grisoni and Gisbert Schneider “Geometric Deep Learning on Molecular Representations” In Nature Machine Intelligence 3.12 Nature Publishing Group, 2021, pp. 1023–1032 DOI: 10.1038/s42256-021-00418-8
  4. “Structure Motif–Centric Learning Framework for Inorganic Crystalline Systems” In Science Advances 7.17 American Association for the Advancement of Science, 2021, pp. eabf1754 DOI: 10.1126/sciadv.abf1754
  5. “Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition” In Sensors (Basel, Switzerland) 22.19, 2022, pp. 7324 DOI: 10.3390/s22197324
  6. Rico Berner, Serhiy Yanchuk and Eckehard Schöll “What Adaptive Neuronal Networks Teach Us about Power Grids” In Physical Review E 103.4 American Physical Society, 2021, pp. 042315 DOI: 10.1103/PhysRevE.103.042315
  7. “Generalized Splay States in Phase Oscillator Networks” In Chaos: An Interdisciplinary Journal of Nonlinear Science 31.7, 2021, pp. 073128 DOI: 10.1063/5.0056664
  8. “Solitary States in Adaptive Nonlocal Oscillator Networks” In The European Physical Journal Special Topics 229.12, 2020, pp. 2183–2203 DOI: 10.1140/epjst/e2020-900253-0
  9. “Graph Neural Networks with Convolutional ARMA Filters” In IEEE Transactions on Pattern Analysis and Machine Intelligence IEEE Computer Society, 2021, pp. 1–1 DOI: 10.1109/TPAMI.2021.3054830
  10. Adam Birchfield “ACTIVSg2000: 2000-Bus Synthetic Grid on Footprint of Texas, Visited on Nov. 1, 2021”, 2021 URL: https://electricgrids.engr.tamu.edu/electric-grid-test-cases/activsg2000/
  11. “Grid Structural Characteristics as Validation Criteria for Synthetic Networks” In IEEE Transactions on Power Systems 32.4, 2017, pp. 3258–3265 DOI: 10.1109/TPWRS.2016.2616385
  12. “Network Synchronizability Analysis: A Graph-Theoretic Approach” In Chaos: An Interdisciplinary Journal of Nonlinear Science 18.3 American Institute of Physics, 2008, pp. 037102 DOI: 10.1063/1.2965530
  13. “Deep Learning and Social Network Analysis Elucidate Drivers of HIV Transmission in a High-Incidence Cohort of People Who Inject Drugs” In Science Advances 8.42 American Association for the Advancement of Science, 2022, pp. eabf0158 DOI: 10.1126/sciadv.abf0158
  14. Timo Dewenter and Alexander K. Hartmann “Large-Deviation Properties of Resilience of Power Grids” In New Journal of Physics 17.1 IOP Publishing, 2015, pp. 015005 DOI: 10.1088/1367-2630/17/1/015005
  15. “Topology Adaptive Graph Convolutional Networks”, 2017 DOI: 10.48550/arXiv.1710.10370
  16. Jonas Egerer “Open Source Electricity Model for Germany (ELMOD-DE)”, 2016 URL: https://www.econstor.eu/handle/10419/129782
  17. Yannick Feld and Alexander K. Hartmann “Large-Deviations of the Basin Stability of Power Grids” In Chaos: An Interdisciplinary Journal of Nonlinear Science 29.11 American Institute of Physics, 2019, pp. 113103 DOI: 10.1063/1.5121415
  18. Matthias Fey and Jan Eric Lenssen “Fast Graph Representation Learning with PyTorch Geometric” arXiv, 2019 DOI: 10.48550/ARXIV.1903.02428
  19. Aric Hagberg, Pieter Swart and Daniel S Chult “Exploring Network Structure, Dynamics, and Function Using Networkx”, 2008 URL: https://www.osti.gov/biblio/960616
  20. “Network-Induced Multistability through Lossy Coupling and Exotic Solitary States” In Nature Communications 11.1 Nature Publishing Group, 2020, pp. 592 DOI: 10.1038/s41467-020-14417-7
  21. “Survivability of Deterministic Dynamical Systems” In Scientific Reports 6.1 Nature Publishing Group, 2016, pp. 29654 DOI: 10.1038/srep29654
  22. “Cluster Explosive Synchronization in Complex Networks” In Physical Review Letters 110.21 American Physical Society, 2013, pp. 218701 DOI: 10.1103/PhysRevLett.110.218701
  23. “Second Order Centrality: Distributed Assessment of Nodes Criticity in Complex Networks” In Computer Communications 34.5, Special Issue: Complex Networks, 2011, pp. 619–628 DOI: 10.1016/j.comcom.2010.06.007
  24. Heetae Kim and Sang Hoon Lee “Relational Flexibility of Network Elements Based on Inconsistent Community Detection” In Physical Review E 100.2 American Physical Society, 2019, pp. 022311 DOI: 10.1103/PhysRevE.100.022311
  25. Heetae Kim, Sang Hoon Lee and Petter Holme “Building Blocks of the Basin Stability of Power Grids” In Physical Review E 93.6 American Physical Society, 2016, pp. 062318 DOI: 10.1103/PhysRevE.93.062318
  26. Heetae Kim, Sang Hoon Lee and Petter Holme “Community Consistency Determines the Stability Transition Window of Power-Grid Nodes” In New Journal of Physics 17.11 IOP Publishing, 2015, pp. 113005 DOI: 10.1088/1367-2630/17/11/113005
  27. “On Structural and Dynamical Factors Determining the Integrated Basin Instability of Power-Grid Nodes” In Chaos: An Interdisciplinary Journal of Nonlinear Science 29.10 American Institute of Physics, 2019, pp. 103132 DOI: 10.1063/1.5115532
  28. Thomas N. Kipf and Max Welling “Semi-Supervised Classification with Graph Convolutional Networks”, 2017 DOI: arXiv:1609.02907
  29. Johannes Kruse, Benjamin Schäfer and Dirk Witthaut “Revealing Drivers and Risks for Power Grid Frequency Stability with Explainable AI” In Patterns 2.11, 2021, pp. 100365 DOI: 10.1016/j.patter.2021.100365
  30. Yoshiki Kuramoto “Chemical Oscillations, Waves, and Turbulence” 19, Springer Series in Synergetics Berlin, Heidelberg: Springer, 1984 DOI: 10.1007/978-3-642-69689-3
  31. Yoshiki Kuramoto “Self-Entrainment of a Population of Coupled Non-Linear Oscillators” In International Symposium on Mathematical Problems in Theoretical Physics 1975 Berlin, Heidelberg: Springer, 1975, pp. 420–422 DOI: 10.1007/BFb0013365
  32. “Explainability in Graph Neural Networks: An Experimental Survey”, 2022 arXiv: http://arxiv.org/abs/2203.09258
  33. “Tune: A Research Platform for Distributed Model Selection and Training”, 2018 DOI: 10.48550/arXiv.1807.05118
  34. “Comparison of Handcrafted Features and Convolutional Neural Networks for Liver MR Image Adequacy Assessment” In Scientific Reports 10.1 Nature Publishing Group, 2020, pp. 20336 DOI: 10.1038/s41598-020-77264-y
  35. Michael Lindner “Applying Modeling, Simulation and Machine Learning for the Renewable Energy Transition”, 2023 DOI: 10.14279/depositonce-18257
  36. “Explaining the Explainers in Graph Neural Networks: A Comparative Study”, 2023 DOI: 10.48550/arXiv.2210.15304
  37. Scott M. Lundberg, Gabriel G. Erion and Su-In Lee “Consistent Individualized Feature Attribution for Tree Ensembles”, 2019 DOI: 10.48550/arXiv.1802.03888
  38. Scott M. Lundberg and Su-In Lee “A Unified Approach to Interpreting Model Predictions” In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17 Red Hook, NY, USA: Curran Associates Inc., 2017, pp. 4768–4777
  39. “Matching Pursuits with Time-Frequency Dictionaries” In IEEE Transactions on Signal Processing 41.12, 1993, pp. 3397–3415 DOI: 10.1109/78.258082
  40. “How Basin Stability Complements the Linear-Stability Paradigm” In Nature Physics 9.2 Nature Publishing Group, 2013, pp. 89–92 DOI: 10.1038/nphys2516
  41. “How Dead Ends Undermine Power Grid Stability” In Nature Communications 5.1 Nature Publishing Group, 2014, pp. 3969 DOI: 10.1038/ncomms4969
  42. Seyedmahdad Mirsamadi, Emad Barsoum and Cha Zhang “Automatic Speech Emotion Recognition Using Recurrent Neural Networks with Local Attention” In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2017, pp. 2227–2231 DOI: 10.1109/ICASSP.2017.7952552
  43. “Ray: A Distributed Framework for Emerging AI Applications”, 2018 arXiv: http://arxiv.org/abs/1712.05889
  44. “Predicting Basin Stability of Power Grids Using Graph Neural Networks” In New Journal of Physics 24.4 IOP Publishing, 2022, pp. 043041 DOI: 10.1088/1367-2630/ac54c9
  45. “Toward Dynamic Stability Assessment of Power Grid Topologies Using Graph Neural Networks” In Chaos: An Interdisciplinary Journal of Nonlinear Science 33.10, 2023, pp. 103103 DOI: 10.1063/5.0160915
  46. “Towards Dynamic Stability Analysis of Sustainable Power Grids Using Graph Neural Networks” NeurIPS 2022 Workshop on Tackling Climate Change with Machine Learning, 2022 DOI: 10.48550/arXiv.2212.11130
  47. “Deciphering the Imprint of Topology on Nonlinear Dynamical Network Stability” In New Journal of Physics 19.3 IOP Publishing, 2017, pp. 033029 DOI: 10.1088/1367-2630/aa6321
  48. “PyTorch: An Imperative Style, High-Performance Deep Learning Library” In Advances in Neural Information Processing Systems 32 Curran Associates, Inc., 2019, pp. 8024–8035 URL: http://papers.neurips.cc/paper/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf
  49. “Cluster Synchronization and Isolated Desynchronization in Complex Networks with Symmetries” In Nature Communications 5.1 Nature Publishing Group, 2014, pp. 4079 DOI: 10.1038/ncomms5079
  50. Arkady Pikovsky, Michael Rosenblum and Jürgen Kurths “Synchronization: A Universal Concept in Nonlinear Sciences”, Cambridge Nonlinear Science Series Cambridge: Cambridge University Press, 2001 DOI: 10.1017/CBO9780511755743
  51. “Efficient Catalyst Screening Using Graph Neural Networks to Predict Strain Effects on Adsorption Energy” In Science Advances 8.47 American Association for the Advancement of Science, 2022 DOI: 10.1126/sciadv.abq5944
  52. “The Kuramoto Model in Complex Networks” In Physics Reports 610, The Kuramoto Model in Complex Networks, 2016, pp. 1–98 DOI: 10.1016/j.physrep.2015.10.008
  53. “Dynamically Induced Cascading Failures in Power Grids” In Nature Communications 9.1 Nature Publishing Group, 2018, pp. 1975 DOI: 10.1038/s41467-018-04287-5
  54. “Crystal Graph Attention Networks for the Prediction of Stable Materials” In Science Advances 7.49 American Association for the Advancement of Science, 2021, pp. eabi7948 DOI: 10.1126/sciadv.abi7948
  55. “Higher-Order Explanations of Graph Neural Networks via Relevant Walks” In IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, pp. 1–1 DOI: 10.1109/TPAMI.2021.3115452
  56. Malte Schröder, Marc Timme and Dirk Witthaut “A Universal Order Parameter for Synchrony in Networks of Limit Cycle Oscillators” In Chaos: An Interdisciplinary Journal of Nonlinear Science 27.7 American Institute of Physics, 2017, pp. 073119 DOI: 10.1063/1.4995963
  57. Paul Schultz “Luap-Pik-Tree-Node-Classification”, 2021 URL: https://github.com/luap-pik/tree-node-classification
  58. Paul Schultz, Jobst Heitzig and Jürgen Kurths “A Random Growth Model for Power Grids and Other Spatially Embedded Infrastructure Networks” In The European Physical Journal Special Topics 223.12, 2014, pp. 2593–2610 DOI: 10.1140/epjst/e2014-02279-6
  59. Paul Schultz, Jobst Heitzig and Jürgen Kurths “Detours around Basin Stability in Power Networks” In New Journal of Physics 16.12, 2014, pp. 125001 DOI: 10.1088/1367-2630/16/12/125001
  60. “Comparison of Hand-Craft Feature Based SVM and CNN Based Deep Learning Framework for Automatic Polyp Classification” In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2017, pp. 3277–3280 DOI: 10.1109/EMBC.2017.8037556
  61. Steven H. Strogatz “From Kuramoto to Crawford: Exploring the Onset of Synchronization in Populations of Coupled Oscillators” In Physica D: Nonlinear Phenomena 143.1, 2000, pp. 1–20 DOI: 10.1016/S0167-2789(00)00094-4
  62. Halgurd Taher, Simona Olmi and Eckehard Schöll “Enhancing Power Grid Synchronization and Stability through Time-Delayed Feedback Control” In Physical Review E 100.6 American Physical Society, 2019, pp. 062306 DOI: 10.1103/PhysRevE.100.062306
  63. Peter A. Tass “Phase Resetting in Medicine and Biology: Stochastic Modelling and Data Analysis” Springer Science & Business Media, 2007
  64. “Predicting Dynamic Stability from Static Features in Power Grid Models Using Machine Learning” In Chaos: An Interdisciplinary Journal of Nonlinear Science 34.1, 2024, pp. 013139 DOI: 10.1063/5.0175372
  65. Liudmila Tumash, Simona Olmi and Eckehard Schöll “Stability and Control of Power Grids with Diluted Network Topology” In Chaos: An Interdisciplinary Journal of Nonlinear Science 29.12, 2019, pp. 123105 DOI: 10.1063/1.5111686
  66. M. Tyloo, L. Pagnier and P. Jacquod “The Key Player Problem in Complex Oscillator Networks and Electric Power Grids: Resistance Centralities Identify Local Vulnerabilities” In Science Advances 5.11 American Association for the Advancement of Science, 2019, pp. eaaw8359 DOI: 10.1126/sciadv.aaw8359
  67. “A Network Approach for Power Grid Robustness against Cascading Failures” In 2015 7th International Workshop on Reliable Networks Design and Modeling (RNDM), 2015, pp. 208–214 DOI: 10.1109/RNDM.2015.7325231
  68. “Collective Nonlinear Dynamics and Self-Organization in Decentralized Power Grids” In Reviews of Modern Physics 94.1 American Physical Society, 2022, pp. 015005 DOI: 10.1103/RevModPhys.94.015005
  69. “Critical Links and Nonlocal Rerouting in Complex Supply Networks” In Physical Review Letters 116.13 American Physical Society, 2016, pp. 138701 DOI: 10.1103/PhysRevLett.116.138701
  70. “Modular Architecture Facilitates Noise-Driven Control of Synchrony in Neuronal Networks” In Science Advances 9.34 American Association for the Advancement of Science, 2023, pp. eade1755 DOI: 10.1126/sciadv.ade1755
  71. “Power-Grid Stability Predictions Using Transferable Machine Learning” In Chaos: An Interdisciplinary Journal of Nonlinear Science 31.12 American Institute of Physics, 2021, pp. 123127 DOI: 10.1063/5.0058001
  72. “Explainability in Graph Neural Networks: A Taxonomic Survey”, 2022 DOI: 10.48550/arXiv.2012.15445
  73. Mohammad Reza Zare, David Olayemi Alebiosu and Sheng Long Lee “Comparison of Handcrafted Features and Deep Learning in Classification of Medical X-ray Images” In 2018 Fourth International Conference on Information Retrieval and Knowledge Management (CAMP), 2018, pp. 1–5 DOI: 10.1109/INFRKM.2018.8464688
  74. Changsong Zhou, Adilson E. Motter and Jürgen Kurths “Universality in the Synchronization of Weighted Random Networks” In Physical Review Letters 96.3 American Physical Society, 2006, pp. 034101 DOI: 10.1103/PhysRevLett.96.034101
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com