PyTorch Geometric Signed Directed: A Software Package on Graph Neural Networks for Signed and Directed Graphs (2202.10793v6)
Abstract: Networks are ubiquitous in many real-world applications (e.g., social networks encoding trust/distrust relationships, correlation networks arising from time series data). While many networks are signed or directed, or both, there is a lack of unified software packages on graph neural networks (GNNs) specially designed for signed and directed networks. In this paper, we present PyTorch Geometric Signed Directed (PyGSD), a software package which fills this gap. Along the way, we evaluate the implemented methods with experiments with a view to providing insights into which method to choose for a given task. The deep learning framework consists of easy-to-use GNN models, synthetic and real-world data, as well as task-specific evaluation metrics and loss functions for signed and directed networks. As an extension library for PyG, our proposed software is maintained with open-source releases, detailed documentation, continuous integration, unit tests and code coverage checks. The GitHub repository of the library is https://github.com/SherylHYX/pytorch_geometric_signed_directed.
- Tensorflow: A system for large-scale machine learning. In 12th {normal-{\{{USENIX}normal-}\}} Symposium on Operating Systems Design and Implementation ({normal-{\{{OSDI}normal-}\}} 16), pages 265–283, 2016.
- The political blogosphere and the 2004 US election: divided they blog. In Proceedings of the 3rd International Workshop on Link Discovery, pages 36–43, 2005.
- Time-series clustering–a decade review. Information Systems, 53:16–38, 2015.
- Detection and clustering of lead-lag networks for multivariate time series with an application to financial markets. 7th SIGKDD Workshop on Mining and Learning from Time Series (MiLeTS), 2021.
- Climate inference on daily rainfall across the australian continent, 1876–2015. Annals of Applied Statistics, 13(2):683–712, 2019.
- Deep Gaussian embedding of graphs: Unsupervised inductive learning via ranking. In ICLR Workshop on Representation Learning on Graphs and Manifolds, 2017.
- The Activity of the Far Right on Telegram. https://www.researchgate.net/publication/346968575_The_Activity_of_the_Far_Right_on_Telegram_v21, 2020.
- Jax: composable transformations of python+ numpy programs. 2018.
- Andrew P Bradley. The use of the area under the roc curve in the evaluation of machine learning algorithms. Pattern Recognition, 30(7):1145–1159, 1997.
- CogDL: A comprehensive library for graph deep learning. In Proceedings of the ACM Web Conference 2023 (WWW’23), 2023.
- MXNet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274, 2015.
- " bridge" enhanced signed directed network embedding. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management, pages 773–782, 2018.
- Scalable clustering of signed networks using balance normalized cut. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management, CIKM ’12, pages 615–624, New York, United States, 2012. Association for Computing Machinery.
- The igraph software package for complex network research. InterJournal, Complex Systems, 1695(5):1–9, 2006.
- Sponge: a generalized eigenproblem for clustering signed networks. In The 22nd International Conference on Artificial Intelligence and Statistics, pages 1088–1098. PMLR, 2019.
- Hermitian matrices for clustering directed graphs: insights and applications. In International Conference on Artificial Intelligence and Statistics, pages 983–992. PMLR, 2020.
- CSIRO’s Data61. StellarGraph machine learning library. https://github.com/stellargraph/stellargraph, 2018.
- Convolutional neural networks on graphs with fast localized spectral filtering. In Advances in Neural Information Processing Systems, pages 3844–3852. Neural Information Processing Systems Foundation, 2016.
- Signed graph convolutional networks. In 2018 IEEE International Conference on Data Mining (ICDM), pages 929–934, Singapore, 2018. IEEE, IEEE.
- Anomaly detection in networks using spectral methods and network comparison approaches. arXiv preprint arXiv:1901.00402, 2019.
- Fast graph representation learning with PyTorch Geometric. In ICLR Workshop on Representation Learning on Graphs and Manifolds, 2019.
- Sergio M Focardi. Clustering economic and financial time series: Exploring the existence of stable correlation conditions. The Intertek Group, 2005.
- Citeseer: An automatic citation indexing system. In Proceedings of the third ACM conference on Digital libraries, pages 89–98, 1998.
- Neural message passing for quantum chemistry. In International Conference on Machine Learning, pages 1263–1272. PMLR, 2017.
- Jraph: A library for graph neural networks in jax., 2020. URL http://github. com/deepmind/jraph, 5.
- Graph neural networks in tensorflow and keras with spektral [application notes]. IEEE Computational Intelligence Magazine, 16(1):99–106, 2021.
- Propagation of trust and distrust. In Proceedings of the 13th International Conference on World Wide Web, pages 403–412, 2004.
- Exploring network structure, dynamics, and function using NetworkX. Technical report, Los Alamos National Lab.(LANL), Los Alamos, NM (United States), 2008.
- Inductive representation learning on large graphs. Advances in Neural Information Processing Systems, 30, 2017.
- OpenNE: An open source toolkit for network embedding. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (System Demonstrations), Brussels, Belgium, pages 139–144, 2018.
- Frank Harary. On the notion of balance of a signed graph. Michigan Mathematical Journal, 2(2):143–146, 1953.
- Yixuan He. GNNs for node clustering in signed and directed networks. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, pages 1547–1548, 2022.
- GNNRank: Learning global rankings from pairwise comparisons via directed graph neural networks. In International Conference on Machine Learning, pages 8581–8612. PMLR, 2022.
- MSGNN: a spectral graph neural network based on a novel magnetic signed Laplacian. In Learning on Graphs Conference, pages 40–1. PMLR, 2022.
- DIGRAC: digraph clustering based on flow imbalance. In Learning on Graphs Conference, pages 21–1. PMLR, 2022.
- SSSNET: Semi-supervised signed network clustering. In Proceedings of the 2022 SIAM International Conference on Data Mining (SDM), pages 244–252. SIAM, 2022.
- Robust angular synchronization via directed graph neural networks. arXiv preprint arXiv:2310.05842, 2023.
- Fritz Heider. Attitudes and cognitive organization. The Journal of Psychology, 21(1):107–112, 1946.
- Efficient graph deep learning in Tensorflow with TF_Geometric. In Proceedings of the 29th ACM International Conference on Multimedia, pages 3775–3778, 2021.
- Signed graph attention networks. In International Conference on Artificial Neural Networks, pages 566–577. Springer, 2019.
- SDGNN: Learning node representation for signed directed networks. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 196–203, 2021.
- Comparing partitions. Journal of Classification, 2(1):193–218, 1985.
- Adam: A Method for Stochastic Optimization. In Proceedings of the 3rd International Conference on Learning Representations, 2015.
- Semi-supervised classification with graph convolutional networks. In International Conference on Learning Representations, 2017.
- Edge weight prediction in weighted signed networks. In Data Mining (ICDM), 2016 IEEE 16th International Conference on, pages 221–230, Barcelona, Spain, 2016. IEEE, IEEE.
- Spectral analysis of signed graphs for clustering, prediction and visualization. In Proceedings of the 2010 SIAM International Conference on Data Mining, pages 559–570, Sydney, Australia, 2010. SIAM, IEEE.
- Signed networks in social media. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1361–1370. Association for Computing Machinery, 2010.
- Graph signal processing, graph neural network and graph learning on biological data: a systematic review. IEEE Reviews in Biomedical Engineering, 2021.
- Learning signed network embedding via graph attention. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 4772–4779, 2020.
- DIG: a turnkey library for diving into graph deep learning research. Journal of Machine Learning Research, 22(240):1–9, 2021.
- Traffic prediction with graph neural network: A survey. In CICTP 2021, pages 467–474. 2021.
- Spectral-based graph convolutional network for directed graphs. arXiv preprint arXiv:1907.08990, 2019.
- Clustering and community detection in directed networks: A survey. Physics Reports, 533(4):95–142, 2013.
- EvalNE: A framework for network embedding evaluation. SoftwareX, 17:100997, 2022.
- Signal processing on directed graphs: The role of edge directionality when processing and learning from network data. IEEE Signal Processing Magazine, 37(6):99–116, 2020.
- Controversial users demand local trust metrics: An experimental study on epinions.com community. In AAAI, pages 121–126, 2005.
- Clustering signed networks with the geometric mean of Laplacians. Advances in Neural Information Processing System, 29, 2016.
- Wiki-cs: A wikipedia-based benchmark for graph neural networks. arXiv preprint arXiv:2007.02901, 2020.
- Beware the middleman: Empirical analysis of bitcoin-exchange risk. In Financial Cryptography and Data Security: 17th International Conference, FC 2013, Okinawa, Japan, April 1-5, 2013, Revised Selected Papers 17, pages 25–33. Springer, 2013.
- Finding large balanced subgraphs in signed networks. In Proceedings of The Web Conference 2020, WWW ’20, page 1378–1388, New York, NY, USA, 2020. Association for Computing Machinery.
- Spectral clustering for directed networks. In Rosa M. Benito, Chantal Cherifi, Hocine Cherifi, Esteban Moro, Luis Mateus Rocha, and Marta Sales-Pardo, editors, Complex Networks & Their Applications IX, pages 87–99, Cham, 2021. Springer International Publishing.
- PyTorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems, pages 8024–8035, 2019.
- Financial forecasting through unsupervised clustering and neural networks. Operational Research, 6(2):103–127, 2006.
- Geom-GCN: geometric graph convolutional networks. In International Conference on Learning Representations, 2020.
- Marc J Perry. State-to-state migration Flows, 1995 to 2000. US Department of Commerce, Economics and Statistics Administration, US …, 2003.
- CDLIB: a python library to extract, compare and evaluate communities from complex networks. Applied Network Science, 4(1):1–26, 2019.
- Multi-scale attributed node embedding. Journal of Complex Networks, 9(2):cnab014, 2021.
- PyTorch Geometric Temporal: spatiotemporal signal processing with neural machine learning models. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management, CIKM ’21, page 4564–4573, New York, NY, USA, 2021. Association for Computing Machinery.
- Samuel Franklin Sampson. A novitiate in a period of change: An experimental and case study of social relationships. Cornell University, Ithaca, NY 14850, USA, 1968.
- Symmetrizations for clustering directed graphs. In Proceedings of the 14th International Conference on Extending Database Technology, pages 343–354, 2011.
- Modeling relational data with graph convolutional networks. In European Semantic Web Conference, pages 593–607. Springer, 2018.
- A systematic analysis of performance measures for classification tasks. Information Processing & Management, 45(4):427–437, 2009.
- NetworKit: A tool suite for large-scale complex network analysis. Network Science, 4(4):508–530, 2016.
- Directed acyclic graph neural networks. In International Conference on Learning Representations, 2021.
- Directed graph contrastive learning. Advances in Neural Information Processing Systems, 34, 2021.
- Digraph inception convolutional networks. Advances in Neural Information Processing Systems, 33:17907–17918, 2020.
- Directed graph convolutional network. arXiv preprint arXiv:2004.13970, 2020.
- From Louvain to Leiden: guaranteeing well-connected communities. Scientific Reports, 9(1):1–12, 2019.
- Motif-based spectral clustering of weighted directed networks. Applied Network Science, 5(62), September 2020.
- Composition-based multi-relational graph convolutional networks. In International Conference on Learning Representations, 2020.
- Graph attention networks. In International Conference on Learning Representations, 2018.
- Integrating protein-protein interaction networks with phenotypes reveals signs of interactions. Nature methods, 11(1):94–99, 2014.
- Attributed signed network embedding. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pages 137–146, 2017.
- Exploiting social network structure for person-to-person sentiment analysis. Transactions of the Association for Computational Linguistics, 2:297–310, 2014.
- A comprehensive survey on graph neural networks. IEEE transactions on neural networks and learning systems, 32(1):4–24, 2020.
- yahoo! finance. S&p 1500 data set link. https://finance.yahoo.com/, 2021. [Online; accessed 19-January-2021].
- SNE: signed network embedding. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 10235, pages 183–195. Springer Verlag, 2017.
- MagNet: a neural network for directed graphs. Advances in Neural Information Processing Systems, 34:27003–27015, 2021.
- Relational graph neural network with hierarchical attention for knowledge graph completion. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 9612–9619, 2020.
- Learning graph neural networks with Deep Graph Library. In Companion Proceedings of the Web Conference 2020, WWW ’20, page 305–306, 2020.
- Spectral embedding of signed networks. In Proceedings of the 2015 SIAM International Conference on Data Mining, pages 55–63. SIAM, 2015.
- Graph neural networks: A review of methods and applications. AI Open, 1:57–81, 2020.
- Aligraph: a comprehensive graph neural network platform. Proceedings of the VLDB Endowment, 12(12):2094–2105, 2019.
- Visual market sector analysis for financial time series data. In Visual Analytics Science and Technology (VAST), 2010 IEEE Symposium on, pages 83–90. IEEE, 2010.
- Yixuan He (20 papers)
- Xitong Zhang (20 papers)
- Junjie Huang (73 papers)
- Benedek Rozemberczki (23 papers)
- Mihai Cucuringu (76 papers)
- Gesine Reinert (70 papers)