Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Gradient Flow of Energy: A General and Efficient Approach for Entity Alignment Decoding (2401.12798v3)

Published 23 Jan 2024 in cs.IR and cs.CL

Abstract: Entity alignment (EA), a pivotal process in integrating multi-source Knowledge Graphs (KGs), seeks to identify equivalent entity pairs across these graphs. Most existing approaches regard EA as a graph representation learning task, concentrating on enhancing graph encoders. However, the decoding process in EA - essential for effective operation and alignment accuracy - has received limited attention and remains tailored to specific datasets and model architectures, necessitating both entity and additional explicit relation embeddings. This specificity limits its applicability, particularly in GNN-based models. To address this gap, we introduce a novel, generalized, and efficient decoding approach for EA, relying solely on entity embeddings. Our method optimizes the decoding process by minimizing Dirichlet energy, leading to the gradient flow within the graph, to maximize graph homophily. The discretization of the gradient flow produces a fast and scalable approach, termed Triple Feature Propagation (TFP). TFP innovatively generalizes adjacency matrices to multi-views matrices:entity-to-entity, entity-to-relation, relation-to-entity, and relation-to-triple. The gradient flow through generalized matrices enables TFP to harness the multi-view structural information of KGs. Rigorous experimentation on diverse public datasets demonstrates that our approach significantly enhances various EA methods. Notably, the approach achieves these advancements with less than 6 seconds of additional computational time, establishing a new benchmark in efficiency and adaptability for future EA methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (54)
  1. Beamqa: Multi-hop knowledge graph question answering with sequence-to-sequence prediction and beam search. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 781–790.
  2. Active learning for entity alignment. In Advances in Information Retrieval: 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28–April 1, 2021, Proceedings, Part I 43. Springer, 48–62.
  3. Translating embeddings for modeling multi-relational data. Advances in neural information processing systems 26 (2013).
  4. Soumen Chakrabarti. 2022. Deep knowledge graph representation learning for completion, alignment, and question answering. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 3451–3454.
  5. Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 1511–1517.
  6. Knowledge-enhanced Multi-View Graph Neural Networks for Session-based Recommendation. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 352–361.
  7. Fan Chung. 1996. Spectral Graph Theory. In CBMS Regional Conference Series in Mathematics. American Mathematical Society.
  8. Marco Cuturi. 2013. Sinkhorn distances: Lightspeed computation of optimal transport. Advances in neural information processing systems 26 (2013).
  9. Deep Graph Matching Consensus. In International Conference on Learning Representations.
  10. Learning to exploit long-term relational dependencies in knowledge graphs. In International conference on machine learning. PMLR, 2505–2514.
  11. Refining network alignment to improve matched neighborhood consistency. In Proceedings of the 2021 SIAM International Conference on Data Mining (SDM). SIAM, 172–180.
  12. A Survey on Knowledge Graphs: Representation, Acquisition, and Applications. IEEE Trans. Neural Networks Learn. Syst. 33, 2 (2022), 494–514.
  13. Harold W Kuhn. 1955. The Hungarian method for the assignment problem. Naval research logistics quarterly 2, 1-2 (1955), 83–97.
  14. Word translation without parallel data. In International Conference on Learning Representations.
  15. Jia Li and Dandan Song. 2022. Uncertainty-aware pseudo label refinery for entity alignment. In Proceedings of the ACM Web Conference 2022. 829–837.
  16. ActiveEA: Active Learning for Neural Entity Alignment. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 3364–3374.
  17. Unsupervised Entity Alignment for Temporal Knowledge Graphs. In Proceedings of the ACM Web Conference 2023. 2528–2538.
  18. Exploring and Evaluating Attributes, Values, and Structures for Entity Alignment. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 6355–6364.
  19. An effective and efficient entity alignment decoding algorithm via third-order tensor isomorphism. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 5888–5898.
  20. Boosting the speed of entity alignment 10×\times×: Dual attention matching network with normalized hard sample mining. In Proceedings of the Web Conference 2021. 821–832.
  21. From Alignment to Assignment: Frustratingly Simple Unsupervised Entity Alignment. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 2843–2853.
  22. LightEA: A Scalable, Robust, and Interpretable Entity Alignment Framework via Three-view Label Propagation. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. 825–838.
  23. MRAEA: an efficient and robust entity alignment approach for cross-lingual knowledge graph. In Proceedings of the 13th International Conference on Web Search and Data Mining. 420–428.
  24. Relational reflection entity alignment. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 1095–1104.
  25. A Fractional Graph Laplacian Approach to Oversmoothing. arXiv preprint arXiv:2305.13084 (2023).
  26. Geom-GCN: Geometric Graph Convolutional Networks. In International Conference on Learning Representations.
  27. Semi-supervised entity alignment via knowledge graph embedding with awareness of degree difference. In The world wide web conference. 3130–3136.
  28. On the unreasonable effectiveness of feature propagation in learning on graphs with missing node features. In Learning on Graphs Conference. PMLR, 11–1.
  29. Alvin E Roth. 2008. Deferred acceptance algorithms: History, theory, practice, and open questions. international Journal of game Theory 36 (2008), 537–569.
  30. Xiaofei Shi and Yanghua Xiao. 2019. Modeling multi-mapping relations for precise cross-lingual entity alignment. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 813–822.
  31. Cross-lingual entity alignment via joint attribute-preserving embedding. In The Semantic Web–ISWC 2017: 16th International Semantic Web Conference, Vienna, Austria, October 21–25, 2017, Proceedings, Part I 16. Springer, 628–644.
  32. Revisiting embedding-based entity alignment: a robust and adaptive method. IEEE Transactions on Knowledge and Data Engineering (2022).
  33. Bootstrapping entity alignment with knowledge graph embedding.. In IJCAI, Vol. 18.
  34. Transedge: Translating relation-contextualized embeddings for knowledge graphs. In The Semantic Web–ISWC 2019: 18th International Semantic Web Conference, Auckland, New Zealand, October 26–30, 2019, Proceedings, Part I 18. Springer, 612–629.
  35. Knowledge graph alignment network with gated multi-hop neighborhood aggregation. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 222–229.
  36. A benchmarking study of embedding-based entity alignment for knowledge graphs. Proceedings of the VLDB Endowment 13, 12 (2020).
  37. Entity alignment between knowledge graphs using attribute embeddings. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 297–304.
  38. Mixed-Curvature Manifolds Interaction Learning for Knowledge Graph-aware Recommendation. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 372–382.
  39. Cross-lingual knowledge graph alignment via graph convolutional networks. In Proceedings of the 2018 conference on empirical methods in natural language processing. 349–357.
  40. Knowledge graph alignment with entity-pair embedding. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1672–1680.
  41. Relation-Aware Entity Alignment for Heterogeneous Knowledge Graphs. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence.
  42. Jointly Learning Entity and Relation Representations for Entity Alignment. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 240–249.
  43. Time-aware Graph Neural Network for Entity Alignment between Temporal Knowledge Graphs. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 8999–9010.
  44. Time-aware entity alignment using temporal relational attention. In Proceedings of the ACM Web Conference 2022. 788–797.
  45. Coordinated reasoning for cross-lingual knowledge graph alignment. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 9354–9361.
  46. Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Network. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 3156–3161.
  47. A vectorized relational graph convolutional network for multi-relational network alignment.. In IJCAI. 4135–4141.
  48. Donghan Yu and Yiming Yang. 2023. Retrieval-Enhanced Generative Model for Large-Scale Knowledge Graph Completion. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2334–2338.
  49. Generalized multi-relational graph convolution network. arXiv (2020), 07331.
  50. A comprehensive survey of entity alignment for knowledge graphs. AI Open 2 (2021), 1–13.
  51. Reinforced active entity alignment. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2477–2486.
  52. Degree-aware alignment for entities in tail. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 811–820.
  53. Collective multi-type entity alignment between knowledge graphs. In Proceedings of The Web Conference 2020. 2241–2252.
  54. RAGA: relation-aware graph attention networks for global entity alignment. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 501–513.
Citations (2)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets