GenAINet: Enabling Wireless Collective Intelligence via Knowledge Transfer and Reasoning (2402.16631v3)
Abstract: Generative Artificial Intelligence (GenAI) and communication networks are expected to have groundbreaking synergies for 6G. Connecting GenAI agents via a wireless network can potentially unleash the power of Collective Intelligence (CI) and pave the way for AGI. However, current wireless networks are designed as a "data pipe" and are not suited to accommodate and leverage the power of GenAI. In this paper, we propose the GenAINet framework in which distributed GenAI agents communicate knowledge (facts, experiences, and methods) to accomplish arbitrary tasks. We first propose an architecture for a single GenAI agent and then provide a network architecture integrating GenAI capabilities to manage both network protocols and applications. Building on this, we investigate effective communication and reasoning problems by proposing a semantic-native GenAINet. Specifically, GenAI agents extract semantics from heterogeneous raw data, build and maintain a knowledge model representing the semantic relationships among pieces of knowledge, which is retrieved by GenAI models for planning and reasoning. Under this paradigm, different levels of collaboration can be achieved flexibly depending on the complexity of targeted tasks. Furthermore, we conduct two case studies in which, through wireless device queries, we demonstrate that extracting, compressing and transferring common knowledge can improve query accuracy while reducing communication costs; and in the wireless power control problem, we show that distributed agents can complete general tasks independently through collaborative reasoning without predefined communication protocols. Finally, we discuss challenges and future research directions in applying LLMs in 6G networks.
- G. Yenduri et al., “Generative pre-trained transformer: A comprehensive review on enabling technologies, potential applications, emerging challenges, and future directions,” arXiv preprint arXiv:2305.10435, 2023.
- L. Bariah et al., “Large generative ai models for telecom: The next big thing?” IEEE Communications Magazine, 2024.
- C. Hsieh et al., “Distilling step-by-step! outperforming larger language models with less training data and smaller model sizes,” in Findings of the Association for Computational Linguistics, 2023.
- W. Kwon et al., “Efficient memory management for large language model serving with paged attention,” in 29th Symposium on Operating Systems Principles, 2023.
- T. Dettmers, A. Pagnoni et al., “QLoRA: Efficient finetuning of quantized LLMs,” arXiv preprint arXiv:2305.14314, 2023.
- L. Wang et al., “A survey on large language model based autonomous agents,” arXiv preprint arXiv:2308.11432, 2023.
- J. Li, Q. Zhang, Y. Yu, Q. Fu, and D. Ye, “More agents is all you need,” arXiv preprint arXiv:2402.05120, 2024.
- G. Li, H. Hammoud, H. Itani, D. Khizbullin, and B. Ghanem, “CAMEL: Communicative agents for “mind” exploration of large scale language model society,” arXiv preprint arXiv:2303.17760, 2023.
- J. S. Park et al., “Generative agents: Interactive simulacra of human behavior,” in 36th Annual ACM Symposium on User Interface Software and Technology, 2023.
- R. Girdhar, A. El-Nouby et al., “ImageBind one embedding space to bind them all,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
- J. Wei, X. Wang et al., “Chain-of-thought prompting elicits reasoning in large language models,” in Annual Conference on Neural Information Processing Systems, 2022.
- H. Gilbert, M. Sandborn et al., “Semantic compression with large language models,” in International Conference on Social Networks Analysis, Management and Security, 2023.
- A. Maatouk, F. Ayed et al., “TeleQnA: A benchmark dataset to assess large language models telecommunications knowledge,” arXiv preprint arXiv:2310.15051, 2023.
- A. Dawid and Y. LeCun, “Introduction to latent variable energy-based models: A path towards autonomous machine intelligence,” arXiv preprint arXiv:2306.02572, 2023.
- M. Assran, Q. Duval et al., “Self-supervised learning from images with a joint-embedding predictive architecture,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.