AsyncMLD: Asynchronous Multi-LLM Framework for Dialogue Recommendation System (2312.13925v1)
Abstract: We have reached a practical and realistic phase in human-support dialogue agents by developing a LLM. However, when requiring expert knowledge or anticipating the utterance content using the massive size of the dialogue database, we still need help with the utterance content's effectiveness and the efficiency of its output speed, even if using LLM. Therefore, we propose a framework that uses LLM asynchronously in the part of the system that returns an appropriate response and in the part that understands the user's intention and searches the database. In particular, noting that it takes time for the robot to speak, threading related to database searches is performed while the robot is speaking.
- Y. Lee, “Improving end-to-end task-oriented dialog system with a simple auxiliary task,” in Findings of the Association for Computational Linguistics: EMNLP 2021. Punta Cana, Dominican Republic: Association for Computational Linguistics, 2021, pp. 1296–1303.
- OpenAI, “Gpt-4 technical report,” 2023.
- M. Takashi, H. Ryuichiro, S. Kurima, F. Tomo, N. Hiromitsu, and N. Takayuki, “Overview of dialogue robot competition 2023,” in Proceedings of the Dialogue Robot Competition 2023, 2023.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
