{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/one-agent-to-rule-them-all-towards-multi-1","title":"One Agent To Rule Them All: Towards Multi-agent Conversational AI","arxiv_id":"2203.07665","date":"2022-03-15","proceeding":"Findings (ACL) 2022 5","authors":["Christopher Clarke","Joseph Joshua Peper","Karthik Krishnamurthy","Walter Talamonti","Kevin Leach","Walter Lasecki","Yiping Kang","Lingjia Tang","Jason Mars"],"abstract":"The increasing volume of commercially available conversational agents (CAs) on the market has resulted in users being burdened with learning and adopting multiple agents to accomplish their tasks. Though prior work has explored supporting a multitude of domains within the design of a single agent, the interaction experience suffers due to the large action space of desired capabilities. To address these problems, we introduce a new task BBAI: Black-Box Agent Integration, focusing on combining the capabilities of multiple black-box CAs at scale. We explore two techniques: question agent pairing and question response pairing aimed at resolving this task. Leveraging these techniques, we design One For All (OFA), a scalable system that provides a unified interface to interact with multiple CAs. Additionally, we introduce MARS: Multi-Agent Response Selection, a new encoder model for question response pairing that jointly encodes user question and agent response pairs. We demonstrate that OFA is able to automatically and accurately integrate an ensemble of commercially available CAs spanning disparate domains. Specifically, using the MARS encoder we achieve the highest accuracy on our BBAI task, outperforming strong baselines.","url_abs":"https://arxiv.org/abs/2203.07665v1","url_pdf":"https://arxiv.org/pdf/2203.07665v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"one-agent-to-rule-them-all-towards-multi-1","repo_url":"https://github.com/ChrisIsKing/black-box-multi-agent-integation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"all","task_name":"All"},{"task_slug":"conversational-response-selection","task_name":"Conversational Response Selection"},{"task_slug":"multi-agent-integration","task_name":"Multi-agent Integration"},{"task_slug":"text-classification","task_name":"Text Classification"}],"methods":[{"method_slug":"ofa","method_name":"OFA"}],"datasets_introduced":[{"slug":"bbai-dataset","name":"BBAI Dataset","full_name":"Black-box Agent Integration"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/multi-agent-integration-on-bbai-dataset","task":"Multi-agent Integration","dataset":"BBAI Dataset","model":"MARS Encoder","rank_in_archive_order":1,"of":1,"metrics":{"P@1":"83.55"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2203.07665","atlas_url":"https://app.syntology.ai/?focus=2203.07665","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}