{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/triad-a-framework-leveraging-a-multi-role-llm","title":"Triad: A Framework Leveraging a Multi-Role LLM-based Agent to Solve Knowledge Base Question Answering","arxiv_id":"2402.14320","date":"2024-02-22","proceeding":null,"authors":["Chang Zong","Yuchen Yan","Weiming Lu","Jian Shao","Eliot Huang","Heng Chang","Yueting Zhuang"],"abstract":"Recent progress with LLM-based agents has shown promising results across various tasks. However, their use in answering questions from knowledge bases remains largely unexplored. Implementing a KBQA system using traditional methods is challenging due to the shortage of task-specific training data and the complexity of creating task-focused model structures. In this paper, we present Triad, a unified framework that utilizes an LLM-based agent with three roles for KBQA tasks. The agent is assigned three roles to tackle different KBQA subtasks: agent as a generalist for mastering various subtasks, as a decision maker for the selection of candidates, and as an advisor for answering questions with knowledge. Our KBQA framework is executed in four phases, involving the collaboration of the agent's multiple roles. We evaluated the performance of our framework using three benchmark datasets, and the results show that our framework outperforms state-of-the-art systems on the LC-QuAD and YAGO-QA benchmarks, yielding F1 scores of 11.8% and 20.7%, respectively.","url_abs":"https://arxiv.org/abs/2402.14320v6","url_pdf":"https://arxiv.org/pdf/2402.14320v6.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"triad-a-framework-leveraging-a-multi-role-llm","repo_url":"https://github.com/ZJU-DCDLab/Triad","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"knowledge-base-question-answering","task_name":"Knowledge Base Question Answering"},{"task_slug":"question-answering","task_name":"Question Answering"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.14320","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.14320"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ZJU-DCDLab/Triad","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5},"by_repo_kind":{"official":{"samples":5,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"de27068f288c8047","entry":"format_lm_input_and_response","repo":"ZJU-DCDLab/Triad","repo_kind":"official","path":"utils.py","file_url":"https://github.com/ZJU-DCDLab/Triad/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de27068f288c8047"}},{"code_sha256_prefix":"0f7cd1634c94f943","entry":"format_uri","repo":"ZJU-DCDLab/Triad","repo_kind":"official","path":"query_generator.py","file_url":"https://github.com/ZJU-DCDLab/Triad/blob/HEAD/query_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f7cd1634c94f943"}},{"code_sha256_prefix":"544fc9cf382eba79","entry":"log_lm","repo":"ZJU-DCDLab/Triad","repo_kind":"official","path":"utils.py","file_url":"https://github.com/ZJU-DCDLab/Triad/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"544fc9cf382eba79"}},{"code_sha256_prefix":"80efeec2d2ce9b72","entry":"log_time_cost","repo":"ZJU-DCDLab/Triad","repo_kind":"official","path":"utils.py","file_url":"https://github.com/ZJU-DCDLab/Triad/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"80efeec2d2ce9b72"}},{"code_sha256_prefix":"c4c58b4c8e527c57","entry":"rank_triples","repo":"ZJU-DCDLab/Triad","repo_kind":"official","path":"query_generator.py","file_url":"https://github.com/ZJU-DCDLab/Triad/blob/HEAD/query_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4c58b4c8e527c57"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}