{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/interactive-kbqa-multi-turn-interactions-for","title":"Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models","arxiv_id":"2402.15131","date":"2024-02-23","proceeding":null,"authors":["Guanming Xiong","Junwei Bao","Wen Zhao"],"abstract":"This study explores the realm of knowledge base question answering (KBQA). KBQA is considered a challenging task, particularly in parsing intricate questions into executable logical forms. Traditional semantic parsing (SP)-based methods require extensive data annotations, which result in significant costs. Recently, the advent of few-shot in-context learning, powered by large language models (LLMs), has showcased promising capabilities. However, fully leveraging LLMs to parse questions into logical forms in low-resource scenarios poses a substantial challenge. To tackle these hurdles, we introduce Interactive-KBQA, a framework designed to generate logical forms through direct interaction with knowledge bases (KBs). Within this framework, we have developed three generic APIs for KB interaction. For each category of complex question, we devised exemplars to guide LLMs through the reasoning processes. Our method achieves competitive results on the WebQuestionsSP, ComplexWebQuestions, KQA Pro, and MetaQA datasets with a minimal number of examples (shots). Importantly, our approach supports manual intervention, allowing for the iterative refinement of LLM outputs. By annotating a dataset with step-wise reasoning processes, we showcase our model's adaptability and highlight its potential for contributing significant enhancements to the field.","url_abs":"https://arxiv.org/abs/2402.15131v2","url_pdf":"https://arxiv.org/pdf/2402.15131v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"interactive-kbqa-multi-turn-interactions-for","repo_url":"https://github.com/jimxionggm/interactive-kbqa","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"in-context-learning","task_name":"In-Context Learning"},{"task_slug":"knowledge-base-question-answering","task_name":"Knowledge Base Question Answering"},{"task_slug":"question-answering","task_name":"Question Answering"},{"task_slug":"semantic-parsing","task_name":"Semantic Parsing"}],"methods":[{"method_slug":"base","method_name":"BASE"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.15131","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.15131"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jimxionggm/interactive-kbqa","reach":null}],"summary":{"ran":3,"ran_draft_wrong":3,"ran_fixture":1,"unverified":3},"by_repo_kind":{"official":{"samples":10,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"897e89203d507722","entry":"ChatCompletionMessage","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"897e89203d507722"}},{"code_sha256_prefix":"710bae971cb2b906","entry":"Choice","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"710bae971cb2b906"}},{"code_sha256_prefix":"21dfc4e2ab6279a3","entry":"StoppingCriteriaSub","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"21dfc4e2ab6279a3"}},{"code_sha256_prefix":"40beb3c0fb58cc9d","entry":"check_and_format_history","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"40beb3c0fb58cc9d"}},{"code_sha256_prefix":"74fb329db01ef4a7","entry":"history_to_input","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"DEP_MISSING","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"74fb329db01ef4a7"}},{"code_sha256_prefix":"cf84595e9a4296ef","entry":"make_responce","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cf84595e9a4296ef"}},{"code_sha256_prefix":"196fea4558be7d10","entry":"process_stop_words","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"196fea4558be7d10"}},{"code_sha256_prefix":"1bfcd9f0963c988d","entry":"load_model","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1bfcd9f0963c988d"}},{"code_sha256_prefix":"e9916eef46c98f37","entry":"load_tokenizer","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e9916eef46c98f37"}},{"code_sha256_prefix":"33db2544cd4ff8c4","entry":"predictor_history","repo":"jimxionggm/interactive-kbqa","repo_kind":"official","path":"predict/dialog_predictor.py","file_url":"https://github.com/jimxionggm/interactive-kbqa/blob/HEAD/predict/dialog_predictor.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"33db2544cd4ff8c4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}