{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/leveraging-structured-information-for","title":"Leveraging Structured Information for Explainable Multi-hop Question Answering and Reasoning","arxiv_id":"2311.03734","date":"2023-11-07","proceeding":null,"authors":["Ruosen Li","Xinya Du"],"abstract":"Neural models, including large language models (LLMs), achieve superior performance on multi-hop question-answering. To elicit reasoning capabilities from LLMs, recent works propose using the chain-of-thought (CoT) mechanism to generate both the reasoning chain and the answer, which enhances the model's capabilities in conducting multi-hop reasoning. However, several challenges still remain: such as struggling with inaccurate reasoning, hallucinations, and lack of interpretability. On the other hand, information extraction (IE) identifies entities, relations, and events grounded to the text. The extracted structured information can be easily interpreted by humans and machines (Grishman, 2019). In this work, we investigate constructing and leveraging extracted semantic structures (graphs) for multi-hop question answering, especially the reasoning process. Empirical results and human evaluations show that our framework: generates more faithful reasoning chains and substantially improves the QA performance on two benchmark datasets. Moreover, the extracted structures themselves naturally provide grounded explanations that are preferred by humans, as compared to the generated reasoning chains and saliency-based explanations.","url_abs":"https://arxiv.org/abs/2311.03734v1","url_pdf":"https://arxiv.org/pdf/2311.03734v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"leveraging-structured-information-for","repo_url":"https://github.com/bcdnlp/structure-qa","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-3.0"}}],"tasks":[{"task_slug":"multi-hop-question-answering","task_name":"Multi-hop Question Answering"},{"task_slug":"question-answering","task_name":"Question Answering"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2311.03734","atlas_url":"https://app.syntology.ai/?focus=2311.03734","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.03734"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bcdnlp/structure-qa","reach":{"status":"ok","spdx":"GPL-3.0"}}],"summary":{"ran_violates":1,"ran_honours":1,"ran":3,"ran_draft_wrong":1,"unverified":7},"by_repo_kind":{"official":{"samples":13,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":13,"samples":[{"code_sha256_prefix":"9d0dc82a4491f803","entry":"exact_match_score","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/hotpot_evaluate.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/hotpot_evaluate.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"9d0dc82a4491f803"}},{"code_sha256_prefix":"32a5f1733d9a8971","entry":"f1_score","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/hotpot_evaluate.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/hotpot_evaluate.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"32a5f1733d9a8971"}},{"code_sha256_prefix":"b7d4fb2b56b0a006","entry":"flatten","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/knowledge_graph_generation.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/knowledge_graph_generation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b7d4fb2b56b0a006"}},{"code_sha256_prefix":"dae7ab386661a4f4","entry":"normalize_answer","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/hotpot_evaluate.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/hotpot_evaluate.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"dae7ab386661a4f4"}},{"code_sha256_prefix":"81dc98c62fa01dde","entry":"token_length","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/demonstration.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/demonstration.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"81dc98c62fa01dde"}},{"code_sha256_prefix":"083a29a2790d4467","entry":"unflatten","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/knowledge_graph_generation.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/knowledge_graph_generation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"083a29a2790d4467"}},{"code_sha256_prefix":"8c5cb2832849e3c9","entry":"demo_generation","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/demonstration.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/demonstration.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"8c5cb2832849e3c9"}},{"code_sha256_prefix":"33c6fb2a636e2a0b","entry":"fetch_text","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/context_fetching.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/context_fetching.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"33c6fb2a636e2a0b"}},{"code_sha256_prefix":"b733c2237f78e89e","entry":"get_file_path","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/utils.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b733c2237f78e89e"}},{"code_sha256_prefix":"985f3e1928bf23e5","entry":"graph_demo_generation","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/demonstration.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/demonstration.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"985f3e1928bf23e5"}},{"code_sha256_prefix":"04117773586405bf","entry":"read_2wikimultihopqa","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/dataset_reader.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/dataset_reader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"04117773586405bf"}},{"code_sha256_prefix":"6a4f215228594a3f","entry":"read_hotpotqa","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/dataset_reader.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/dataset_reader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"6a4f215228594a3f"}},{"code_sha256_prefix":"51b87e785211f08b","entry":"read_metaqa","repo":"bcdnlp/structure-qa","repo_kind":"official","path":"src/dataset_reader.py","file_url":"https://github.com/bcdnlp/structure-qa/blob/HEAD/src/dataset_reader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"51b87e785211f08b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}