{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/deliberation-on-priors-trustworthy-reasoning","title":"Deliberation on Priors: Trustworthy Reasoning of Large Language Models on Knowledge Graphs","arxiv_id":"2505.15210","date":"2025-05-21","proceeding":null,"authors":["Jie Ma","Ning Qu","Zhitao Gao","Rui Xing","Jun Liu","Hongbin Pei","Jiang Xie","Linyun Song","Pinghui Wang","Jing Tao","Zhou Su"],"abstract":"Knowledge graph-based retrieval-augmented generation seeks to mitigate hallucinations in Large Language Models (LLMs) caused by insufficient or outdated knowledge. However, existing methods often fail to fully exploit the prior knowledge embedded in knowledge graphs (KGs), particularly their structural information and explicit or implicit constraints. The former can enhance the faithfulness of LLMs' reasoning, while the latter can improve the reliability of response generation. Motivated by these, we propose a trustworthy reasoning framework, termed Deliberation over Priors (DP), which sufficiently utilizes the priors contained in KGs. Specifically, DP adopts a progressive knowledge distillation strategy that integrates structural priors into LLMs through a combination of supervised fine-tuning and Kahneman-Tversky optimization, thereby improving the faithfulness of relation path generation. Furthermore, our framework employs a reasoning-introspection strategy, which guides LLMs to perform refined reasoning verification based on extracted constraint priors, ensuring the reliability of response generation. Extensive experiments on three benchmark datasets demonstrate that DP achieves new state-of-the-art performance, especially a Hit@1 improvement of 13% on the ComplexWebQuestions dataset, and generates highly trustworthy responses. We also conduct various analyses to verify its flexibility and practicality. The code is available at https://github.com/reml-group/Deliberation-on-Priors.","url_abs":"https://arxiv.org/abs/2505.15210v1","url_pdf":"https://arxiv.org/pdf/2505.15210v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deliberation-on-priors-trustworthy-reasoning","repo_url":"https://github.com/reml-group/deliberation-on-priors","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"},{"task_slug":"knowledge-graphs","task_name":"Knowledge Graphs"},{"task_slug":"response-generation","task_name":"Response Generation"},{"task_slug":"retrieval-augmented-generation","task_name":"Retrieval-augmented Generation"}],"methods":[{"method_slug":"knowledge-distillation","method_name":"Knowledge Distillation"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2505.15210","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2505.15210"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/mira-ai-lab/Deliberation-on-Priors","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/reml-group/deliberation-on-priors","reach":null}],"summary":{"ran_draft_wrong":2,"ran_honours":2,"ran":1,"unverified":9},"by_repo_kind":{"official":{"samples":10,"ran":1,"repositories":1},"found_in_text":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3d5343ae289698e8","entry":"read_jsonl","repo":"mira-ai-lab/deliberation-on-priors","repo_kind":"found_in_text","path":"reasoning/instantiation.py","file_url":"https://github.com/mira-ai-lab/deliberation-on-priors/blob/HEAD/reasoning/instantiation.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":2,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3d5343ae289698e8"}},{"code_sha256_prefix":"1e11b1bf8e1981da","entry":"unique_list_of_lists","repo":"mira-ai-lab/deliberation-on-priors","repo_kind":"found_in_text","path":"reasoning/instantiation.py","file_url":"https://github.com/mira-ai-lab/deliberation-on-priors/blob/HEAD/reasoning/instantiation.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":2,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e11b1bf8e1981da"}},{"code_sha256_prefix":"c9255be856cbdcd6","entry":"chat_llm","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c9255be856cbdcd6"}},{"code_sha256_prefix":"d541befd0d18141c","entry":"find_possible_endpoints","repo":"mira-ai-lab/deliberation-on-priors","repo_kind":"found_in_text","path":"reasoning/instantiation.py","file_url":"https://github.com/mira-ai-lab/deliberation-on-priors/blob/HEAD/reasoning/instantiation.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d541befd0d18141c"}},{"code_sha256_prefix":"2fad8c014befa093","entry":"process_data","repo":"mira-ai-lab/deliberation-on-priors","repo_kind":"found_in_text","path":"reasoning/introspection.py","file_url":"https://github.com/mira-ai-lab/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2fad8c014befa093"}},{"code_sha256_prefix":"de4e81515c073cf7","entry":"answer_trying","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de4e81515c073cf7"}},{"code_sha256_prefix":"77154254149468e7","entry":"constraint_extract","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"77154254149468e7"}},{"code_sha256_prefix":"3a8571bfeb3b11f7","entry":"llms_only_answering","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a8571bfeb3b11f7"}},{"code_sha256_prefix":"b52a4c4d3f2af70d","entry":"log_error","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b52a4c4d3f2af70d"}},{"code_sha256_prefix":"fda81d888ca408ec","entry":"log_function_call","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fda81d888ca408ec"}},{"code_sha256_prefix":"3c8242558bdffcf8","entry":"log_ground_truth","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c8242558bdffcf8"}},{"code_sha256_prefix":"49dd4a41475a6c0f","entry":"log_llm_calls","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"49dd4a41475a6c0f"}},{"code_sha256_prefix":"73d42c7cfa0dafbe","entry":"reasoning_by_multi_agent","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"73d42c7cfa0dafbe"}},{"code_sha256_prefix":"43a5e6e045f0a363","entry":"select_path","repo":"reml-group/deliberation-on-priors","repo_kind":"official","path":"reasoning/introspection.py","file_url":"https://github.com/reml-group/deliberation-on-priors/blob/HEAD/reasoning/introspection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"43a5e6e045f0a363"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}