{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/verify-in-the-graph-entity-disambiguation","title":"Verify-in-the-Graph: Entity Disambiguation Enhancement for Complex Claim Verification with Interactive Graph Representation","arxiv_id":"2505.22993","date":"2025-05-29","proceeding":null,"authors":["Hoang Pham","Thanh-Do Nguyen","Khac-Hoai Nam Bui"],"abstract":"Claim verification is a long-standing and challenging task that demands not only high accuracy but also explainability of the verification process. This task becomes an emerging research issue in the era of large language models (LLMs) since real-world claims are often complex, featuring intricate semantic structures or obfuscated entities. Traditional approaches typically address this by decomposing claims into sub-claims and querying a knowledge base to resolve hidden or ambiguous entities. However, the absence of effective disambiguation strategies for these entities can compromise the entire verification process. To address these challenges, we propose Verify-in-the-Graph (VeGraph), a novel framework leveraging the reasoning and comprehension abilities of LLM agents. VeGraph operates in three phases: (1) Graph Representation - an input claim is decomposed into structured triplets, forming a graph-based representation that integrates both structured and unstructured information; (2) Entity Disambiguation -VeGraph iteratively interacts with the knowledge base to resolve ambiguous entities within the graph for deeper sub-claim verification; and (3) Verification - remaining triplets are verified to complete the fact-checking process. Experiments using Meta-Llama-3-70B (instruct version) show that VeGraph achieves competitive performance compared to baselines on two benchmarks HoVer and FEVEROUS, effectively addressing claim verification challenges. Our source code and data are available for further exploitation.","url_abs":"https://arxiv.org/abs/2505.22993v1","url_pdf":"https://arxiv.org/pdf/2505.22993v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"claim-verification","task_name":"Claim Verification"},{"task_slug":"entity-disambiguation","task_name":"Entity Disambiguation"},{"task_slug":"fact-checking","task_name":"Fact Checking"}],"methods":[{"method_slug":"base","method_name":"BASE"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2505.22993","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2505.22993"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/teacherpeterpan/ProgramFC","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/wang2226/FOLK","reach":{"status":"ok"}}],"summary":{"ran":2,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":6,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"4e1c4ff342f96bc9","entry":"dispatch_openai_chat_requests","repo":"teacherpeterpan/ProgramFC","repo_kind":"found_in_text","path":"models/utils.py","file_url":"https://github.com/teacherpeterpan/ProgramFC/blob/HEAD/models/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e1c4ff342f96bc9"}},{"code_sha256_prefix":"94928eafb9afc8c7","entry":"dispatch_openai_prompt_requests","repo":"teacherpeterpan/ProgramFC","repo_kind":"found_in_text","path":"models/utils.py","file_url":"https://github.com/teacherpeterpan/ProgramFC/blob/HEAD/models/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"94928eafb9afc8c7"}},{"code_sha256_prefix":"fe524a16685ba8c3","entry":"hash","repo":"teacherpeterpan/ProgramFC","repo_kind":"found_in_text","path":"datasets/FEVEROUS/utils.py","file_url":"https://github.com/teacherpeterpan/ProgramFC/blob/HEAD/datasets/FEVEROUS/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fe524a16685ba8c3"}},{"code_sha256_prefix":"24103c586dcf9044","entry":"is_valid_sample","repo":"teacherpeterpan/ProgramFC","repo_kind":"found_in_text","path":"datasets/FEVEROUS/feverous_processing.py","file_url":"https://github.com/teacherpeterpan/ProgramFC/blob/HEAD/datasets/FEVEROUS/feverous_processing.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"24103c586dcf9044"}},{"code_sha256_prefix":"71cbb05f2913e671","entry":"load_sparse_csr","repo":"teacherpeterpan/ProgramFC","repo_kind":"found_in_text","path":"datasets/FEVEROUS/utils.py","file_url":"https://github.com/teacherpeterpan/ProgramFC/blob/HEAD/datasets/FEVEROUS/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"71cbb05f2913e671"}},{"code_sha256_prefix":"b1c91c9e3a3b88e4","entry":"normalize","repo":"teacherpeterpan/ProgramFC","repo_kind":"found_in_text","path":"datasets/FEVEROUS/utils.py","file_url":"https://github.com/teacherpeterpan/ProgramFC/blob/HEAD/datasets/FEVEROUS/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b1c91c9e3a3b88e4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}