{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/logic-level-evidence-retrieval-and-graph","title":"Logic-level Evidence Retrieval and Graph-based Verification Network for Table-based Fact Verification","arxiv_id":"2109.06480","date":"2021-09-14","proceeding":"EMNLP 2021 11","authors":["Qi Shi","Yu Zhang","Qingyu Yin","Ting Liu"],"abstract":"Table-based fact verification task aims to verify whether the given statement is supported by the given semi-structured table. Symbolic reasoning with logical operations plays a crucial role in this task. Existing methods leverage programs that contain rich logical information to enhance the verification process. However, due to the lack of fully supervised signals in the program generation process, spurious programs can be derived and employed, which leads to the inability of the model to catch helpful logical operations. To address the aforementioned problems, in this work, we formulate the table-based fact verification task as an evidence retrieval and reasoning framework, proposing the Logic-level Evidence Retrieval and Graph-based Verification network (LERGV). Specifically, we first retrieve logic-level program-like evidence from the given table and statement as supplementary evidence for the table. After that, we construct a logic-level graph to capture the logical relations between entities and functions in the retrieved evidence, and design a graph-based verification network to perform logic-level graph-based reasoning based on the constructed graph to classify the final entailment relation. Experimental results on the large-scale benchmark TABFACT show the effectiveness of the proposed approach.","url_abs":"https://arxiv.org/abs/2109.06480v1","url_pdf":"https://arxiv.org/pdf/2109.06480v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"logic-level-evidence-retrieval-and-graph","repo_url":"https://github.com/qshi95/lergv","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"fact-verification","task_name":"Fact Verification"},{"task_slug":"retrieval","task_name":"Retrieval"},{"task_slug":"table-based-fact-verification","task_name":"Table-based Fact Verification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2109.06480","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.06480"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/qshi95/lergv","reach":null}],"summary":{"ran":2,"ran_draft_wrong":1,"ran_honours":1,"ran_fixture":2,"unverified":1},"by_repo_kind":{"official":{"samples":7,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"73423ebb1b22eada","entry":"GATMultiLayer","repo":"qshi95/lergv","repo_kind":"official","path":"modeling_gnn.py","file_url":"https://github.com/qshi95/lergv/blob/HEAD/modeling_gnn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"73423ebb1b22eada"}},{"code_sha256_prefix":"4b1027cf723a6f29","entry":"GELU","repo":"qshi95/lergv","repo_kind":"official","path":"modeling_gnn.py","file_url":"https://github.com/qshi95/lergv/blob/HEAD/modeling_gnn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4b1027cf723a6f29"}},{"code_sha256_prefix":"4f7bf8f9ff270a79","entry":"aug","repo":"qshi95/lergv","repo_kind":"official","path":"modeling_gnn.py","file_url":"https://github.com/qshi95/lergv/blob/HEAD/modeling_gnn.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4f7bf8f9ff270a79"}},{"code_sha256_prefix":"b75e9c793d2a286a","entry":"gelu","repo":"qshi95/lergv","repo_kind":"official","path":"modeling_gnn.py","file_url":"https://github.com/qshi95/lergv/blob/HEAD/modeling_gnn.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b75e9c793d2a286a"}},{"code_sha256_prefix":"0d0159689e1a727b","entry":"get_target_index","repo":"qshi95/lergv","repo_kind":"official","path":"modeling_gnn.py","file_url":"https://github.com/qshi95/lergv/blob/HEAD/modeling_gnn.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0d0159689e1a727b"}},{"code_sha256_prefix":"774c83f8044ae111","entry":"remove_nodes_func","repo":"qshi95/lergv","repo_kind":"official","path":"modeling_gnn.py","file_url":"https://github.com/qshi95/lergv/blob/HEAD/modeling_gnn.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"774c83f8044ae111"}},{"code_sha256_prefix":"c6e276d7149b73a2","entry":"remove_nodes_and_edges","repo":"qshi95/lergv","repo_kind":"official","path":"modeling_gnn.py","file_url":"https://github.com/qshi95/lergv/blob/HEAD/modeling_gnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c6e276d7149b73a2"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}