{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/natural-language-inference-with-self","title":"Natural Language Inference with Self-Attention for Veracity Assessment of Pandemic Claims","arxiv_id":"2205.02596","date":"2022-05-05","proceeding":"NAACL 2022 7","authors":["M. Arana-Catania","Elena Kochkina","Arkaitz Zubiaga","Maria Liakata","Rob Procter","Yulan He"],"abstract":"We present a comprehensive work on automated veracity assessment from dataset creation to developing novel methods based on Natural Language Inference (NLI), focusing on misinformation related to the COVID-19 pandemic. We first describe the construction of the novel PANACEA dataset consisting of heterogeneous claims on COVID-19 and their respective information sources. The dataset construction includes work on retrieval techniques and similarity measurements to ensure a unique set of claims. We then propose novel techniques for automated veracity assessment based on Natural Language Inference including graph convolutional networks and attention based approaches. We have carried out experiments on evidence retrieval and veracity assessment on the dataset using the proposed techniques and found them competitive with SOTA methods, and provided a detailed discussion.","url_abs":"https://arxiv.org/abs/2205.02596v1","url_pdf":"https://arxiv.org/pdf/2205.02596v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"misinformation","task_name":"Misinformation"},{"task_slug":"natural-language-inference","task_name":"Natural Language Inference"},{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2205.02596","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.02596"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/thunlp/KernelGAT","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/thunlp/GEAR","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":6},"by_repo_kind":{"found_in_text":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"478a8f97a41f3881","entry":"convert_examples_to_features","repo":"thunlp/GEAR","repo_kind":"found_in_text","path":"feature_extractor/extractor.py","file_url":"https://github.com/thunlp/GEAR/blob/HEAD/feature_extractor/extractor.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"478a8f97a41f3881"}},{"code_sha256_prefix":"f1c875bc177439e7","entry":"feature_pooling","repo":"thunlp/GEAR","repo_kind":"found_in_text","path":"gear/utils.py","file_url":"https://github.com/thunlp/GEAR/blob/HEAD/gear/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f1c875bc177439e7"}},{"code_sha256_prefix":"ea5e88ea0a342fc5","entry":"get_predicted_label","repo":"thunlp/GEAR","repo_kind":"found_in_text","path":"gear/results_scorer.py","file_url":"https://github.com/thunlp/GEAR/blob/HEAD/gear/results_scorer.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ea5e88ea0a342fc5"}},{"code_sha256_prefix":"d505cdfd0346181d","entry":"load_bert_features_claim","repo":"thunlp/GEAR","repo_kind":"found_in_text","path":"gear/utils.py","file_url":"https://github.com/thunlp/GEAR/blob/HEAD/gear/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d505cdfd0346181d"}},{"code_sha256_prefix":"7810d2e781319a98","entry":"load_bert_features_claim_test","repo":"thunlp/GEAR","repo_kind":"found_in_text","path":"gear/utils.py","file_url":"https://github.com/thunlp/GEAR/blob/HEAD/gear/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7810d2e781319a98"}},{"code_sha256_prefix":"2ae4bb4b0bc8a71c","entry":"read_examples","repo":"thunlp/GEAR","repo_kind":"found_in_text","path":"feature_extractor/extractor.py","file_url":"https://github.com/thunlp/GEAR/blob/HEAD/feature_extractor/extractor.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ae4bb4b0bc8a71c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}