{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/crossaug-a-contrastive-data-augmentation","title":"CrossAug: A Contrastive Data Augmentation Method for Debiasing Fact Verification Models","arxiv_id":"2109.15107","date":"2021-09-30","proceeding":null,"authors":["Minwoo Lee","Seungpil Won","Juae Kim","Hwanhee Lee","Cheoneum Park","Kyomin Jung"],"abstract":"Fact verification datasets are typically constructed using crowdsourcing techniques due to the lack of text sources with veracity labels. However, the crowdsourcing process often produces undesired biases in data that cause models to learn spurious patterns. In this paper, we propose CrossAug, a contrastive data augmentation method for debiasing fact verification models. Specifically, we employ a two-stage augmentation pipeline to generate new claims and evidences from existing samples. The generated samples are then paired cross-wise with the original pair, forming contrastive samples that facilitate the model to rely less on spurious patterns and learn more robust representations. Experimental results show that our method outperforms the previous state-of-the-art debiasing technique by 3.6% on the debiased extension of the FEVER dataset, with a total performance boost of 10.13% from the baseline. Furthermore, we evaluate our approach in data-scarce settings, where models can be more susceptible to biases due to the lack of training data. Experimental results demonstrate that our approach is also effective at debiasing in these low-resource conditions, exceeding the baseline performance on the Symmetric dataset with just 1% of the original data.","url_abs":"https://arxiv.org/abs/2109.15107v1","url_pdf":"https://arxiv.org/pdf/2109.15107v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"crossaug-a-contrastive-data-augmentation","repo_url":"https://github.com/minwhoo/crossaug","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"fact-verification","task_name":"Fact Verification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2109.15107","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.15107"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/minwhoo/crossaug","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":2,"ran_fixture":1,"ran_honours":1,"unverified":5},"by_repo_kind":{"official":{"samples":9,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0f786c407fb1ee4c","entry":"swish","repo":"minwhoo/crossaug","repo_kind":"official","path":"modeling_bert.py","file_url":"https://github.com/minwhoo/crossaug/blob/HEAD/modeling_bert.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":2,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f786c407fb1ee4c"}},{"code_sha256_prefix":"cac113ca87b9d9f3","entry":"acc_and_f1","repo":"minwhoo/crossaug","repo_kind":"official","path":"utils_fever.py","file_url":"https://github.com/minwhoo/crossaug/blob/HEAD/utils_fever.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cac113ca87b9d9f3"}},{"code_sha256_prefix":"fdc64f4c72036ae4","entry":"gelu","repo":"minwhoo/crossaug","repo_kind":"official","path":"modeling_bert.py","file_url":"https://github.com/minwhoo/crossaug/blob/HEAD/modeling_bert.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fdc64f4c72036ae4"}},{"code_sha256_prefix":"0c145728a35789fa","entry":"load_tf_weights_in_bert","repo":"minwhoo/crossaug","repo_kind":"official","path":"modeling_bert.py","file_url":"https://github.com/minwhoo/crossaug/blob/HEAD/modeling_bert.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0c145728a35789fa"}},{"code_sha256_prefix":"f98c94e02e958cf4","entry":"convert_examples_to_features","repo":"minwhoo/crossaug","repo_kind":"official","path":"utils_fever.py","file_url":"https://github.com/minwhoo/crossaug/blob/HEAD/utils_fever.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f98c94e02e958cf4"}},{"code_sha256_prefix":"21714b9a7592d2fa","entry":"find_substitution_map","repo":"minwhoo/crossaug","repo_kind":"official","path":"run_crossaug.py","file_url":"https://github.com/minwhoo/crossaug/blob/HEAD/run_crossaug.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"21714b9a7592d2fa"}},{"code_sha256_prefix":"c2efdae34b4062fc","entry":"generate_negative_claims","repo":"minwhoo/crossaug","repo_kind":"official","path":"run_crossaug.py","file_url":"https://github.com/minwhoo/crossaug/blob/HEAD/run_crossaug.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c2efdae34b4062fc"}},{"code_sha256_prefix":"3c241ecfe3749a6d","entry":"simple_accuracy","repo":"minwhoo/crossaug","repo_kind":"official","path":"utils_fever.py","file_url":"https://github.com/minwhoo/crossaug/blob/HEAD/utils_fever.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c241ecfe3749a6d"}},{"code_sha256_prefix":"b72a1fc29a343946","entry":"substitute_sent","repo":"minwhoo/crossaug","repo_kind":"official","path":"run_crossaug.py","file_url":"https://github.com/minwhoo/crossaug/blob/HEAD/run_crossaug.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b72a1fc29a343946"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}