{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/robustness-verification-for-transformers-1","title":"Robustness Verification for Transformers","arxiv_id":"2002.06622","date":"2020-02-16","proceeding":"ICLR 2020 1","authors":["Zhouxing Shi","huan zhang","Kai-Wei Chang","Minlie Huang","Cho-Jui Hsieh"],"abstract":"Robustness verification that aims to formally certify the prediction behavior of neural networks has become an important tool for understanding model behavior and obtaining safety guarantees. However, previous methods can usually only handle neural networks with relatively simple architectures. In this paper, we consider the robustness verification problem for Transformers. Transformers have complex self-attention layers that pose many challenges for verification, including cross-nonlinearity and cross-position dependency, which have not been discussed in previous works. We resolve these challenges and develop the first robustness verification algorithm for Transformers. The certified robustness bounds computed by our method are significantly tighter than those by naive Interval Bound Propagation. These bounds also shed light on interpreting Transformers as they consistently reflect the importance of different words in sentiment analysis.","url_abs":"https://arxiv.org/abs/2002.06622v2","url_pdf":"https://arxiv.org/pdf/2002.06622v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"robustness-verification-for-transformers-1","repo_url":"https://github.com/shizhouxing/Robustness-Verification-for-Transformers","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":null,"task_name":"Position"},{"task_slug":"sentiment-analysis","task_name":"Sentiment Analysis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2002.06622","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2002.06622"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/shizhouxing/Robustness-Verification-for-Transformers","reach":null}],"summary":{"ran":1,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"official":{"samples":5,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"085fdf07ea1108cf","entry":"Bounds","repo":"shizhouxing/Robustness-Verification-for-Transformers","repo_kind":"official","path":"Verifiers/VerifierForward.py","file_url":"https://github.com/shizhouxing/Robustness-Verification-for-Transformers/blob/HEAD/Verifiers/VerifierForward.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"085fdf07ea1108cf"}},{"code_sha256_prefix":"c8c7e6fb64c1eaca","entry":"sample","repo":"shizhouxing/Robustness-Verification-for-Transformers","repo_kind":"official","path":"Verifiers/VerifierForward.py","file_url":"https://github.com/shizhouxing/Robustness-Verification-for-Transformers/blob/HEAD/Verifiers/VerifierForward.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"c8c7e6fb64c1eaca"}},{"code_sha256_prefix":"b2e80c3b21f69c24","entry":"Verifier","repo":"shizhouxing/Robustness-Verification-for-Transformers","repo_kind":"official","path":"Verifiers/VerifierForward.py","file_url":"https://github.com/shizhouxing/Robustness-Verification-for-Transformers/blob/HEAD/Verifiers/VerifierForward.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"b2e80c3b21f69c24"}},{"code_sha256_prefix":"be1c973d0a4f3a46","entry":"VerifierForward","repo":"shizhouxing/Robustness-Verification-for-Transformers","repo_kind":"official","path":"Verifiers/VerifierForward.py","file_url":"https://github.com/shizhouxing/Robustness-Verification-for-Transformers/blob/HEAD/Verifiers/VerifierForward.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"be1c973d0a4f3a46"}},{"code_sha256_prefix":"6a76b134a3b9b730","entry":"check","repo":"shizhouxing/Robustness-Verification-for-Transformers","repo_kind":"official","path":"Verifiers/VerifierForward.py","file_url":"https://github.com/shizhouxing/Robustness-Verification-for-Transformers/blob/HEAD/Verifiers/VerifierForward.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"6a76b134a3b9b730"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}