{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/agro-adversarial-discovery-of-error-prone","title":"AGRO: Adversarial Discovery of Error-prone groups for Robust Optimization","arxiv_id":"2212.00921","date":"2022-12-02","proceeding":null,"authors":["Bhargavi Paranjape","Pradeep Dasigi","Vivek Srikumar","Luke Zettlemoyer","Hannaneh Hajishirzi"],"abstract":"Models trained via empirical risk minimization (ERM) are known to rely on spurious correlations between labels and task-independent input features, resulting in poor generalization to distributional shifts. Group distributionally robust optimization (G-DRO) can alleviate this problem by minimizing the worst-case loss over a set of pre-defined groups over training data. G-DRO successfully improves performance of the worst-group, where the correlation does not hold. However, G-DRO assumes that the spurious correlations and associated worst groups are known in advance, making it challenging to apply it to new tasks with potentially multiple unknown spurious correlations. We propose AGRO -- Adversarial Group discovery for Distributionally Robust Optimization -- an end-to-end approach that jointly identifies error-prone groups and improves accuracy on them. AGRO equips G-DRO with an adversarial slicing model to find a group assignment for training examples which maximizes worst-case loss over the discovered groups. On the WILDS benchmark, AGRO results in 8% higher model performance on average on known worst-groups, compared to prior group discovery approaches used with G-DRO. AGRO also improves out-of-distribution performance on SST2, QQP, and MS-COCO -- datasets where potential spurious correlations are as yet uncharacterized. Human evaluation of ARGO groups shows that they contain well-defined, yet previously unstudied spurious correlations that lead to model errors.","url_abs":"https://arxiv.org/abs/2212.00921v2","url_pdf":"https://arxiv.org/pdf/2212.00921v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"agro-adversarial-discovery-of-error-prone","repo_url":"https://github.com/bhargaviparanjape/robust-transformers","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"jax","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"qqp","task_name":"QQP"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2212.00921","atlas_url":"https://app.syntology.ai/?focus=2212.00921","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2212.00921"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bhargaviparanjape/robust-transformers","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":3,"unverified":9},"by_repo_kind":{"official":{"samples":12,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":12,"samples":[{"code_sha256_prefix":"a727df5fd2f5599a","entry":"check_number_comma","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/convert_slow_tokenizer.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/convert_slow_tokenizer.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"a727df5fd2f5599a"}},{"code_sha256_prefix":"d770e1dd1d799a47","entry":"ensure_valid_input","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/convert_graph_to_onnx.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/convert_graph_to_onnx.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"d770e1dd1d799a47"}},{"code_sha256_prefix":"7efe3db5c9e2f94d","entry":"generate_identified_filename","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/convert_graph_to_onnx.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/convert_graph_to_onnx.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"7efe3db5c9e2f94d"}},{"code_sha256_prefix":"303c695a12e16704","entry":"convert_slow_tokenizer","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/convert_slow_tokenizer.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/convert_slow_tokenizer.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"303c695a12e16704"}},{"code_sha256_prefix":"e187e5429b112df7","entry":"deepspeed_reinit","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/deepspeed.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/deepspeed.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"e187e5429b112df7"}},{"code_sha256_prefix":"c551a79d5bb1b062","entry":"detect_overflow","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/debug_utils.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/debug_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"c551a79d5bb1b062"}},{"code_sha256_prefix":"37a5eed2dbd663ca","entry":"gelu_fast","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/activations_tf.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/activations_tf.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"37a5eed2dbd663ca"}},{"code_sha256_prefix":"b5db92a796ef38f1","entry":"get_abs_min_max","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/debug_utils.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/debug_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b5db92a796ef38f1"}},{"code_sha256_prefix":"dd3166a87bc972ff","entry":"get_configuration_file","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/configuration_utils.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/configuration_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"dd3166a87bc972ff"}},{"code_sha256_prefix":"3449d7d975edfb89","entry":"infer_shapes","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/convert_graph_to_onnx.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/convert_graph_to_onnx.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"3449d7d975edfb89"}},{"code_sha256_prefix":"cc8c8c3ebf0c343f","entry":"mish","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/activations_tf.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/activations_tf.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"cc8c8c3ebf0c343f"}},{"code_sha256_prefix":"e2d56cb91f999bef","entry":"quick_gelu","repo":"bhargaviparanjape/robust-transformers","repo_kind":"official","path":"src/transformers/activations_tf.py","file_url":"https://github.com/bhargaviparanjape/robust-transformers/blob/HEAD/src/transformers/activations_tf.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"e2d56cb91f999bef"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}