{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/model-agnostic-sample-reweighting-for-out-of","title":"Model Agnostic Sample Reweighting for Out-of-Distribution Learning","arxiv_id":"2301.09819","date":"2023-01-24","proceeding":null,"authors":["Xiao Zhou","Yong Lin","Renjie Pi","Weizhong Zhang","Renzhe Xu","Peng Cui","Tong Zhang"],"abstract":"Distributionally robust optimization (DRO) and invariant risk minimization (IRM) are two popular methods proposed to improve out-of-distribution (OOD) generalization performance of machine learning models. While effective for small models, it has been observed that these methods can be vulnerable to overfitting with large overparameterized models. This work proposes a principled method, \\textbf{M}odel \\textbf{A}gnostic sam\\textbf{PL}e r\\textbf{E}weighting (\\textbf{MAPLE}), to effectively address OOD problem, especially in overparameterized scenarios. Our key idea is to find an effective reweighting of the training samples so that the standard empirical risk minimization training of a large model on the weighted training data leads to superior OOD generalization performance. The overfitting issue is addressed by considering a bilevel formulation to search for the sample reweighting, in which the generalization complexity depends on the search space of sample weights instead of the model size. We present theoretical analysis in linear case to prove the insensitivity of MAPLE to model size, and empirically verify its superiority in surpassing state-of-the-art methods by a large margin. Code is available at \\url{https://github.com/x-zho14/MAPLE}.","url_abs":"https://arxiv.org/abs/2301.09819v1","url_pdf":"https://arxiv.org/pdf/2301.09819v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"model-agnostic-sample-reweighting-for-out-of","repo_url":"https://github.com/x-zho14/maple","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2301.09819","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2301.09819"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/x-zho14/maple","reach":null}],"summary":{"ran":1,"unverified":1},"by_repo_kind":{"official":{"samples":2,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"f34ed02e4e4a0035","entry":"get_grad_weights_on_full_train","repo":"x-zho14/maple","repo_kind":"official","path":"cnn_mnist_probability_1step_irm.py","file_url":"https://github.com/x-zho14/maple/blob/HEAD/cnn_mnist_probability_1step_irm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f34ed02e4e4a0035"}},{"code_sha256_prefix":"06ba0639f917e369","entry":"train_to_converge","repo":"x-zho14/maple","repo_kind":"official","path":"cnn_mnist_probability_1step_irm.py","file_url":"https://github.com/x-zho14/maple/blob/HEAD/cnn_mnist_probability_1step_irm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"06ba0639f917e369"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}