{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/group-robust-sample-reweighting-for","title":"Group-robust Sample Reweighting for Subpopulation Shifts via Influence Functions","arxiv_id":"2503.07315","date":"2025-03-10","proceeding":null,"authors":["Rui Qiao","Zhaoxuan Wu","Jingtan Wang","Pang Wei Koh","Bryan Kian Hsiang Low"],"abstract":"Machine learning models often have uneven performance among subpopulations (a.k.a., groups) in the data distributions. This poses a significant challenge for the models to generalize when the proportions of the groups shift during deployment. To improve robustness to such shifts, existing approaches have developed strategies that train models or perform hyperparameter tuning using the group-labeled data to minimize the worst-case loss over groups. However, a non-trivial amount of high-quality labels is often required to obtain noticeable improvements. Given the costliness of the labels, we propose to adopt a different paradigm to enhance group label efficiency: utilizing the group-labeled data as a target set to optimize the weights of other group-unlabeled data. We introduce Group-robust Sample Reweighting (GSR), a two-stage approach that first learns the representations from group-unlabeled data, and then tinkers the model by iteratively retraining its last layer on the reweighted data using influence functions. Our GSR is theoretically sound, practically lightweight, and effective in improving the robustness to subpopulation shifts. In particular, GSR outperforms the previous state-of-the-art approaches that require the same amount or even more group labels.","url_abs":"https://arxiv.org/abs/2503.07315v1","url_pdf":"https://arxiv.org/pdf/2503.07315v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"group-robust-sample-reweighting-for","repo_url":"https://github.com/qiaoruiyt/gsr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[{"method_slug":"adopt","method_name":"ADOPT"},{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2503.07315","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.07315"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/qiaoruiyt/GSR","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/qiaoruiyt/gsr","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"ran_draft_wrong":2,"unverified":10},"by_repo_kind":{"official":{"samples":14,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"08917fa5845d4743","entry":"StepLR","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"08917fa5845d4743"}},{"code_sha256_prefix":"6f1d4d10d1e5c202","entry":"WeightedObjective","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6f1d4d10d1e5c202"}},{"code_sha256_prefix":"e169611ba2ac5ecc","entry":"evaluate_group_metrics","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e169611ba2ac5ecc"}},{"code_sha256_prefix":"2864831366686f37","entry":"get_scheduler","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2864831366686f37"}},{"code_sha256_prefix":"3fd80b99367c12ea","entry":"BaseInfluenceModule","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3fd80b99367c12ea"}},{"code_sha256_prefix":"2c20ae130b043d1b","entry":"BaseObjective","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2c20ae130b043d1b"}},{"code_sha256_prefix":"f479c3ef9035af3a","entry":"CGInfluenceModule","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f479c3ef9035af3a"}},{"code_sha256_prefix":"fc12323333290500","entry":"FastExactInfluenceModule","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fc12323333290500"}},{"code_sha256_prefix":"9b4e102e69368b30","entry":"FastHFInfluenceModule","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b4e102e69368b30"}},{"code_sha256_prefix":"63ab38b374ee2fc8","entry":"GSRTrainer","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"63ab38b374ee2fc8"}},{"code_sha256_prefix":"8d4b41e721b86e4c","entry":"LiSSAInfluenceModule","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8d4b41e721b86e4c"}},{"code_sha256_prefix":"b1bcc58431353e09","entry":"NoninvInfluenceModule","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b1bcc58431353e09"}},{"code_sha256_prefix":"fe7f4afa378d85ca","entry":"_del_attr","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fe7f4afa378d85ca"}},{"code_sha256_prefix":"60d1488f20a46cd1","entry":"_set_attr","repo":"qiaoruiyt/gsr","repo_kind":"official","path":"gsr.py","file_url":"https://github.com/qiaoruiyt/gsr/blob/HEAD/gsr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"60d1488f20a46cd1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}