{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mesa-boost-ensemble-imbalanced-learning-with","title":"MESA: Boost Ensemble Imbalanced Learning with MEta-SAmpler","arxiv_id":"2010.08830","date":"2020-10-17","proceeding":"NeurIPS 2020 12","authors":["Zhining Liu","Pengfei Wei","Jing Jiang","Wei Cao","Jiang Bian","Yi Chang"],"abstract":"Imbalanced learning (IL), i.e., learning unbiased models from class-imbalanced data, is a challenging problem. Typical IL methods including resampling and reweighting were designed based on some heuristic assumptions. They often suffer from unstable performance, poor applicability, and high computational cost in complex tasks where their assumptions do not hold. In this paper, we introduce a novel ensemble IL framework named MESA. It adaptively resamples the training set in iterations to get multiple classifiers and forms a cascade ensemble model. MESA directly learns the sampling strategy from data to optimize the final metric beyond following random heuristics. Moreover, unlike prevailing meta-learning-based IL solutions, we decouple the model-training and meta-training in MESA by independently train the meta-sampler over task-agnostic meta-data. This makes MESA generally applicable to most of the existing learning models and the meta-sampler can be efficiently applied to new tasks. Extensive experiments on both synthetic and real-world tasks demonstrate the effectiveness, robustness, and transferability of MESA. Our code is available at https://github.com/ZhiningLiu1998/mesa.","url_abs":"https://arxiv.org/abs/2010.08830v1","url_pdf":"https://arxiv.org/pdf/2010.08830v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mesa-boost-ensemble-imbalanced-learning-with","repo_url":"https://github.com/ZhiningLiu1998/mesa","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"mesa-boost-ensemble-imbalanced-learning-with","repo_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"meta-learning","task_name":"Meta-Learning"},{"task_slug":"imbalanced-classification","task_name":"imbalanced classification"}],"methods":[{"method_slug":"sac","method_name":"SAC"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2010.08830","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.08830"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/ZhiningLiu1998/mesa","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa","reach":null}],"summary":{"ran":8,"ran_honours":1,"ran_fixture":2,"ran_draft_wrong":2,"ran_violates":1,"unverified":4},"by_repo_kind":{"official":{"samples":3,"ran":2,"repositories":1},"listed":{"samples":15,"ran":12,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"56013393aeafd8da","entry":"DeterministicPolicy","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"56013393aeafd8da"}},{"code_sha256_prefix":"c1ebf5a998d2091f","entry":"Ensemble","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c1ebf5a998d2091f"}},{"code_sha256_prefix":"3393f1e0da810f3f","entry":"GaussianPolicy","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3393f1e0da810f3f"}},{"code_sha256_prefix":"ff10fc4473be092a","entry":"QNetwork","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff10fc4473be092a"}},{"code_sha256_prefix":"da0436c9be63db03","entry":"Rater","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da0436c9be63db03"}},{"code_sha256_prefix":"c4cf549ba24993c4","entry":"ReplayMemory","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4cf549ba24993c4"}},{"code_sha256_prefix":"2526cfd8d5bf5d06","entry":"create_log_gaussian","repo":"ZhiningLiu1998/mesa","repo_kind":"official","path":"sac_src/utils.py","file_url":"https://github.com/ZhiningLiu1998/mesa/blob/HEAD/sac_src/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2526cfd8d5bf5d06"}},{"code_sha256_prefix":"636cc3cc12cdfb01","entry":"gaussian_prob","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"636cc3cc12cdfb01"}},{"code_sha256_prefix":"c17d6156cdefefee","entry":"histogram_error_distribution","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c17d6156cdefefee"}},{"code_sha256_prefix":"4e4775be095c5d65","entry":"imbalance_train_test_split","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e4775be095c5d65"}},{"code_sha256_prefix":"09556d56c8b73050","entry":"logsumexp","repo":"ZhiningLiu1998/mesa","repo_kind":"official","path":"sac_src/utils.py","file_url":"https://github.com/ZhiningLiu1998/mesa/blob/HEAD/sac_src/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09556d56c8b73050"}},{"code_sha256_prefix":"4258a828fc4e901c","entry":"memory_init_fulfill","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4258a828fc4e901c"}},{"code_sha256_prefix":"8b9d66c120aa4db4","entry":"meta_sampling","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8b9d66c120aa4db4"}},{"code_sha256_prefix":"52edf1fa0ae5a2aa","entry":"state_scale","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"52edf1fa0ae5a2aa"}},{"code_sha256_prefix":"a1cae9d58f3c469f","entry":"EnsembleTrainingEnv","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a1cae9d58f3c469f"}},{"code_sha256_prefix":"312c199e2cf3845b","entry":"Mesa","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"312c199e2cf3845b"}},{"code_sha256_prefix":"2eade89a5f8f0440","entry":"SAC","repo":"NeurIPS2020AnonymousSubmission/mesa","repo_kind":"listed","path":"mesa.py","file_url":"https://github.com/NeurIPS2020AnonymousSubmission/mesa/blob/HEAD/mesa.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2eade89a5f8f0440"}},{"code_sha256_prefix":"13155842a3eda501","entry":"load_dataset","repo":"ZhiningLiu1998/mesa","repo_kind":"official","path":"utils.py","file_url":"https://github.com/ZhiningLiu1998/mesa/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"13155842a3eda501"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}