{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/generative-active-learning-for-long-tailed","title":"Generative Active Learning for Long-tailed Instance Segmentation","arxiv_id":"2406.02435","date":"2024-06-04","proceeding":null,"authors":["Muzhi Zhu","Chengxiang Fan","Hao Chen","Yang Liu","Weian Mao","Xiaogang Xu","Chunhua Shen"],"abstract":"Recently, large-scale language-image generative models have gained widespread attention and many works have utilized generated data from these models to further enhance the performance of perception tasks. However, not all generated data can positively impact downstream models, and these methods do not thoroughly explore how to better select and utilize generated data. On the other hand, there is still a lack of research oriented towards active learning on generated data. In this paper, we explore how to perform active learning specifically for generated data in the long-tailed instance segmentation task. Subsequently, we propose BSGAL, a new algorithm that online estimates the contribution of the generated data based on gradient cache. BSGAL can handle unlimited generated data and complex downstream segmentation tasks effectively. Experiments show that BSGAL outperforms the baseline approach and effectually improves the performance of long-tailed segmentation. Our code can be found at https://github.com/aim-uofa/DiverGen.","url_abs":"https://arxiv.org/abs/2406.02435v1","url_pdf":"https://arxiv.org/pdf/2406.02435v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"generative-active-learning-for-long-tailed","repo_url":"https://github.com/aim-uofa/DiverGen","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-2-Clause"}}],"tasks":[{"task_slug":"active-learning","task_name":"Active Learning"},{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.02435","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.02435"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/aim-uofa/DiverGen","reach":{"status":"ok","spdx":"BSD-2-Clause"}}],"summary":{"ran":5,"ran_fixture":1,"ran_violates":1,"unverified":2},"by_repo_kind":{"official":{"samples":9,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"00ab34f79a0e8521","entry":"filter_none","repo":"aim-uofa/DiverGen","repo_kind":"official","path":"DiverGen/filteration/clean_pool_if.py","file_url":"https://github.com/aim-uofa/DiverGen/blob/HEAD/DiverGen/filteration/clean_pool_if.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"00ab34f79a0e8521"}},{"code_sha256_prefix":"8218770271c01c2c","entry":"get_clip_embeddings","repo":"aim-uofa/divergen","repo_kind":"official","path":"BSGAL/bsgal/predictor.py","file_url":"https://github.com/aim-uofa/divergen/blob/HEAD/BSGAL/bsgal/predictor.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"DEP_MISSING","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"8218770271c01c2c"}},{"code_sha256_prefix":"d2784f2d81aab615","entry":"get_clip_embeddings","repo":"aim-uofa/DiverGen","repo_kind":"official","path":"DiverGen/divergen/predictor.py","file_url":"https://github.com/aim-uofa/DiverGen/blob/HEAD/DiverGen/divergen/predictor.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d2784f2d81aab615"}},{"code_sha256_prefix":"bb583e07209fe58b","entry":"get_fed_loss_inds","repo":"aim-uofa/DiverGen","repo_kind":"official","path":"DiverGen/divergen/modeling/utils.py","file_url":"https://github.com/aim-uofa/DiverGen/blob/HEAD/DiverGen/divergen/modeling/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"bb583e07209fe58b"}},{"code_sha256_prefix":"3d29f42a6e854903","entry":"get_largest_connect_component","repo":"aim-uofa/DiverGen","repo_kind":"official","path":"DiverGen/filteration/clean_pool_if.py","file_url":"https://github.com/aim-uofa/DiverGen/blob/HEAD/DiverGen/filteration/clean_pool_if.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"3d29f42a6e854903"}},{"code_sha256_prefix":"1f6e4c3da7b82979","entry":"load_class_freq","repo":"aim-uofa/DiverGen","repo_kind":"official","path":"DiverGen/divergen/modeling/utils.py","file_url":"https://github.com/aim-uofa/DiverGen/blob/HEAD/DiverGen/divergen/modeling/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"1f6e4c3da7b82979"}},{"code_sha256_prefix":"c15434906f804d7f","entry":"match_name_keywords","repo":"aim-uofa/DiverGen","repo_kind":"official","path":"DiverGen/divergen/custom_solver.py","file_url":"https://github.com/aim-uofa/DiverGen/blob/HEAD/DiverGen/divergen/custom_solver.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"c15434906f804d7f"}},{"code_sha256_prefix":"313bd22b056120f7","entry":"init_distributed","repo":"aim-uofa/DiverGen","repo_kind":"official","path":"DiverGen/filteration/get_clip_score.py","file_url":"https://github.com/aim-uofa/DiverGen/blob/HEAD/DiverGen/filteration/get_clip_score.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"313bd22b056120f7"}},{"code_sha256_prefix":"6c76a9bfda987c86","entry":"init_distributed","repo":"aim-uofa/DiverGen","repo_kind":"official","path":"DiverGen/filteration/clean_pool_if.py","file_url":"https://github.com/aim-uofa/DiverGen/blob/HEAD/DiverGen/filteration/clean_pool_if.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"6c76a9bfda987c86"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}