{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/batch-active-learning-at-scale","title":"Batch Active Learning at Scale","arxiv_id":"2107.14263","date":"2021-07-29","proceeding":"NeurIPS 2021 12","authors":["Gui Citovsky","Giulia Desalvo","Claudio Gentile","Lazaros Karydas","Anand Rajagopalan","Afshin Rostamizadeh","Sanjiv Kumar"],"abstract":"The ability to train complex and highly effective models often requires an abundance of training data, which can easily become a bottleneck in cost, time, and computational resources. Batch active learning, which adaptively issues batched queries to a labeling oracle, is a common approach for addressing this problem. The practical benefits of batch sampling come with the downside of less adaptivity and the risk of sampling redundant examples within a batch -- a risk that grows with the batch size. In this work, we analyze an efficient active learning algorithm, which focuses on the large batch setting. In particular, we show that our sampling method, which combines notions of uncertainty and diversity, easily scales to batch sizes (100K-1M) several orders of magnitude larger than used in previous studies and provides significant improvements in model training efficiency compared to recent baselines. Finally, we provide an initial theoretical analysis, proving label complexity guarantees for a related sampling method, which we show is approximately equivalent to our sampling method in specific settings.","url_abs":"https://arxiv.org/abs/2107.14263v1","url_pdf":"https://arxiv.org/pdf/2107.14263v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"batch-active-learning-at-scale","repo_url":"https://github.com/airi-institute/al_toolbox","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"active-learning","task_name":"Active Learning"},{"task_slug":"diversity","task_name":"Diversity"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2107.14263","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2107.14263"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/airi-institute/al_toolbox","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":8},"by_repo_kind":{"listed":{"samples":8,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2cc02afb97254ce3","entry":"calculate_grad","repo":"airi-institute/al_toolbox","repo_kind":"listed","path":"acleto/post_processing/calculate_tracin_score.py","file_url":"https://github.com/airi-institute/al_toolbox/blob/HEAD/acleto/post_processing/calculate_tracin_score.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2cc02afb97254ce3"}},{"code_sha256_prefix":"576acc9de24783fe","entry":"calculate_grad_flair","repo":"airi-institute/al_toolbox","repo_kind":"listed","path":"acleto/post_processing/calculate_tracin_score.py","file_url":"https://github.com/airi-institute/al_toolbox/blob/HEAD/acleto/post_processing/calculate_tracin_score.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"576acc9de24783fe"}},{"code_sha256_prefix":"fd43f053d6bc8e97","entry":"convert_y_to_dict_format","repo":"airi-institute/al_toolbox","repo_kind":"listed","path":"jupyterlab_demo/utils_data.py","file_url":"https://github.com/airi-institute/al_toolbox/blob/HEAD/jupyterlab_demo/utils_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fd43f053d6bc8e97"}},{"code_sha256_prefix":"7084c56588c1e6af","entry":"create_custom_path","repo":"airi-institute/al_toolbox","repo_kind":"listed","path":"jupyterlab_demo/demo_system.py","file_url":"https://github.com/airi-institute/al_toolbox/blob/HEAD/jupyterlab_demo/demo_system.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7084c56588c1e6af"}},{"code_sha256_prefix":"316cb1f89e1cee44","entry":"create_helper","repo":"airi-institute/al_toolbox","repo_kind":"listed","path":"jupyterlab_demo/utils_data.py","file_url":"https://github.com/airi-institute/al_toolbox/blob/HEAD/jupyterlab_demo/utils_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"316cb1f89e1cee44"}},{"code_sha256_prefix":"3117d3ae4991e45d","entry":"format_entities","repo":"airi-institute/al_toolbox","repo_kind":"listed","path":"jupyterlab_demo/utils_data.py","file_url":"https://github.com/airi-institute/al_toolbox/blob/HEAD/jupyterlab_demo/utils_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3117d3ae4991e45d"}},{"code_sha256_prefix":"e95ff7d47060fbd2","entry":"instance_to_sentence","repo":"airi-institute/al_toolbox","repo_kind":"listed","path":"domain_adaptation/hf_dataset_to_sent.py","file_url":"https://github.com/airi-institute/al_toolbox/blob/HEAD/domain_adaptation/hf_dataset_to_sent.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e95ff7d47060fbd2"}},{"code_sha256_prefix":"e17c116467304c37","entry":"point_to_device","repo":"airi-institute/al_toolbox","repo_kind":"listed","path":"acleto/post_processing/calculate_tracin_score.py","file_url":"https://github.com/airi-institute/al_toolbox/blob/HEAD/acleto/post_processing/calculate_tracin_score.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e17c116467304c37"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}