{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/similar-submodular-information-measures-based","title":"SIMILAR: Submodular Information Measures Based Active Learning In Realistic Scenarios","arxiv_id":"2107.00717","date":"2021-07-01","proceeding":"NeurIPS 2021 12","authors":["Suraj Kothawade","Nathan Beck","KrishnaTeja Killamsetty","Rishabh Iyer"],"abstract":"Active learning has proven to be useful for minimizing labeling costs by selecting the most informative samples. However, existing active learning methods do not work well in realistic scenarios such as imbalance or rare classes, out-of-distribution data in the unlabeled set, and redundancy. In this work, we propose SIMILAR (Submodular Information Measures based actIve LeARning), a unified active learning framework using recently proposed submodular information measures (SIM) as acquisition functions. We argue that SIMILAR not only works in standard active learning, but also easily extends to the realistic settings considered above and acts as a one-stop solution for active learning that is scalable to large real-world datasets. Empirically, we show that SIMILAR significantly outperforms existing active learning algorithms by as much as ~5% - 18% in the case of rare classes and ~5% - 10% in the case of out-of-distribution data on several image classification tasks like CIFAR-10, MNIST, and ImageNet. SIMILAR is available as a part of the DISTIL toolkit: \"https://github.com/decile-team/distil\".","url_abs":"https://arxiv.org/abs/2107.00717v2","url_pdf":"https://arxiv.org/pdf/2107.00717v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"similar-submodular-information-measures-based","repo_url":"https://github.com/decile-team/distil","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"active-learning","task_name":"Active Learning"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2107.00717","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2107.00717"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/decile-team/distil","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":3},"by_repo_kind":{"official":{"samples":3,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"78ff6678d2342591","entry":"dict_to","repo":"decile-team/distil","repo_kind":"official","path":"distil/active_learning_strategies/batch_bald.py","file_url":"https://github.com/decile-team/distil/blob/HEAD/distil/active_learning_strategies/batch_bald.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"78ff6678d2342591"}},{"code_sha256_prefix":"af56f1b5edfdba7f","entry":"init_centers","repo":"decile-team/distil","repo_kind":"official","path":"distil/active_learning_strategies/badge.py","file_url":"https://github.com/decile-team/distil/blob/HEAD/distil/active_learning_strategies/badge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"af56f1b5edfdba7f"}},{"code_sha256_prefix":"11c8d12a65d8f1aa","entry":"merge","repo":"decile-team/distil","repo_kind":"official","path":"distil/active_learning_strategies/score_streaming_strategy.py","file_url":"https://github.com/decile-team/distil/blob/HEAD/distil/active_learning_strategies/score_streaming_strategy.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"11c8d12a65d8f1aa"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}