{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-13109","title":"BoSS: A Best-of-Strategies Selector as an Oracle for Deep Active Learning","arxiv_id":"2603.13109","date":"2026-03-13","proceeding":null,"authors":["Denis Huseljic","Paul Hahn","Marek Herde","Christoph Sandrock","Bernhard Sick"],"abstract":"Active learning (AL) aims to reduce annotation costs while maximizing model performance by iteratively selecting valuable instances. While foundation models have made it easier to identify these instances, existing selection strategies still lack robustness across different models, annotation budgets, and datasets. To highlight the potential weaknesses of existing AL strategies and provide a reference point for research, we explore oracle strategies, i.e., strategies that approximate the optimal selection by accessing ground-truth information unavailable in practical AL scenarios. Current oracle strategies, however, fail to scale effectively to large datasets and complex deep neural networks. To tackle these limitations, we introduce the Best-of-Strategy Selector (BoSS), a scalable oracle strategy designed for large-scale AL scenarios. BoSS constructs a set of candidate batches through an ensemble of selection strategies and then selects the batch yielding the highest performance gain. As an ensemble of selection strategies, BoSS can be easily extended with new state-of-the-art strategies as they emerge, ensuring it remains a reliable oracle strategy in the future. Our evaluation demonstrates that i) BoSS outperforms existing oracle strategies, ii) state-of-the-art AL strategies still fall noticeably short of oracle performance, especially in large-scale datasets with many classes, and iii) one possible solution to counteract the inconsistent performance of AL strategies might be to employ an ensemble-based approach for the selection.","url_abs":"https://arxiv.org/abs/2603.13109","url_pdf":"https://arxiv.org/pdf/2603.13109","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.13109","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.13109"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/dhuseljic/dal-toolbox","reach":null}],"summary":{"unverified":8},"by_repo_kind":{"found_in_text":{"samples":8,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"353b9cd8fa98a04b","entry":"first_order_update","repo":"dhuseljic/dal-toolbox","repo_kind":"found_in_text","path":"dal_toolbox/models/laplace.py","file_url":"https://github.com/dhuseljic/dal-toolbox/blob/HEAD/dal_toolbox/models/laplace.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"353b9cd8fa98a04b"}},{"code_sha256_prefix":"e090a7f151829158","entry":"kfac_update","repo":"dhuseljic/dal-toolbox","repo_kind":"found_in_text","path":"dal_toolbox/models/laplace.py","file_url":"https://github.com/dhuseljic/dal-toolbox/blob/HEAD/dal_toolbox/models/laplace.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"e090a7f151829158"}},{"code_sha256_prefix":"9cfc7b9b3cafe7b9","entry":"list_diff","repo":"dhuseljic/dal-toolbox","repo_kind":"found_in_text","path":"dal_toolbox/active_learning/data.py","file_url":"https://github.com/dhuseljic/dal-toolbox/blob/HEAD/dal_toolbox/active_learning/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"9cfc7b9b3cafe7b9"}},{"code_sha256_prefix":"e0cfb0149d7ca788","entry":"list_union","repo":"dhuseljic/dal-toolbox","repo_kind":"found_in_text","path":"dal_toolbox/active_learning/data.py","file_url":"https://github.com/dhuseljic/dal-toolbox/blob/HEAD/dal_toolbox/active_learning/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"e0cfb0149d7ca788"}},{"code_sha256_prefix":"d5986b80c712704e","entry":"plot_grids","repo":"dhuseljic/dal-toolbox","repo_kind":"found_in_text","path":"dal_toolbox/utils.py","file_url":"https://github.com/dhuseljic/dal-toolbox/blob/HEAD/dal_toolbox/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d5986b80c712704e"}},{"code_sha256_prefix":"f0a30d632ccbe1b4","entry":"second_order_update","repo":"dhuseljic/dal-toolbox","repo_kind":"found_in_text","path":"dal_toolbox/models/laplace.py","file_url":"https://github.com/dhuseljic/dal-toolbox/blob/HEAD/dal_toolbox/models/laplace.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"f0a30d632ccbe1b4"}},{"code_sha256_prefix":"19fea5af109d9bbd","entry":"setup_rng","repo":"dhuseljic/dal-toolbox","repo_kind":"found_in_text","path":"dal_toolbox/utils.py","file_url":"https://github.com/dhuseljic/dal-toolbox/blob/HEAD/dal_toolbox/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"19fea5af109d9bbd"}},{"code_sha256_prefix":"32740d526d3118a3","entry":"unnormalize","repo":"dhuseljic/dal-toolbox","repo_kind":"found_in_text","path":"dal_toolbox/utils.py","file_url":"https://github.com/dhuseljic/dal-toolbox/blob/HEAD/dal_toolbox/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"32740d526d3118a3"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}