{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-framework-and-benchmark-for-deep-batch","title":"A Framework and Benchmark for Deep Batch Active Learning for Regression","arxiv_id":"2203.09410","date":"2022-03-17","proceeding":null,"authors":["David Holzmüller","Viktor Zaverkin","Johannes Kästner","Ingo Steinwart"],"abstract":"The acquisition of labels for supervised learning can be expensive. To improve the sample efficiency of neural network regression, we study active learning methods that adaptively select batches of unlabeled data for labeling. We present a framework for constructing such methods out of (network-dependent) base kernels, kernel transformations, and selection methods. Our framework encompasses many existing Bayesian methods based on Gaussian process approximations of neural networks as well as non-Bayesian methods. Additionally, we propose to replace the commonly used last-layer features with sketched finite-width neural tangent kernels and to combine them with a novel clustering method. To evaluate different methods, we introduce an open-source benchmark consisting of 15 large tabular regression data sets. Our proposed method outperforms the state-of-the-art on our benchmark, scales to large data sets, and works out-of-the-box without adjusting the network architecture or training code. We provide open-source code that includes efficient implementations of all kernels, kernel transformations, and selection methods, and can be used for reproducing our results.","url_abs":"https://arxiv.org/abs/2203.09410v4","url_pdf":"https://arxiv.org/pdf/2203.09410v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-framework-and-benchmark-for-deep-batch","repo_url":"https://github.com/dholzmueller/bmdal_reg","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"a-framework-and-benchmark-for-deep-batch","repo_url":"https://github.com/blackhc/2302.08981","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"active-learning","task_name":"Active Learning"},{"task_slug":"regression-1","task_name":"regression"},{"task_slug":"tabular-regression","task_name":"tabular-regression"}],"methods":[{"method_slug":"base","method_name":"BASE"},{"method_slug":"gaussian-process","method_name":"Gaussian Process"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2203.09410","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.09410"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/blackhc/2302.08981","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dholzmueller/bmdal_reg","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":8},"by_repo_kind":{"official":{"samples":8,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2e17be58345bd466","entry":"adapt_config","repo":"dholzmueller/bmdal_reg","repo_kind":"official","path":"bmdal_reg/utils.py","file_url":"https://github.com/dholzmueller/bmdal_reg/blob/HEAD/bmdal_reg/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2e17be58345bd466"}},{"code_sha256_prefix":"95eea7da879628d6","entry":"batch_randperm","repo":"dholzmueller/bmdal_reg","repo_kind":"official","path":"bmdal_reg/data.py","file_url":"https://github.com/dholzmueller/bmdal_reg/blob/HEAD/bmdal_reg/data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"95eea7da879628d6"}},{"code_sha256_prefix":"03a15704a71a77e1","entry":"existsDir","repo":"dholzmueller/bmdal_reg","repo_kind":"official","path":"bmdal_reg/utils.py","file_url":"https://github.com/dholzmueller/bmdal_reg/blob/HEAD/bmdal_reg/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"03a15704a71a77e1"}},{"code_sha256_prefix":"b8bcbb07e5765b1f","entry":"get_act_layer","repo":"dholzmueller/bmdal_reg","repo_kind":"official","path":"bmdal_reg/layers.py","file_url":"https://github.com/dholzmueller/bmdal_reg/blob/HEAD/bmdal_reg/layers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b8bcbb07e5765b1f"}},{"code_sha256_prefix":"85a8460e7bdd92dc","entry":"get_devices","repo":"dholzmueller/bmdal_reg","repo_kind":"official","path":"bmdal_reg/task_execution.py","file_url":"https://github.com/dholzmueller/bmdal_reg/blob/HEAD/bmdal_reg/task_execution.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"85a8460e7bdd92dc"}},{"code_sha256_prefix":"8d08e6cb25102f66","entry":"measure_fixed_rams_gb","repo":"dholzmueller/bmdal_reg","repo_kind":"official","path":"bmdal_reg/task_execution.py","file_url":"https://github.com/dholzmueller/bmdal_reg/blob/HEAD/bmdal_reg/task_execution.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8d08e6cb25102f66"}},{"code_sha256_prefix":"7e6e2aa6dabd6a9b","entry":"seeded_randperm","repo":"dholzmueller/bmdal_reg","repo_kind":"official","path":"bmdal_reg/data.py","file_url":"https://github.com/dholzmueller/bmdal_reg/blob/HEAD/bmdal_reg/data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7e6e2aa6dabd6a9b"}},{"code_sha256_prefix":"5c9ba5ab385c9169","entry":"select_from_config","repo":"dholzmueller/bmdal_reg","repo_kind":"official","path":"bmdal_reg/utils.py","file_url":"https://github.com/dholzmueller/bmdal_reg/blob/HEAD/bmdal_reg/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5c9ba5ab385c9169"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}