{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dataset-distillation-via-committee-voting","title":"Dataset Distillation via Committee Voting","arxiv_id":"2501.07575","date":"2025-01-13","proceeding":null,"authors":["Jiacheng Cui","Zhaoyi Li","Xiaochen Ma","Xinyue Bi","Yaxin Luo","Zhiqiang Shen"],"abstract":"Dataset distillation aims to synthesize a smaller, representative dataset that preserves the essential properties of the original data, enabling efficient model training with reduced computational resources. Prior work has primarily focused on improving the alignment or matching process between original and synthetic data, or on enhancing the efficiency of distilling large datasets. In this work, we introduce ${\\bf C}$ommittee ${\\bf V}$oting for ${\\bf D}$ataset ${\\bf D}$istillation (CV-DD), a novel and orthogonal approach that leverages the collective wisdom of multiple models or experts to create high-quality distilled datasets. We start by showing how to establish a strong baseline that already achieves state-of-the-art accuracy through leveraging recent advancements and thoughtful adjustments in model design and optimization processes. By integrating distributions and predictions from a committee of models while generating high-quality soft labels, our method captures a wider spectrum of data features, reduces model-specific biases and the adverse effects of distribution shifts, leading to significant improvements in generalization. This voting-based strategy not only promotes diversity and robustness within the distilled dataset but also significantly reduces overfitting, resulting in improved performance on post-eval tasks. Extensive experiments across various datasets and IPCs (images per class) demonstrate that Committee Voting leads to more reliable and adaptable distilled data compared to single/multi-model distillation methods, demonstrating its potential for efficient and accurate dataset distillation. Code is available at: https://github.com/Jiacheng8/CV-DD.","url_abs":"https://arxiv.org/abs/2501.07575v1","url_pdf":"https://arxiv.org/pdf/2501.07575v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dataset-distillation-via-committee-voting","repo_url":"https://github.com/jiacheng8/cv-dd","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"dataset-distillation","task_name":"Dataset Distillation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2501.07575","atlas_url":"https://app.syntology.ai/?focus=2501.07575","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2501.07575"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jiacheng8/cv-dd","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":14,"ran_draft_wrong":2,"unverified":3},"by_repo_kind":{"official":{"samples":19,"ran":16,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3da7ee44118b27ad","entry":"DenseNet121","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"models/densenet.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/models/densenet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3da7ee44118b27ad"}},{"code_sha256_prefix":"339dfa096b3c4a02","entry":"DenseNet169","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"models/densenet.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/models/densenet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"339dfa096b3c4a02"}},{"code_sha256_prefix":"e28ebe17022741b6","entry":"DenseNet201","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"models/densenet.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/models/densenet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e28ebe17022741b6"}},{"code_sha256_prefix":"c2749ad43673e986","entry":"ResNet18","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c2749ad43673e986"}},{"code_sha256_prefix":"f9e75567dfd01367","entry":"ResNet34","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f9e75567dfd01367"}},{"code_sha256_prefix":"71310b3a95d5c6eb","entry":"ResNet50","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"71310b3a95d5c6eb"}},{"code_sha256_prefix":"b07a34e357aed3db","entry":"cutmix","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"relabel/utils_fkd.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/relabel/utils_fkd.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b07a34e357aed3db"}},{"code_sha256_prefix":"b97000ad1f1f7bba","entry":"format_int_to_str","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"recover/utils_recover.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/recover/utils_recover.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b97000ad1f1f7bba"}},{"code_sha256_prefix":"370445b84099fd37","entry":"get_FKD_info","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"relabel/utils_fkd.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/relabel/utils_fkd.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"370445b84099fd37"}},{"code_sha256_prefix":"a5eb548b0300cae0","entry":"get_all_models","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"squeeze/utils_squeeze.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/squeeze/utils_squeeze.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5eb548b0300cae0"}},{"code_sha256_prefix":"25dda4be04d5c390","entry":"get_second_idx","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"recover/utils_recover.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/recover/utils_recover.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"25dda4be04d5c390"}},{"code_sha256_prefix":"bb8fad7d1a279f7e","entry":"load_dataset","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"squeeze/utils_squeeze.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/squeeze/utils_squeeze.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bb8fad7d1a279f7e"}},{"code_sha256_prefix":"c0c32e1872910304","entry":"load_model","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"squeeze/squeeze_imagenet1k_prior.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/squeeze/squeeze_imagenet1k_prior.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c0c32e1872910304"}},{"code_sha256_prefix":"8c08fe6238212dd8","entry":"load_model","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"squeeze/squeeze_imagenette.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/squeeze/squeeze_imagenette.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c08fe6238212dd8"}},{"code_sha256_prefix":"38fd828e9ae4636a","entry":"lr_policy","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"recover/utils_recover.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/recover/utils_recover.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"38fd828e9ae4636a"}},{"code_sha256_prefix":"0756a99508caf42c","entry":"rand_bbox","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"relabel/utils_fkd.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/relabel/utils_fkd.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0756a99508caf42c"}},{"code_sha256_prefix":"ff01d3802d4ba4b2","entry":"train","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"squeeze/squeeze_imagenet1k_prior.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/squeeze/squeeze_imagenet1k_prior.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff01d3802d4ba4b2"}},{"code_sha256_prefix":"230fb2e9963063c9","entry":"validate","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"recover/recover.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/recover/recover.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"230fb2e9963063c9"}},{"code_sha256_prefix":"af9e030f554c4938","entry":"validate","repo":"jiacheng8/cv-dd","repo_kind":"official","path":"squeeze/squeeze_imagenet1k_prior.py","file_url":"https://github.com/jiacheng8/cv-dd/blob/HEAD/squeeze/squeeze_imagenet1k_prior.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"af9e030f554c4938"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}