{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/d-4-m-dataset-distillation-via-disentangled","title":"D$^4$M: Dataset Distillation via Disentangled Diffusion Model","arxiv_id":"2407.15138","date":"2024-07-21","proceeding":null,"authors":["Duo Su","Junjie Hou","Weizhi Gao","Yingjie Tian","Bowen Tang"],"abstract":"Dataset distillation offers a lightweight synthetic dataset for fast network training with promising test accuracy. To imitate the performance of the original dataset, most approaches employ bi-level optimization and the distillation space relies on the matching architecture. Nevertheless, these approaches either suffer significant computational costs on large-scale datasets or experience performance decline on cross-architectures. We advocate for designing an economical dataset distillation framework that is independent of the matching architectures. With empirical observations, we argue that constraining the consistency of the real and synthetic image spaces will enhance the cross-architecture generalization. Motivated by this, we introduce Dataset Distillation via Disentangled Diffusion Model (D$^4$M), an efficient framework for dataset distillation. Compared to architecture-dependent methods, D$^4$M employs latent diffusion model to guarantee consistency and incorporates label information into category prototypes. The distilled datasets are versatile, eliminating the need for repeated generation of distinct datasets for various architectures. Through comprehensive experiments, D$^4$M demonstrates superior performance and robust generalization, surpassing the SOTA methods across most aspects.","url_abs":"https://arxiv.org/abs/2407.15138v1","url_pdf":"https://arxiv.org/pdf/2407.15138v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"d-4-m-dataset-distillation-via-disentangled","repo_url":"https://github.com/richards94/D4M","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-2-Clause"}}],"tasks":[{"task_slug":"dataset-distillation","task_name":"Dataset Distillation"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"latent-diffusion-model","method_name":"Latent Diffusion Model"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2407.15138","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2407.15138"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/richards94/D4M","reach":{"status":"ok","spdx":"BSD-2-Clause"}}],"summary":{"ran_fixture":1,"ran":1,"ran_draft_wrong":1,"unverified":10},"by_repo_kind":{"listed":{"samples":13,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"eab4f74c38cc3c8f","entry":"accuracy","repo":"richards94/D4M","repo_kind":"listed","path":"validate/utils.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/validate/utils.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"eab4f74c38cc3c8f"}},{"code_sha256_prefix":"370445b84099fd37","entry":"get_FKD_info","repo":"richards94/D4M","repo_kind":"listed","path":"matching/utils_fkd.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/matching/utils_fkd.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"370445b84099fd37"}},{"code_sha256_prefix":"0756a99508caf42c","entry":"rand_bbox","repo":"richards94/D4M","repo_kind":"listed","path":"matching/utils_fkd.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/matching/utils_fkd.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"0756a99508caf42c"}},{"code_sha256_prefix":"3762ba29552f4adc","entry":"cutmix","repo":"richards94/D4M","repo_kind":"listed","path":"matching/utils_fkd.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/matching/utils_fkd.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"3762ba29552f4adc"}},{"code_sha256_prefix":"9f8d584ac43e6fcd","entry":"gen_label_list","repo":"richards94/D4M","repo_kind":"listed","path":"distillation/dataset_utils.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/distillation/dataset_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"9f8d584ac43e6fcd"}},{"code_sha256_prefix":"dee581eabe52bcdb","entry":"gen_prototype","repo":"richards94/D4M","repo_kind":"listed","path":"distillation/gen_prototype.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/distillation/gen_prototype.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"dee581eabe52bcdb"}},{"code_sha256_prefix":"9a700a3b149f4952","entry":"get_parameters","repo":"richards94/D4M","repo_kind":"listed","path":"validate/utils.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/validate/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"9a700a3b149f4952"}},{"code_sha256_prefix":"98dda32767bfeb9d","entry":"initialize_km_models","repo":"richards94/D4M","repo_kind":"listed","path":"distillation/gen_prototype.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/distillation/gen_prototype.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"98dda32767bfeb9d"}},{"code_sha256_prefix":"975334e17a616dce","entry":"keep_top_k","repo":"richards94/D4M","repo_kind":"listed","path":"validate/utils.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/validate/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"975334e17a616dce"}},{"code_sha256_prefix":"59cdf1119408f945","entry":"load_dataset","repo":"richards94/D4M","repo_kind":"listed","path":"distillation/dataset_utils.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/distillation/dataset_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"59cdf1119408f945"}},{"code_sha256_prefix":"fe5f75ed450404ee","entry":"load_prototype","repo":"richards94/D4M","repo_kind":"listed","path":"distillation/gen_syn_image.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/distillation/gen_syn_image.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"fe5f75ed450404ee"}},{"code_sha256_prefix":"cf77f8fbab6646fb","entry":"load_syn_dataset","repo":"richards94/D4M","repo_kind":"listed","path":"distillation/dataset_utils.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/distillation/dataset_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"cf77f8fbab6646fb"}},{"code_sha256_prefix":"2acc8620fafefcb1","entry":"prototype_kmeans","repo":"richards94/D4M","repo_kind":"listed","path":"distillation/gen_prototype.py","file_url":"https://github.com/richards94/D4M/blob/HEAD/distillation/gen_prototype.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"2acc8620fafefcb1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}