{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dance-dual-view-distribution-alignment-for","title":"DANCE: Dual-View Distribution Alignment for Dataset Condensation","arxiv_id":"2406.01063","date":"2024-06-03","proceeding":null,"authors":["Hansong Zhang","Shikun Li","Fanzhao Lin","Weiping Wang","Zhenxing Qian","Shiming Ge"],"abstract":"Dataset condensation addresses the problem of data burden by learning a small synthetic training set that preserves essential knowledge from the larger real training set. To date, the state-of-the-art (SOTA) results are often yielded by optimization-oriented methods, but their inefficiency hinders their application to realistic datasets. On the other hand, the Distribution-Matching (DM) methods show remarkable efficiency but sub-optimal results compared to optimization-oriented methods. In this paper, we reveal the limitations of current DM-based methods from the inner-class and inter-class views, i.e., Persistent Training and Distribution Shift. To address these problems, we propose a new DM-based method named Dual-view distribution AligNment for dataset CondEnsation (DANCE), which exploits a few pre-trained models to improve DM from both inner-class and inter-class views. Specifically, from the inner-class view, we construct multiple \"middle encoders\" to perform pseudo long-term distribution alignment, making the condensed set a good proxy of the real one during the whole training process; while from the inter-class view, we use the expert models to perform distribution calibration, ensuring the synthetic data remains in the real class region during condensing. Experiments demonstrate the proposed method achieves a SOTA performance while maintaining comparable efficiency with the original DM across various scenarios. Source codes are available at https://github.com/Hansong-Zhang/DANCE.","url_abs":"https://arxiv.org/abs/2406.01063v1","url_pdf":"https://arxiv.org/pdf/2406.01063v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dance-dual-view-distribution-alignment-for","repo_url":"https://github.com/hansong-zhang/dance","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"dataset-condensation","task_name":"Dataset Condensation"}],"methods":[{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.01063","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.01063"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hansong-zhang/dance","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/Hansong-Zhang/DANCE","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":3,"ran":11,"unverified":4},"by_repo_kind":{"official":{"samples":18,"ran":14,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":18,"samples":[{"code_sha256_prefix":"2813416b75f3a5a8","entry":"remove_aug","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"common.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/common.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":2,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2813416b75f3a5a8"}},{"code_sha256_prefix":"19442a6a71144dbd","entry":"DenseNet121","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"models/densenet_cifar.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/models/densenet_cifar.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"19442a6a71144dbd"}},{"code_sha256_prefix":"96a2132550304d0d","entry":"DenseNet169","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"models/densenet_cifar.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/models/densenet_cifar.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"96a2132550304d0d"}},{"code_sha256_prefix":"8937ae0759fe135c","entry":"DenseNet201","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"models/densenet_cifar.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/models/densenet_cifar.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8937ae0759fe135c"}},{"code_sha256_prefix":"fac5364e2f53c6db","entry":"conv3x3","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fac5364e2f53c6db"}},{"code_sha256_prefix":"1b4af1f0c7b88a83","entry":"conv_stride1","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"models/resnet_ap.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/models/resnet_ap.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1b4af1f0c7b88a83"}},{"code_sha256_prefix":"d923e828eed4fb87","entry":"ipc_epoch","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"arguments/arg_condense.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/arguments/arg_condense.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d923e828eed4fb87"}},{"code_sha256_prefix":"8aac35516308515a","entry":"normalization","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8aac35516308515a"}},{"code_sha256_prefix":"8ba16d20cf03f09b","entry":"normalization","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"models/resnet_ap.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/models/resnet_ap.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8ba16d20cf03f09b"}},{"code_sha256_prefix":"229a68e1f889cf68","entry":"remove_aug","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"arguments/arg_condense.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/arguments/arg_condense.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"229a68e1f889cf68"}},{"code_sha256_prefix":"be23b707de10a353","entry":"set_arguments","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"arguments/reproduce_condense.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/arguments/reproduce_condense.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"be23b707de10a353"}},{"code_sha256_prefix":"6f117c0b0ca5c428","entry":"set_arguments","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"arguments/reproduce_pretrain.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/arguments/reproduce_pretrain.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6f117c0b0ca5c428"}},{"code_sha256_prefix":"23bf22274cc64dc6","entry":"str2bool","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"arguments/arg_condense.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/arguments/arg_condense.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"23bf22274cc64dc6"}},{"code_sha256_prefix":"52605edc9d326455","entry":"transform_cifar","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"data.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/data.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"52605edc9d326455"}},{"code_sha256_prefix":"5bd248f46233fcd6","entry":"innerloss","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"DANCE.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/DANCE.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5bd248f46233fcd6"}},{"code_sha256_prefix":"1bb9a2b0d91ea4cf","entry":"interloss","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"DANCE.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/DANCE.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1bb9a2b0d91ea4cf"}},{"code_sha256_prefix":"5b2e2797a6da2cb5","entry":"transform_mnist","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"data.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5b2e2797a6da2cb5"}},{"code_sha256_prefix":"4a3eef12c129ad96","entry":"transform_svhn","repo":"Hansong-Zhang/DANCE","repo_kind":"official","path":"data.py","file_url":"https://github.com/Hansong-Zhang/DANCE/blob/HEAD/data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4a3eef12c129ad96"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}