{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-adversarially-robust-dataset","title":"Towards Adversarially Robust Dataset Distillation by Curvature Regularization","arxiv_id":"2403.10045","date":"2024-03-15","proceeding":null,"authors":["Eric Xue","Yijiang Li","Haoyang Liu","Peiran Wang","Yifan Shen","Haohan Wang"],"abstract":"Dataset distillation (DD) allows datasets to be distilled to fractions of their original size while preserving the rich distributional information so that models trained on the distilled datasets can achieve a comparable accuracy while saving significant computational loads. Recent research in this area has been focusing on improving the accuracy of models trained on distilled datasets. In this paper, we aim to explore a new perspective of DD. We study how to embed adversarial robustness in distilled datasets, so that models trained on these datasets maintain the high accuracy and meanwhile acquire better adversarial robustness. We propose a new method that achieves this goal by incorporating curvature regularization into the distillation process with much less computational overhead than standard adversarial training. Extensive empirical experiments suggest that our method not only outperforms standard adversarial training on both accuracy and robustness with less computation overhead but is also capable of generating robust distilled datasets that can withstand various adversarial attacks.","url_abs":"https://arxiv.org/abs/2403.10045v3","url_pdf":"https://arxiv.org/pdf/2403.10045v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"towards-adversarially-robust-dataset","repo_url":"https://github.com/yumozi/guard","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"adversarial-robustness","task_name":"Adversarial Robustness"},{"task_slug":"dataset-distillation","task_name":"Dataset Distillation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.10045","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.10045"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yumozi/guard","reach":{"status":"ok"}}],"summary":{"ran":11,"ran_draft_wrong":2,"ran_violates":1,"unverified":3},"by_repo_kind":{"official":{"samples":17,"ran":14,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":17,"samples":[{"code_sha256_prefix":"d3ba0def38e62a16","entry":"clip_cifar","repo":"yumozi/guard","repo_kind":"official","path":"recover/recover_cifar.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/recover/recover_cifar.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d3ba0def38e62a16"}},{"code_sha256_prefix":"86f5a43a05aa1c9b","entry":"compute_wasserstein_barycenter","repo":"yumozi/guard","repo_kind":"official","path":"recover/barycenter.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/recover/barycenter.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"86f5a43a05aa1c9b"}},{"code_sha256_prefix":"d9def42110729a85","entry":"conv1x1","repo":"yumozi/guard","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d9def42110729a85"}},{"code_sha256_prefix":"160bb14bd76201b4","entry":"conv3x3","repo":"yumozi/guard","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"160bb14bd76201b4"}},{"code_sha256_prefix":"47db86feca98203a","entry":"denormalize_cifar","repo":"yumozi/guard","repo_kind":"official","path":"recover/recover_cifar.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/recover/recover_cifar.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"47db86feca98203a"}},{"code_sha256_prefix":"89c3215b7bc92caf","entry":"fast_is_better_than_free","repo":"yumozi/guard","repo_kind":"official","path":"pretrain/pretrain.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/pretrain/pretrain.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"89c3215b7bc92caf"}},{"code_sha256_prefix":"d80ff6e1df7cb876","entry":"fixed_support_barycenter","repo":"yumozi/guard","repo_kind":"official","path":"recover/barycenter.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/recover/barycenter.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d80ff6e1df7cb876"}},{"code_sha256_prefix":"7a74def3fdadd855","entry":"get_image_size_map","repo":"yumozi/guard","repo_kind":"official","path":"pretrain/utils.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/pretrain/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7a74def3fdadd855"}},{"code_sha256_prefix":"338cd6960a213cdb","entry":"get_num_class_map","repo":"yumozi/guard","repo_kind":"official","path":"pretrain/utils.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/pretrain/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"338cd6960a213cdb"}},{"code_sha256_prefix":"4780f5edc4e40df5","entry":"prepare_data","repo":"yumozi/guard","repo_kind":"official","path":"recover/data_synthesis.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/recover/data_synthesis.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4780f5edc4e40df5"}},{"code_sha256_prefix":"3cbc04eada4612a6","entry":"project_simplex","repo":"yumozi/guard","repo_kind":"official","path":"recover/barycenter.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/recover/barycenter.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3cbc04eada4612a6"}},{"code_sha256_prefix":"7c508037b40522af","entry":"str2bool","repo":"yumozi/guard","repo_kind":"official","path":"pretrain/utils.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/pretrain/utils.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7c508037b40522af"}},{"code_sha256_prefix":"57ebedfddf9562e4","entry":"trades_attack","repo":"yumozi/guard","repo_kind":"official","path":"pretrain/pretrain.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/pretrain/pretrain.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"57ebedfddf9562e4"}},{"code_sha256_prefix":"29ca9d1819cac58b","entry":"trades_loss","repo":"yumozi/guard","repo_kind":"official","path":"pretrain/pretrain.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/pretrain/pretrain.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"29ca9d1819cac58b"}},{"code_sha256_prefix":"b2ea55703711dd12","entry":"get_module","repo":"yumozi/guard","repo_kind":"official","path":"pretrain/presets.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/pretrain/presets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b2ea55703711dd12"}},{"code_sha256_prefix":"8874836603a819db","entry":"resnet18","repo":"yumozi/guard","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/models/resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8874836603a819db"}},{"code_sha256_prefix":"230fb2e9963063c9","entry":"validate","repo":"yumozi/guard","repo_kind":"official","path":"recover/data_synthesis.py","file_url":"https://github.com/yumozi/guard/blob/HEAD/recover/data_synthesis.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"230fb2e9963063c9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}