{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/breaking-class-barriers-efficient-dataset","title":"Breaking Class Barriers: Efficient Dataset Distillation via Inter-Class Feature Compensator","arxiv_id":"2408.06927","date":"2024-08-13","proceeding":null,"authors":["Xin Zhang","Jiawei Du","Ping Liu","Joey Tianyi Zhou"],"abstract":"Dataset distillation has emerged as a technique aiming to condense informative features from large, natural datasets into a compact and synthetic form. While recent advancements have refined this technique, its performance is bottlenecked by the prevailing class-specific synthesis paradigm. Under this paradigm, synthetic data is optimized exclusively for a pre-assigned one-hot label, creating an implicit class barrier in feature condensation. This leads to inefficient utilization of the distillation budget and oversight of inter-class feature distributions, which ultimately limits the effectiveness and efficiency, as demonstrated in our analysis. To overcome these constraints, this paper presents the Inter-class Feature Compensator (INFER), an innovative distillation approach that transcends the class-specific data-label framework widely utilized in current dataset distillation methods. Specifically, INFER leverages a Universal Feature Compensator (UFC) to enhance feature integration across classes, enabling the generation of multiple additional synthetic instances from a single UFC input. This significantly improves the efficiency of the distillation budget. Moreover, INFER enriches inter-class interactions during the distillation, thereby enhancing the effectiveness and generalizability of the distilled data. By allowing for the linear interpolation of labels similar to those in the original dataset, INFER meticulously optimizes the synthetic data and dramatically reduces the size of soft labels in the synthetic dataset to almost zero, establishing a new benchmark for efficiency and effectiveness in dataset distillation.","url_abs":"https://arxiv.org/abs/2408.06927v2","url_pdf":"https://arxiv.org/pdf/2408.06927v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"dataset-distillation","task_name":"Dataset Distillation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2408.06927","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.06927"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/zhangxin-xd/UFC","reach":null}],"summary":{"ran":1,"ran_fixture":2,"ran_draft_wrong":2,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":7,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"00726bd6c8148bcf","entry":"BNFeatureHook","repo":"zhangxin-xd/UFC","repo_kind":"found_in_text","path":"ufc_generation/ufc_cifar.py","file_url":"https://github.com/zhangxin-xd/UFC/blob/HEAD/ufc_generation/ufc_cifar.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"00726bd6c8148bcf"}},{"code_sha256_prefix":"2965707b8ea787bf","entry":"clip_image","repo":"zhangxin-xd/UFC","repo_kind":"found_in_text","path":"ufc_generation/ufc_cifar.py","file_url":"https://github.com/zhangxin-xd/UFC/blob/HEAD/ufc_generation/ufc_cifar.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2965707b8ea787bf"}},{"code_sha256_prefix":"ff95f7a094f7cc0a","entry":"denormalize_image","repo":"zhangxin-xd/UFC","repo_kind":"found_in_text","path":"ufc_generation/ufc_cifar.py","file_url":"https://github.com/zhangxin-xd/UFC/blob/HEAD/ufc_generation/ufc_cifar.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ff95f7a094f7cc0a"}},{"code_sha256_prefix":"bf11ca8888082847","entry":"lr_cosine_policy","repo":"zhangxin-xd/UFC","repo_kind":"found_in_text","path":"ufc_generation/ufc_cifar.py","file_url":"https://github.com/zhangxin-xd/UFC/blob/HEAD/ufc_generation/ufc_cifar.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bf11ca8888082847"}},{"code_sha256_prefix":"38fd828e9ae4636a","entry":"lr_policy","repo":"zhangxin-xd/UFC","repo_kind":"found_in_text","path":"ufc_generation/ufc_cifar.py","file_url":"https://github.com/zhangxin-xd/UFC/blob/HEAD/ufc_generation/ufc_cifar.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"38fd828e9ae4636a"}},{"code_sha256_prefix":"d050e4beff6c61bc","entry":"get_images","repo":"zhangxin-xd/UFC","repo_kind":"found_in_text","path":"ufc_generation/ufc_cifar.py","file_url":"https://github.com/zhangxin-xd/UFC/blob/HEAD/ufc_generation/ufc_cifar.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d050e4beff6c61bc"}},{"code_sha256_prefix":"42d3426a70fba1c8","entry":"save_images","repo":"zhangxin-xd/UFC","repo_kind":"found_in_text","path":"ufc_generation/ufc_cifar.py","file_url":"https://github.com/zhangxin-xd/UFC/blob/HEAD/ufc_generation/ufc_cifar.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"42d3426a70fba1c8"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}