{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dataset-distillation-via-factorization","title":"Dataset Distillation via Factorization","arxiv_id":"2210.16774","date":"2022-10-30","proceeding":null,"authors":["Songhua Liu","Kai Wang","Xingyi Yang","Jingwen Ye","Xinchao Wang"],"abstract":"In this paper, we study \\xw{dataset distillation (DD)}, from a novel perspective and introduce a \\emph{dataset factorization} approach, termed \\emph{HaBa}, which is a plug-and-play strategy portable to any existing DD baseline. Unlike conventional DD approaches that aim to produce distilled and representative samples, \\emph{HaBa} explores decomposing a dataset into two components: data \\emph{Ha}llucination networks and \\emph{Ba}ses, where the latter is fed into the former to reconstruct image samples. The flexible combinations between bases and hallucination networks, therefore, equip the distilled data with exponential informativeness gain, which largely increase the representation capability of distilled datasets. To furthermore increase the data efficiency of compression results, we further introduce a pair of adversarial contrastive constraints on the resultant hallucination networks and bases, which increase the diversity of generated images and inject more discriminant information into the factorization. Extensive comparisons and experiments demonstrate that our method can yield significant improvement on downstream classification tasks compared with previous state of the arts, while reducing the total number of compressed parameters by up to 65\\%. Moreover, distilled datasets by our approach also achieve \\textasciitilde10\\% higher accuracy than baseline methods in cross-architecture generalization. Our code is available \\href{https://github.com/Huage001/DatasetFactorization}{here}.","url_abs":"https://arxiv.org/abs/2210.16774v1","url_pdf":"https://arxiv.org/pdf/2210.16774v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dataset-distillation-via-factorization","repo_url":"https://github.com/huage001/datasetfactorization","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"dataset-distillation-via-factorization","repo_url":"https://github.com/Guang000/Awesome-Dataset-Distillation","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"dataset-distillation-via-factorization","repo_url":"https://github.com/miv-xjtu/speed","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"dataset-distillation","task_name":"Dataset Distillation"},{"task_slug":"hallucination","task_name":"Hallucination"},{"task_slug":"informativeness","task_name":"Informativeness"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2210.16774","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.16774"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Guang000/Awesome-Dataset-Distillation","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/huage001/datasetfactorization","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/miv-xjtu/speed","reach":{"status":"ok"}}],"summary":{"unverified":7},"by_repo_kind":{"official":{"samples":7,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3add7fc8542fbd6b","entry":"VGG11","repo":"huage001/datasetfactorization","repo_kind":"official","path":"networks.py","file_url":"https://github.com/huage001/datasetfactorization/blob/HEAD/networks.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3add7fc8542fbd6b"}},{"code_sha256_prefix":"902d178b5ef5e45d","entry":"VGG11BN","repo":"huage001/datasetfactorization","repo_kind":"official","path":"networks.py","file_url":"https://github.com/huage001/datasetfactorization/blob/HEAD/networks.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"902d178b5ef5e45d"}},{"code_sha256_prefix":"315291722688eead","entry":"VGG13","repo":"huage001/datasetfactorization","repo_kind":"official","path":"networks.py","file_url":"https://github.com/huage001/datasetfactorization/blob/HEAD/networks.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"315291722688eead"}},{"code_sha256_prefix":"e90ce475caae13e2","entry":"club","repo":"huage001/datasetfactorization","repo_kind":"official","path":"contrastive_loss.py","file_url":"https://github.com/huage001/datasetfactorization/blob/HEAD/contrastive_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e90ce475caae13e2"}},{"code_sha256_prefix":"ab493433d379032e","entry":"epoch","repo":"huage001/datasetfactorization","repo_kind":"official","path":"utils.py","file_url":"https://github.com/huage001/datasetfactorization/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ab493433d379032e"}},{"code_sha256_prefix":"830bab09ca31d483","entry":"get_dataset","repo":"huage001/datasetfactorization","repo_kind":"official","path":"utils.py","file_url":"https://github.com/huage001/datasetfactorization/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"830bab09ca31d483"}},{"code_sha256_prefix":"063c36a0255c1823","entry":"likelihood","repo":"huage001/datasetfactorization","repo_kind":"official","path":"contrastive_loss.py","file_url":"https://github.com/huage001/datasetfactorization/blob/HEAD/contrastive_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"063c36a0255c1823"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}