{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/distilling-dataset-into-neural-field","title":"Distilling Dataset into Neural Field","arxiv_id":"2503.04835","date":"2025-03-05","proceeding":null,"authors":["DongHyeok Shin","HeeSun Bae","Gyuwon Sim","Wanmo Kang","Il-Chul Moon"],"abstract":"Utilizing a large-scale dataset is essential for training high-performance deep learning models, but it also comes with substantial computation and storage costs. To overcome these challenges, dataset distillation has emerged as a promising solution by compressing the large-scale dataset into a smaller synthetic dataset that retains the essential information needed for training. This paper proposes a novel parameterization framework for dataset distillation, coined Distilling Dataset into Neural Field (DDiF), which leverages the neural field to store the necessary information of the large-scale dataset. Due to the unique nature of the neural field, which takes coordinates as input and output quantity, DDiF effectively preserves the information and easily generates various shapes of data. We theoretically confirm that DDiF exhibits greater expressiveness than some previous literature when the utilized budget for a single synthetic instance is the same. Through extensive experiments, we demonstrate that DDiF achieves superior performance on several benchmark datasets, extending beyond the image domain to include video, audio, and 3D voxel. We release the code at https://github.com/aailab-kaist/DDiF.","url_abs":"https://arxiv.org/abs/2503.04835v1","url_pdf":"https://arxiv.org/pdf/2503.04835v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"distilling-dataset-into-neural-field","repo_url":"https://github.com/aailab-kaist/ddif","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"dataset-distillation","task_name":"Dataset Distillation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2503.04835","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.04835"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/aailab-kaist/DDiF","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/aailab-kaist/ddif","reach":{"status":"ok"}}],"summary":{"ran":2,"ran_fixture":2,"unverified":2},"by_repo_kind":{"official":{"samples":6,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"ae8eeb2be473650e","entry":"Siren","repo":"aailab-kaist/ddif","repo_kind":"official","path":"3D_Voxel/DDiF.py","file_url":"https://github.com/aailab-kaist/ddif/blob/HEAD/3D_Voxel/DDiF.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ae8eeb2be473650e"}},{"code_sha256_prefix":"6c4bdbee51e51b61","entry":"SirenLayer","repo":"aailab-kaist/ddif","repo_kind":"official","path":"3D_Voxel/DDiF.py","file_url":"https://github.com/aailab-kaist/ddif/blob/HEAD/3D_Voxel/DDiF.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6c4bdbee51e51b61"}},{"code_sha256_prefix":"071a802b00d8e806","entry":"to_coordinates_and_features","repo":"aailab-kaist/ddif","repo_kind":"official","path":"Video/DDiF.py","file_url":"https://github.com/aailab-kaist/ddif/blob/HEAD/Video/DDiF.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"071a802b00d8e806"}},{"code_sha256_prefix":"d58b9410b7ff54ff","entry":"to_coordinates_and_features","repo":"aailab-kaist/ddif","repo_kind":"official","path":"3D_Voxel/DDiF.py","file_url":"https://github.com/aailab-kaist/ddif/blob/HEAD/3D_Voxel/DDiF.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d58b9410b7ff54ff"}},{"code_sha256_prefix":"f9831fb6e06ba99c","entry":"DDiF","repo":"aailab-kaist/ddif","repo_kind":"official","path":"3D_Voxel/DDiF.py","file_url":"https://github.com/aailab-kaist/ddif/blob/HEAD/3D_Voxel/DDiF.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f9831fb6e06ba99c"}},{"code_sha256_prefix":"e3ab0de3573eb5e5","entry":"save_and_print","repo":"aailab-kaist/ddif","repo_kind":"official","path":"3D_Voxel/DDiF.py","file_url":"https://github.com/aailab-kaist/ddif/blob/HEAD/3D_Voxel/DDiF.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e3ab0de3573eb5e5"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}