{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/rapid-inr-storage-efficient-cpu-free-dnn","title":"Rapid-INR: Storage Efficient CPU-free DNN Training Using Implicit Neural Representation","arxiv_id":"2306.16699","date":"2023-06-29","proceeding":null,"authors":["Hanqiu Chen","Hang Yang","Stephen Fitzmeyer","Cong Hao"],"abstract":"Implicit Neural Representation (INR) is an innovative approach for representing complex shapes or objects without explicitly defining their geometry or surface structure. Instead, INR represents objects as continuous functions. Previous research has demonstrated the effectiveness of using neural networks as INR for image compression, showcasing comparable performance to traditional methods such as JPEG. However, INR holds potential for various applications beyond image compression. This paper introduces Rapid-INR, a novel approach that utilizes INR for encoding and compressing images, thereby accelerating neural network training in computer vision tasks. Our methodology involves storing the whole dataset directly in INR format on a GPU, mitigating the significant data communication overhead between the CPU and GPU during training. Additionally, the decoding process from INR to RGB format is highly parallelized and executed on-the-fly. To further enhance compression, we propose iterative and dynamic pruning, as well as layer-wise quantization, building upon previous work. We evaluate our framework on the image classification task, utilizing the ResNet-18 backbone network and three commonly used datasets with varying image sizes. Rapid-INR reduces memory consumption to only about 5% of the original dataset size in RGB format and achieves a maximum 6$\\times$ speedup over the PyTorch training pipeline, as well as a maximum 1.2x speedup over the DALI training pipeline, with only a marginal decrease in accuracy. Importantly, Rapid-INR can be readily applied to other computer vision tasks and backbone networks with reasonable engineering efforts. Our implementation code is publicly available at https://github.com/sharc-lab/Rapid-INR.","url_abs":"https://arxiv.org/abs/2306.16699v3","url_pdf":"https://arxiv.org/pdf/2306.16699v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"rapid-inr-storage-efficient-cpu-free-dnn","repo_url":"https://github.com/sharc-lab/rapid-inr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":null,"task_name":"CPU"},{"task_slug":null,"task_name":"GPU"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-compression","task_name":"Image Compression"},{"task_slug":"quantization","task_name":"Quantization"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2306.16699","atlas_url":"https://app.syntology.ai/?focus=2306.16699","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.16699"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sharc-lab/rapid-inr","reach":null}],"summary":{"ran_violates":1,"ran_draft_wrong":2,"unverified":2},"by_repo_kind":{"official":{"samples":5,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2383223cfe77b76c","entry":"is_image_file","repo":"sharc-lab/rapid-inr","repo_kind":"official","path":"INR_encoding.py","file_url":"https://github.com/sharc-lab/rapid-inr/blob/HEAD/INR_encoding.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2383223cfe77b76c"}},{"code_sha256_prefix":"fc4fa9d0c6ec7c74","entry":"load_image_path","repo":"sharc-lab/rapid-inr","repo_kind":"official","path":"INR_encoding.py","file_url":"https://github.com/sharc-lab/rapid-inr/blob/HEAD/INR_encoding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fc4fa9d0c6ec7c74"}},{"code_sha256_prefix":"d23ec1986312cdd1","entry":"to_coordinates_and_features","repo":"sharc-lab/rapid-inr","repo_kind":"official","path":"INR_encoding.py","file_url":"https://github.com/sharc-lab/rapid-inr/blob/HEAD/INR_encoding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d23ec1986312cdd1"}},{"code_sha256_prefix":"9bbc135f83be2187","entry":"bpp","repo":"sharc-lab/rapid-inr","repo_kind":"official","path":"train_script.py","file_url":"https://github.com/sharc-lab/rapid-inr/blob/HEAD/train_script.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9bbc135f83be2187"}},{"code_sha256_prefix":"e1b0b37b3501c3f1","entry":"model_size_in_bits","repo":"sharc-lab/rapid-inr","repo_kind":"official","path":"train_script.py","file_url":"https://github.com/sharc-lab/rapid-inr/blob/HEAD/train_script.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e1b0b37b3501c3f1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}