{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/autorecon-neural-architecture-search-based","title":"AutoReCon: Neural Architecture Search-based Reconstruction for Data-free Compression","arxiv_id":"2105.12151","date":"2021-05-25","proceeding":null,"authors":["Baozhou Zhu","Peter Hofstee","Johan Peltenburg","Jinho Lee","Zaid AlArs"],"abstract":"Data-free compression raises a new challenge because the original training dataset for a pre-trained model to be compressed is not available due to privacy or transmission issues. Thus, a common approach is to compute a reconstructed training dataset before compression. The current reconstruction methods compute the reconstructed training dataset with a generator by exploiting information from the pre-trained model. However, current reconstruction methods focus on extracting more information from the pre-trained model but do not leverage network engineering. This work is the first to consider network engineering as an approach to design the reconstruction method. Specifically, we propose the AutoReCon method, which is a neural architecture search-based reconstruction method. In the proposed AutoReCon method, the generator architecture is designed automatically given the pre-trained model for reconstruction. Experimental results show that using generators discovered by the AutoRecon method always improve the performance of data-free compression.","url_abs":"https://arxiv.org/abs/2105.12151v1","url_pdf":"https://arxiv.org/pdf/2105.12151v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"autorecon-neural-architecture-search-based","repo_url":"https://github.com/iamkanghyunchoi/ait","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"architecture-search","task_name":"Neural Architecture Search"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2105.12151","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.12151"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/iamkanghyunchoi/ait","reach":null}],"summary":{"ran":10,"unverified":4},"by_repo_kind":{"listed":{"samples":14,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"a4722cea229f323a","entry":"CategoricalConditionalBatchNorm2d","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"a4722cea229f323a"}},{"code_sha256_prefix":"8b9bf771af036f88","entry":"ConditionalBatchNorm2d","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"8b9bf771af036f88"}},{"code_sha256_prefix":"7c28fdce3a19b864","entry":"Conv","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"7c28fdce3a19b864"}},{"code_sha256_prefix":"c9a4179294bd6979","entry":"DilConv","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"c9a4179294bd6979"}},{"code_sha256_prefix":"5094999a837b9555","entry":"Identity","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"5094999a837b9555"}},{"code_sha256_prefix":"5407cd540d50191a","entry":"MixedOp","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"5407cd540d50191a"}},{"code_sha256_prefix":"967e032e45ad1b4a","entry":"MixedUp","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"967e032e45ad1b4a"}},{"code_sha256_prefix":"7eb453cf4fca36ce","entry":"Up","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"7eb453cf4fca36ce"}},{"code_sha256_prefix":"4fd913c0b6e0d39c","entry":"Up_none","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"4fd913c0b6e0d39c"}},{"code_sha256_prefix":"5a30505956439bef","entry":"Zero","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"5a30505956439bef"}},{"code_sha256_prefix":"023f241b96bfcd82","entry":"Cell_one","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"023f241b96bfcd82"}},{"code_sha256_prefix":"f9972a0531e567f7","entry":"Cell_zero","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"f9972a0531e567f7"}},{"code_sha256_prefix":"4d8769e98d9fa25e","entry":"Generator","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"4d8769e98d9fa25e"}},{"code_sha256_prefix":"e0561bd7090a38a1","entry":"MixedUp_cross","repo":"iamkanghyunchoi/ait","repo_kind":"listed","path":"AutoReCon_AIT/model_generator.py","file_url":"https://github.com/iamkanghyunchoi/ait/blob/HEAD/AutoReCon_AIT/model_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"e0561bd7090a38a1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}