{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/repnas-searching-for-efficient-re","title":"RepNAS: Searching for Efficient Re-parameterizing Blocks","arxiv_id":"2109.03508","date":"2021-09-08","proceeding":null,"authors":["Mingyang Zhang","Xinyi Yu","Jingtao Rong","Linlin Ou"],"abstract":"In the past years, significant improvements in the field of neural architecture search(NAS) have been made. However, it is still challenging to search for efficient networks due to the gap between the searched constraint and real inference time exists. To search for a high-performance network with low inference time, several previous works set a computational complexity constraint for the search algorithm. However, many factors affect the speed of inference(e.g., FLOPs, MACs). The correlation between a single indicator and the latency is not strong. Currently, some re-parameterization(Rep) techniques are proposed to convert multi-branch to single-path architecture which is inference-friendly. Nevertheless, multi-branch architectures are still human-defined and inefficient. In this work, we propose a new search space that is suitable for structural re-parameterization techniques. RepNAS, a one-stage NAS approach, is present to efficiently search the optimal diverse branch block(ODBB) for each layer under the branch number constraint. Our experimental results show the searched ODBB can easily surpass the manual diverse branch block(DBB) with efficient training.","url_abs":"https://arxiv.org/abs/2109.03508v4","url_pdf":"https://arxiv.org/pdf/2109.03508v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"repnas-searching-for-efficient-re","repo_url":"https://github.com/bestfleer/RepNAS","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"architecture-search","task_name":"Neural Architecture Search"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2109.03508","atlas_url":"https://app.syntology.ai/?focus=2109.03508","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.03508"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bestfleer/RepNAS","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"ran_draft_wrong":1,"unverified":10},"by_repo_kind":{"official":{"samples":13,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8733e0d87f232d11","entry":"mixup_target","repo":"bestfleer/RepNAS","repo_kind":"official","path":"utils/Mixup.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/utils/Mixup.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8733e0d87f232d11"}},{"code_sha256_prefix":"4728dc2025227bba","entry":"one_hot","repo":"bestfleer/RepNAS","repo_kind":"official","path":"utils/Mixup.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/utils/Mixup.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4728dc2025227bba"}},{"code_sha256_prefix":"2d7b973a4b160d73","entry":"shear_y","repo":"bestfleer/RepNAS","repo_kind":"official","path":"utils/auto_augment.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/utils/auto_augment.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2d7b973a4b160d73"}},{"code_sha256_prefix":"e93d9ddbfeb73ced","entry":"accuracy","repo":"bestfleer/RepNAS","repo_kind":"official","path":"cnn/utils.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/cnn/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e93d9ddbfeb73ced"}},{"code_sha256_prefix":"4be37bd74adfab6e","entry":"dist_reduce_tensor","repo":"bestfleer/RepNAS","repo_kind":"official","path":"distributed.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/distributed.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4be37bd74adfab6e"}},{"code_sha256_prefix":"c94c1dbbf94b5928","entry":"init_dist","repo":"bestfleer/RepNAS","repo_kind":"official","path":"distributed.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/distributed.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c94c1dbbf94b5928"}},{"code_sha256_prefix":"028e1a08f69df3e7","entry":"master_only","repo":"bestfleer/RepNAS","repo_kind":"official","path":"distributed.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/distributed.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"028e1a08f69df3e7"}},{"code_sha256_prefix":"45e8fbb4a42814eb","entry":"rand_bbox","repo":"bestfleer/RepNAS","repo_kind":"official","path":"utils/Mixup.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/utils/Mixup.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"45e8fbb4a42814eb"}},{"code_sha256_prefix":"b31e84df5541213a","entry":"shear_x","repo":"bestfleer/RepNAS","repo_kind":"official","path":"utils/auto_augment.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/utils/auto_augment.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b31e84df5541213a"}},{"code_sha256_prefix":"a1bfd1b41b138e66","entry":"transIII_1x1_kxk","repo":"bestfleer/RepNAS","repo_kind":"official","path":"cnn/ddb_transforms.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/cnn/ddb_transforms.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a1bfd1b41b138e66"}},{"code_sha256_prefix":"788ed0b33aadf578","entry":"transII_addbranch","repo":"bestfleer/RepNAS","repo_kind":"official","path":"cnn/ddb_transforms.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/cnn/ddb_transforms.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"788ed0b33aadf578"}},{"code_sha256_prefix":"079d0a85a0bfbb47","entry":"transI_fusebn","repo":"bestfleer/RepNAS","repo_kind":"official","path":"cnn/ddb_transforms.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/cnn/ddb_transforms.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"079d0a85a0bfbb47"}},{"code_sha256_prefix":"61f2a3e08a11e1f5","entry":"translate_x_rel","repo":"bestfleer/RepNAS","repo_kind":"official","path":"utils/auto_augment.py","file_url":"https://github.com/bestfleer/RepNAS/blob/HEAD/utils/auto_augment.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"61f2a3e08a11e1f5"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}