{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/auto-nba-efficient-and-effective-search-over","title":"Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators","arxiv_id":"2106.06575","date":"2021-06-11","proceeding":null,"authors":["Yonggan Fu","Yongan Zhang","Yang Zhang","David Cox","Yingyan Celine Lin"],"abstract":"While maximizing deep neural networks' (DNNs') acceleration efficiency requires a joint search/design of three different yet highly coupled aspects, including the networks, bitwidths, and accelerators, the challenges associated with such a joint search have not yet been fully understood and addressed. The key challenges include (1) the dilemma of whether to explode the memory consumption due to the huge joint space or achieve sub-optimal designs, (2) the discrete nature of the accelerator design space that is coupled yet different from that of the networks and bitwidths, and (3) the chicken and egg problem associated with network-accelerator co-search, i.e., co-search requires operation-wise hardware cost, which is lacking during search as the optimal accelerator depending on the whole network is still unknown during search. To tackle these daunting challenges towards optimal and fast development of DNN accelerators, we propose a framework dubbed Auto-NBA to enable jointly searching for the Networks, Bitwidths, and Accelerators, by efficiently localizing the optimal design within the huge joint design space for each target dataset and acceleration specification. Our Auto-NBA integrates a heterogeneous sampling strategy to achieve unbiased search with constant memory consumption, and a novel joint-search pipeline equipped with a generic differentiable accelerator search engine. Extensive experiments and ablation studies validate that both Auto-NBA generated networks and accelerators consistently outperform state-of-the-art designs (including co-search/exploration techniques, hardware-aware NAS methods, and DNN accelerators), in terms of search time, task accuracy, and accelerator efficiency. Our codes are available at: https://github.com/RICE-EIC/Auto-NBA.","url_abs":"https://arxiv.org/abs/2106.06575v3","url_pdf":"https://arxiv.org/pdf/2106.06575v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"auto-nba-efficient-and-effective-search-over","repo_url":"https://github.com/RICE-EIC/Auto-NBA","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2106.06575","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.06575"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/RICE-EIC/Auto-NBA","reach":null}],"summary":{"ran_fixture":13,"ran_draft_wrong":4,"ran_honours":1,"unverified":8},"by_repo_kind":{"official":{"samples":24,"ran":16,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"dde6796a9649b047","entry":"allocate_layers","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dde6796a9649b047"}},{"code_sha256_prefix":"2745222d0ad20aeb","entry":"combined_latency","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2745222d0ad20aeb"}},{"code_sha256_prefix":"d6f30bbd3dc5ba42","entry":"comp_engine_lat","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d6f30bbd3dc5ba42"}},{"code_sha256_prefix":"d4db52f918512b42","entry":"design_choice_gen","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d4db52f918512b42"}},{"code_sha256_prefix":"5d5557669b20df95","entry":"dw_combined_latency","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5d5557669b20df95"}},{"code_sha256_prefix":"d4f83a7f576254e7","entry":"dw_comp_engine_lat","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d4f83a7f576254e7"}},{"code_sha256_prefix":"69a5f7e7f77884eb","entry":"dw_read_if_lat","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"69a5f7e7f77884eb"}},{"code_sha256_prefix":"11ad6ba24dd52bed","entry":"dw_read_we_lat","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"11ad6ba24dd52bed"}},{"code_sha256_prefix":"6915888ee6046399","entry":"dw_write_ofmap","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6915888ee6046399"}},{"code_sha256_prefix":"1bab1f2c8a46c6fe","entry":"generate_params","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1bab1f2c8a46c6fe"}},{"code_sha256_prefix":"1824fbfcfee2e185","entry":"gumbel_softmax","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1824fbfcfee2e185"}},{"code_sha256_prefix":"0d41bbe52278fde1","entry":"gumbel_softmax_sample","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"0d41bbe52278fde1"}},{"code_sha256_prefix":"40eb5ef310a13593","entry":"random_sample","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"40eb5ef310a13593"}},{"code_sha256_prefix":"2cf026e1cb51cdf0","entry":"read_if_lat","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2cf026e1cb51cdf0"}},{"code_sha256_prefix":"b678c5ea7942bb72","entry":"read_we_lat","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b678c5ea7942bb72"}},{"code_sha256_prefix":"377dd9a088043ca5","entry":"resource_consumption","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"377dd9a088043ca5"}},{"code_sha256_prefix":"7c913c414af7196f","entry":"sample_gumbel","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"7c913c414af7196f"}},{"code_sha256_prefix":"082bac1336b391d0","entry":"write_ofmap","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"082bac1336b391d0"}},{"code_sha256_prefix":"7809544871a9fe0b","entry":"FBNet","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7809544871a9fe0b"}},{"code_sha256_prefix":"7e63cdc000697a3c","entry":"MixedOp","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7e63cdc000697a3c"}},{"code_sha256_prefix":"83866a815206c036","entry":"capsuled_predictor","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"83866a815206c036"}},{"code_sha256_prefix":"9e23744959c78f65","entry":"cifar_convert_to_layers","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e23744959c78f65"}},{"code_sha256_prefix":"bdf35073bdcf40de","entry":"evaluate_latency","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bdf35073bdcf40de"}},{"code_sha256_prefix":"bd71a08555ee6e6c","entry":"search_for_best_latency","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bd71a08555ee6e6c"}},{"code_sha256_prefix":"cf3df44ac78c9623","entry":"sys_consumption","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cf3df44ac78c9623"}},{"code_sha256_prefix":"f871981fcbaf0534","entry":"sys_latency","repo":"RICE-EIC/Auto-NBA","repo_kind":"official","path":"model_search.py","file_url":"https://github.com/RICE-EIC/Auto-NBA/blob/HEAD/model_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f871981fcbaf0534"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}