{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/construction-of-hierarchical-neural-1","title":"Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars","arxiv_id":"2211.01842","date":"2022-11-03","proceeding":"NeurIPS 2023 11","authors":["Simon Schrodi","Danny Stoll","Binxin Ru","Rhea Sukthanker","Thomas Brox","Frank Hutter"],"abstract":"The discovery of neural architectures from simple building blocks is a long-standing goal of Neural Architecture Search (NAS). Hierarchical search spaces are a promising step towards this goal but lack a unifying search space design framework and typically only search over some limited aspect of architectures. In this work, we introduce a unifying search space design framework based on context-free grammars that can naturally and compactly generate expressive hierarchical search spaces that are 100s of orders of magnitude larger than common spaces from the literature. By enhancing and using their properties, we effectively enable search over the complete architecture and can foster regularity. Further, we propose an efficient hierarchical kernel design for a Bayesian Optimization search strategy to efficiently search over such huge spaces. We demonstrate the versatility of our search space design framework and show that our search strategy can be superior to existing NAS approaches. Code is available at https://github.com/automl/hierarchical_nas_construction.","url_abs":"https://arxiv.org/abs/2211.01842v3","url_pdf":"https://arxiv.org/pdf/2211.01842v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"construction-of-hierarchical-neural-1","repo_url":"https://github.com/automl/hierarchical_nas_construction","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"construction-of-hierarchical-neural-1","repo_url":"https://github.com/automl/neps","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"automl","task_name":"AutoML"},{"task_slug":"bayesian-optimization","task_name":"Bayesian Optimization"},{"task_slug":"architecture-search","task_name":"Neural Architecture Search"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2211.01842","atlas_url":"https://app.syntology.ai/?focus=2211.01842","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2211.01842"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/automl/hierarchical_nas_construction","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/RobGeada/cvpr-nas-datasets","reach":{"status":"ok","spdx":"GPL-3.0"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/karpathy/char-rnn","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/automl/neps","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_draft_wrong":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f2563a00448bfef9","entry":"read_data","repo":"automl/hierarchical_nas_construction","repo_kind":"official","path":"experiments/surrogate_regression.py","file_url":"https://github.com/automl/hierarchical_nas_construction/blob/HEAD/experiments/surrogate_regression.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f2563a00448bfef9"}},{"code_sha256_prefix":"c709e5e85a094102","entry":"remove_players","repo":"automl/hierarchical_nas_construction","repo_kind":"official","path":"experiments/darts_train_search.py","file_url":"https://github.com/automl/hierarchical_nas_construction/blob/HEAD/experiments/darts_train_search.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c709e5e85a094102"}},{"code_sha256_prefix":"1dd5f4e8622fe60d","entry":"run_debug_pipeline","repo":"automl/hierarchical_nas_construction","repo_kind":"official","path":"experiments/optimize.py","file_url":"https://github.com/automl/hierarchical_nas_construction/blob/HEAD/experiments/optimize.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"none","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1dd5f4e8622fe60d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}