{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/einspace-searching-for-neural-architectures","title":"einspace: Searching for Neural Architectures from Fundamental Operations","arxiv_id":"2405.20838","date":"2024-05-31","proceeding":null,"authors":["Linus Ericsson","Miguel Espinosa","Chenhongyi Yang","Antreas Antoniou","Amos Storkey","Shay B. Cohen","Steven McDonagh","Elliot J. Crowley"],"abstract":"Neural architecture search (NAS) finds high performing networks for a given task. Yet the results of NAS are fairly prosaic; they did not e.g. create a shift from convolutional structures to transformers. This is not least because the search spaces in NAS often aren't diverse enough to include such transformations a priori. Instead, for NAS to provide greater potential for fundamental design shifts, we need a novel expressive search space design which is built from more fundamental operations. To this end, we introduce einspace, a search space based on a parameterised probabilistic context-free grammar. Our space is versatile, supporting architectures of various sizes and complexities, while also containing diverse network operations which allow it to model convolutions, attention components and more. It contains many existing competitive architectures, and provides flexibility for discovering new ones. Using this search space, we perform experiments to find novel architectures as well as improvements on existing ones on the diverse Unseen NAS datasets. We show that competitive architectures can be obtained by searching from scratch, and we consistently find large improvements when initialising the search with strong baselines. We believe that this work is an important advancement towards a transformative NAS paradigm where search space expressivity and strategic search initialisation play key roles.","url_abs":"https://arxiv.org/abs/2405.20838v2","url_pdf":"https://arxiv.org/pdf/2405.20838v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"einspace-searching-for-neural-architectures","repo_url":"https://github.com/linusericsson/einspace","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"architecture-search","task_name":"Neural Architecture Search"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2405.20838","atlas_url":"https://app.syntology.ai/?focus=2405.20838","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.20838"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/linusericsson/einspace","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8e8b2baaa9e2d837","entry":"clone_module","repo":"linusericsson/einspace","repo_kind":"official","path":"einspace/utils.py","file_url":"https://github.com/linusericsson/einspace/blob/HEAD/einspace/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8e8b2baaa9e2d837"}},{"code_sha256_prefix":"fac604a64b6e8375","entry":"clone_parameters","repo":"linusericsson/einspace","repo_kind":"official","path":"einspace/utils.py","file_url":"https://github.com/linusericsson/einspace/blob/HEAD/einspace/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fac604a64b6e8375"}},{"code_sha256_prefix":"3a2b451b9ad0890f","entry":"get_fixed_crop","repo":"linusericsson/einspace","repo_kind":"official","path":"einspace/data_utils/cosmic.py","file_url":"https://github.com/linusericsson/einspace/blob/HEAD/einspace/data_utils/cosmic.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a2b451b9ad0890f"}},{"code_sha256_prefix":"3190abd656b4ba5a","entry":"get_random_crop","repo":"linusericsson/einspace","repo_kind":"official","path":"einspace/data_utils/cosmic.py","file_url":"https://github.com/linusericsson/einspace/blob/HEAD/einspace/data_utils/cosmic.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3190abd656b4ba5a"}},{"code_sha256_prefix":"a8a6b34fb836713a","entry":"pair","repo":"linusericsson/einspace","repo_kind":"official","path":"einspace/utils.py","file_url":"https://github.com/linusericsson/einspace/blob/HEAD/einspace/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a8a6b34fb836713a"}},{"code_sha256_prefix":"f7cc76dc34cfaa88","entry":"get_dirs","repo":"linusericsson/einspace","repo_kind":"official","path":"einspace/data_utils/cosmic.py","file_url":"https://github.com/linusericsson/einspace/blob/HEAD/einspace/data_utils/cosmic.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f7cc76dc34cfaa88"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}