{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-modular-and-programmable-architecture","title":"Towards modular and programmable architecture search","arxiv_id":"1909.13404","date":"2019-09-30","proceeding":"NeurIPS 2019 12","authors":["Renato Negrinho","Darshan Patil","Nghia Le","Daniel Ferreira","Matthew Gormley","Geoffrey Gordon"],"abstract":"Neural architecture search methods are able to find high performance deep learning architectures with minimal effort from an expert. However, current systems focus on specific use-cases (e.g. convolutional image classifiers and recurrent language models), making them unsuitable for general use-cases that an expert might wish to write. Hyperparameter optimization systems are general-purpose but lack the constructs needed for easy application to architecture search. In this work, we propose a formal language for encoding search spaces over general computational graphs. The language constructs allow us to write modular, composable, and reusable search space encodings and to reason about search space design. We use our language to encode search spaces from the architecture search literature. The language allows us to decouple the implementations of the search space and the search algorithm, allowing us to expose search spaces to search algorithms through a consistent interface. Our experiments show the ease with which we can experiment with different combinations of search spaces and search algorithms without having to implement each combination from scratch. We release an implementation of our language with this paper.","url_abs":"https://arxiv.org/abs/1909.13404v1","url_pdf":"https://arxiv.org/pdf/1909.13404v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"towards-modular-and-programmable-architecture","repo_url":"https://github.com/negrinho/deep_architect","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"towards-modular-and-programmable-architecture","repo_url":"https://github.com/negrinho/deep_architect_legacy","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"hyperparameter-optimization","task_name":"Hyperparameter Optimization"},{"task_slug":"architecture-search","task_name":"Neural Architecture Search"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1909.13404","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1909.13404"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/negrinho/deep_architect","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/negrinho/deep_architect_legacy","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"unverified":15},"by_repo_kind":{"official":{"samples":3,"ran":1,"repositories":1},"listed":{"samples":13,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0fcde3f7818db7b9","entry":"sorted_values_by_key","repo":"negrinho/deep_architect","repo_kind":"official","path":"deep_architect/core.py","file_url":"https://github.com/negrinho/deep_architect/blob/HEAD/deep_architect/core.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0fcde3f7818db7b9"}},{"code_sha256_prefix":"a23397aa96508c9e","entry":"Optional_fn","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"darch/modules.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/darch/modules.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a23397aa96508c9e"}},{"code_sha256_prefix":"d77c894b8db356ad","entry":"compute_padded_dims","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"darch/modules.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/darch/modules.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d77c894b8db356ad"}},{"code_sha256_prefix":"ff950237d4e1e5fd","entry":"compute_percentiles","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"plots.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/plots.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff950237d4e1e5fd"}},{"code_sha256_prefix":"23308e943e627336","entry":"constant_initializer","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"darch/initializers.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/darch/initializers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"23308e943e627336"}},{"code_sha256_prefix":"3dd086420646eb90","entry":"deepconv_ss0","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"search_spaces.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/search_spaces.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3dd086420646eb90"}},{"code_sha256_prefix":"9c8caae33be86506","entry":"determine_module_eval_seq","repo":"negrinho/deep_architect","repo_kind":"official","path":"deep_architect/core.py","file_url":"https://github.com/negrinho/deep_architect/blob/HEAD/deep_architect/core.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9c8caae33be86506"}},{"code_sha256_prefix":"4c8342e71f166f2b","entry":"extract_unique_modules","repo":"negrinho/deep_architect","repo_kind":"official","path":"deep_architect/core.py","file_url":"https://github.com/negrinho/deep_architect/blob/HEAD/deep_architect/core.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c8342e71f166f2b"}},{"code_sha256_prefix":"06396da2b2c2b8ad","entry":"gaussian_initializer","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"darch/initializers.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/darch/initializers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"06396da2b2c2b8ad"}},{"code_sha256_prefix":"a670d1a23a9c9041","entry":"load_mnist","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"darch/datasets.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/darch/datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a670d1a23a9c9041"}},{"code_sha256_prefix":"863b33d3c3b063c5","entry":"onehot_to_idx","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"darch/datasets.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/darch/datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"863b33d3c3b063c5"}},{"code_sha256_prefix":"31baee2de886be6b","entry":"propagate_seq","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"darch/modules.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/darch/modules.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"31baee2de886be6b"}},{"code_sha256_prefix":"dc596d8ae84aa4d6","entry":"resnet_ss0","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"search_spaces.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/search_spaces.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc596d8ae84aa4d6"}},{"code_sha256_prefix":"d3779a34252371e5","entry":"running_max_stats","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"plots.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/plots.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3779a34252371e5"}},{"code_sha256_prefix":"c16000cc3ab471b6","entry":"tfref_convnet_ss0","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"search_spaces.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/search_spaces.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c16000cc3ab471b6"}},{"code_sha256_prefix":"817a654081d21835","entry":"xavier_initializer_affine","repo":"negrinho/deep_architect_legacy","repo_kind":"listed","path":"darch/initializers.py","file_url":"https://github.com/negrinho/deep_architect_legacy/blob/HEAD/darch/initializers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"817a654081d21835"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}