{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/automated-deep-learning-neural-architecture","title":"Automated Deep Learning: Neural Architecture Search Is Not the End","arxiv_id":"2112.09245","date":"2021-12-16","proceeding":null,"authors":["Xuanyi Dong","David Jacob Kedziora","Katarzyna Musial","Bogdan Gabrys"],"abstract":"Deep learning (DL) has proven to be a highly effective approach for developing models in diverse contexts, including visual perception, speech recognition, and machine translation. However, the end-to-end process for applying DL is not trivial. It requires grappling with problem formulation and context understanding, data engineering, model development, deployment, continuous monitoring and maintenance, and so on. Moreover, each of these steps typically relies heavily on humans, in terms of both knowledge and interactions, which impedes the further advancement and democratization of DL. Consequently, in response to these issues, a new field has emerged over the last few years: automated deep learning (AutoDL). This endeavor seeks to minimize the need for human involvement and is best known for its achievements in neural architecture search (NAS), a topic that has been the focus of several surveys. That stated, NAS is not the be-all and end-all of AutoDL. Accordingly, this review adopts an overarching perspective, examining research efforts into automation across the entirety of an archetypal DL workflow. In so doing, this work also proposes a comprehensive set of ten criteria by which to assess existing work in both individual publications and broader research areas. These criteria are: novelty, solution quality, efficiency, stability, interpretability, reproducibility, engineering quality, scalability, generalizability, and eco-friendliness. Thus, ultimately, this review provides an evaluative overview of AutoDL in the early 2020s, identifying where future opportunities for progress may exist.","url_abs":"https://arxiv.org/abs/2112.09245v3","url_pdf":"https://arxiv.org/pdf/2112.09245v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"automated-deep-learning-neural-architecture","repo_url":"https://github.com/D-X-Y/Awesome-AutoDL","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"deep-learning","task_name":"Deep Learning"},{"task_slug":"machine-translation","task_name":"Machine Translation"},{"task_slug":"architecture-search","task_name":"Neural Architecture Search"},{"task_slug":"speech-recognition","task_name":"Speech Recognition"},{"task_slug":"speech-recognition-1","task_name":"speech-recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2112.09245","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2112.09245"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/D-X-Y/Awesome-AutoDL","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":6},"by_repo_kind":{"official":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"08be96d647a0a90d","entry":"check_and_sort_by_date","repo":"D-X-Y/Awesome-AutoDL","repo_kind":"official","path":"awesome_autodl/utils/check.py","file_url":"https://github.com/D-X-Y/Awesome-AutoDL/blob/HEAD/awesome_autodl/utils/check.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"08be96d647a0a90d"}},{"code_sha256_prefix":"eeac120f54cad4ce","entry":"check_paper_and_correct_format","repo":"D-X-Y/Awesome-AutoDL","repo_kind":"official","path":"awesome_autodl/utils/check.py","file_url":"https://github.com/D-X-Y/Awesome-AutoDL/blob/HEAD/awesome_autodl/utils/check.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eeac120f54cad4ce"}},{"code_sha256_prefix":"03b3d16bf446d0e9","entry":"dump_yaml","repo":"D-X-Y/Awesome-AutoDL","repo_kind":"official","path":"awesome_autodl/utils/yaml.py","file_url":"https://github.com/D-X-Y/Awesome-AutoDL/blob/HEAD/awesome_autodl/utils/yaml.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"03b3d16bf446d0e9"}},{"code_sha256_prefix":"0a4de3b2fce5356a","entry":"filter_ele_w_value","repo":"D-X-Y/Awesome-AutoDL","repo_kind":"official","path":"awesome_autodl/utils/filter.py","file_url":"https://github.com/D-X-Y/Awesome-AutoDL/blob/HEAD/awesome_autodl/utils/filter.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0a4de3b2fce5356a"}},{"code_sha256_prefix":"1f725fcb99b5cb60","entry":"generate_email","repo":"D-X-Y/Awesome-AutoDL","repo_kind":"official","path":"awesome_autodl/bins/list_email.py","file_url":"https://github.com/D-X-Y/Awesome-AutoDL/blob/HEAD/awesome_autodl/bins/list_email.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1f725fcb99b5cb60"}},{"code_sha256_prefix":"bb3be380e6653bdc","entry":"load_yaml","repo":"D-X-Y/Awesome-AutoDL","repo_kind":"official","path":"awesome_autodl/utils/yaml.py","file_url":"https://github.com/D-X-Y/Awesome-AutoDL/blob/HEAD/awesome_autodl/utils/yaml.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bb3be380e6653bdc"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}