{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/on-latency-predictors-for-neural-architecture","title":"On Latency Predictors for Neural Architecture Search","arxiv_id":"2403.02446","date":"2024-03-04","proceeding":null,"authors":["Yash Akhauri","Mohamed S. Abdelfattah"],"abstract":"Efficient deployment of neural networks (NN) requires the co-optimization of accuracy and latency. For example, hardware-aware neural architecture search has been used to automatically find NN architectures that satisfy a latency constraint on a specific hardware device. Central to these search algorithms is a prediction model that is designed to provide a hardware latency estimate for a candidate NN architecture. Recent research has shown that the sample efficiency of these predictive models can be greatly improved through pre-training on some \\textit{training} devices with many samples, and then transferring the predictor on the \\textit{test} (target) device. Transfer learning and meta-learning methods have been used for this, but often exhibit significant performance variability. Additionally, the evaluation of existing latency predictors has been largely done on hand-crafted training/test device sets, making it difficult to ascertain design features that compose a robust and general latency predictor. To address these issues, we introduce a comprehensive suite of latency prediction tasks obtained in a principled way through automated partitioning of hardware device sets. We then design a general latency predictor to comprehensively study (1) the predictor architecture, (2) NN sample selection methods, (3) hardware device representations, and (4) NN operation encoding schemes. Building on conclusions from our study, we present an end-to-end latency predictor training strategy that outperforms existing methods on 11 out of 12 difficult latency prediction tasks, improving latency prediction by 22.5\\% on average, and up to to 87.6\\% on the hardest tasks. Focusing on latency prediction, our HW-Aware NAS reports a $5.8\\times$ speedup in wall-clock time. Our code is available on \\href{https://github.com/abdelfattah-lab/nasflat_latency}{https://github.com/abdelfattah-lab/nasflat\\_latency}.","url_abs":"https://arxiv.org/abs/2403.02446v1","url_pdf":"https://arxiv.org/pdf/2403.02446v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"on-latency-predictors-for-neural-architecture","repo_url":"https://github.com/abdelfattah-lab/nasflat_latency","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"hardware-aware-neural-architecture-search","task_name":"Hardware Aware Neural Architecture Search"},{"task_slug":"meta-learning","task_name":"Meta-Learning"},{"task_slug":"architecture-search","task_name":"Neural Architecture Search"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.02446","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.02446"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/abdelfattah-lab/nasflat_latency","reach":null}],"summary":{"ran_violates":1,"unverified":1},"by_repo_kind":{"official":{"samples":2,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"3c699604599de842","entry":"flatten_mixed_list","repo":"abdelfattah-lab/nasflat_latency","repo_kind":"official","path":"correlation_trainer/main_trf.py","file_url":"https://github.com/abdelfattah-lab/nasflat_latency/blob/HEAD/correlation_trainer/main_trf.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3c699604599de842"}},{"code_sha256_prefix":"c42e6881b4b3c481","entry":"pwl_train","repo":"abdelfattah-lab/nasflat_latency","repo_kind":"official","path":"correlation_trainer/main_trf.py","file_url":"https://github.com/abdelfattah-lab/nasflat_latency/blob/HEAD/correlation_trainer/main_trf.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c42e6881b4b3c481"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}