{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/road-waymo-action-awareness-at-scale-for","title":"ROAD-Waymo: Action Awareness at Scale for Autonomous Driving","arxiv_id":"2411.01683","date":"2024-11-03","proceeding":null,"authors":["Salman Khan","Izzeddin Teeti","Reza Javanmard Alitappeh","Mihaela C. Stoian","Eleonora Giunchiglia","Gurkirt Singh","Andrew Bradley","Fabio Cuzzolin"],"abstract":"Autonomous Vehicle (AV) perception systems require more than simply seeing, via e.g., object detection or scene segmentation. They need a holistic understanding of what is happening within the scene for safe interaction with other road users. Few datasets exist for the purpose of developing and training algorithms to comprehend the actions of other road users. This paper presents ROAD-Waymo, an extensive dataset for the development and benchmarking of techniques for agent, action, location and event detection in road scenes, provided as a layer upon the (US) Waymo Open dataset. Considerably larger and more challenging than any existing dataset (and encompassing multiple cities), it comes with 198k annotated video frames, 54k agent tubes, 3.9M bounding boxes and a total of 12.4M labels. The integrity of the dataset has been confirmed and enhanced via a novel annotation pipeline designed for automatically identifying violations of requirements specifically designed for this dataset. As ROAD-Waymo is compatible with the original (UK) ROAD dataset, it provides the opportunity to tackle domain adaptation between real-world road scenarios in different countries within a novel benchmark: ROAD++.","url_abs":"https://arxiv.org/abs/2411.01683v2","url_pdf":"https://arxiv.org/pdf/2411.01683v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"road-waymo-action-awareness-at-scale-for","repo_url":"https://github.com/salmank255/ROAD_Waymo_Baseline","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"domain-adaptation","task_name":"Domain Adaptation"},{"task_slug":"event-detection","task_name":"Event Detection"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"scene-segmentation","task_name":"Scene Segmentation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2411.01683","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2411.01683"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/salmank255/ROAD_Waymo_Baseline","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran_violates":1,"unverified":9},"by_repo_kind":{"official":{"samples":10,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"25c7475539e39da4","entry":"str2bool","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"gt_vis.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/gt_vis.py","link_basis":"plan_row","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"25c7475539e39da4"}},{"code_sha256_prefix":"62afa6e56fc8d934","entry":"find_in_list_of_list","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"add_location_labels.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/add_location_labels.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"62afa6e56fc8d934"}},{"code_sha256_prefix":"70645db2047d82ec","entry":"get_area","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"kmean_anchors.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/kmean_anchors.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"70645db2047d82ec"}},{"code_sha256_prefix":"bf09436830878aaa","entry":"get_center","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"kmean_anchors.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/kmean_anchors.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"bf09436830878aaa"}},{"code_sha256_prefix":"0958ae956dba4070","entry":"get_maps","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"extras/serach_road_results.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/extras/serach_road_results.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"0958ae956dba4070"}},{"code_sha256_prefix":"ff63da5e3d17ea69","entry":"run_exp","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"extras/serach_road_results.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/extras/serach_road_results.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"ff63da5e3d17ea69"}},{"code_sha256_prefix":"d9cdae7d5a6b9b85","entry":"set_out_video","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"gt_vis.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/gt_vis.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d9cdae7d5a6b9b85"}},{"code_sha256_prefix":"6692bb79466c295a","entry":"set_out_video","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"inference.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/inference.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"6692bb79466c295a"}},{"code_sha256_prefix":"5040afe356ddac29","entry":"set_out_video","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"inference_vis.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/inference_vis.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"5040afe356ddac29"}},{"code_sha256_prefix":"21947d8387b20363","entry":"set_video","repo":"salmank255/ROAD_Waymo_Baseline","repo_kind":"official","path":"inference_vis.py","file_url":"https://github.com/salmank255/ROAD_Waymo_Baseline/blob/HEAD/inference_vis.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"21947d8387b20363"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}