{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-from-all-vehicles","title":"Learning from All Vehicles","arxiv_id":"2203.11934","date":"2022-03-22","proceeding":"CVPR 2022 1","authors":["Dian Chen","Philipp Krähenbühl"],"abstract":"In this paper, we present a system to train driving policies from experiences collected not just from the ego-vehicle, but all vehicles that it observes. This system uses the behaviors of other agents to create more diverse driving scenarios without collecting additional data. The main difficulty in learning from other vehicles is that there is no sensor information. We use a set of supervisory tasks to learn an intermediate representation that is invariant to the viewpoint of the controlling vehicle. This not only provides a richer signal at training time but also allows more complex reasoning during inference. Learning how all vehicles drive helps predict their behavior at test time and can avoid collisions. We evaluate this system in closed-loop driving simulations. Our system outperforms all prior methods on the public CARLA Leaderboard by a wide margin, improving driving score by 25 and route completion rate by 24 points. Our method won the 2021 CARLA Autonomous Driving challenge. Code and data are available at https://github.com/dotchen/LAV.","url_abs":"https://arxiv.org/abs/2203.11934v3","url_pdf":"https://arxiv.org/pdf/2203.11934v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-from-all-vehicles","repo_url":"https://github.com/dotchen/LAV","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"all","task_name":"All"},{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"carla-longest6","task_name":"CARLA longest6"}],"methods":[{"method_slug":"carla","method_name":"CARLA"},{"method_slug":"entropy-regularization","method_name":"Entropy Regularization"},{"method_slug":"ppo","method_name":"PPO"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/autonomous-driving-on-carla-leaderboard","task":"Autonomous Driving","dataset":"CARLA Leaderboard","model":"Learning From All Vehicles (LAV)","rank_in_archive_order":5,"of":18,"metrics":{"Driving Score":"61.846","Infraction penalty":"0.640","Route Completion":"94.459"},"uses_additional_data":false},{"leaderboard":"/sota/carla-longest6-on-carla","task":"CARLA longest6","dataset":"CARLA","model":"Learning from all Vehicle v2 (LAV v2)","rank_in_archive_order":10,"of":21,"metrics":{"Driving Score":"58","Infraction Score":"0.68","Route Completion":"83"},"uses_additional_data":false},{"leaderboard":"/sota/carla-longest6-on-carla","task":"CARLA longest6","dataset":"CARLA","model":"Learning from all Vehicles v1 (LAV v1)","rank_in_archive_order":17,"of":21,"metrics":{"Driving Score":"33","Infraction Score":"0.51","Route Completion":"70"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2203.11934","atlas_url":"https://app.syntology.ai/?focus=2203.11934","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.11934"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/dotchen/LAV","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":2,"unverified":3},"by_repo_kind":{"official":{"samples":5,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"7abd529c9f1f8897","entry":"extract_peak","repo":"dotchen/LAV","repo_kind":"official","path":"lav/lav_final.py","file_url":"https://github.com/dotchen/LAV/blob/HEAD/lav/lav_final.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7abd529c9f1f8897"}},{"code_sha256_prefix":"84aa89472ba98d55","entry":"random_sample","repo":"dotchen/LAV","repo_kind":"official","path":"lav/models/bev_planner.py","file_url":"https://github.com/dotchen/LAV/blob/HEAD/lav/models/bev_planner.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"84aa89472ba98d55"}},{"code_sha256_prefix":"c4b54d78c9913b5f","entry":"filter_cars","repo":"dotchen/LAV","repo_kind":"official","path":"lav/models/bev_planner.py","file_url":"https://github.com/dotchen/LAV/blob/HEAD/lav/models/bev_planner.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c4b54d78c9913b5f"}},{"code_sha256_prefix":"3c3fb01a914c2038","entry":"positionalencoding1d","repo":"dotchen/LAV","repo_kind":"official","path":"lav/models/attention.py","file_url":"https://github.com/dotchen/LAV/blob/HEAD/lav/models/attention.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3c3fb01a914c2038"}},{"code_sha256_prefix":"b7e9e267578a969c","entry":"transform_points","repo":"dotchen/LAV","repo_kind":"official","path":"lav/models/bev_planner.py","file_url":"https://github.com/dotchen/LAV/blob/HEAD/lav/models/bev_planner.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b7e9e267578a969c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}