{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cadre-a-cascade-deep-reinforcement-learning","title":"CADRE: A Cascade Deep Reinforcement Learning Framework for Vision-based Autonomous Urban Driving","arxiv_id":"2202.08557","date":"2022-02-17","proceeding":null,"authors":["Yinuo Zhao","Kun Wu","Zhiyuan Xu","Zhengping Che","Qi Lu","Jian Tang","Chi Harold Liu"],"abstract":"Vision-based autonomous urban driving in dense traffic is quite challenging due to the complicated urban environment and the dynamics of the driving behaviors. Widely-applied methods either heavily rely on hand-crafted rules or learn from limited human experience, which makes them hard to generalize to rare but critical scenarios. In this paper, we present a novel CAscade Deep REinforcement learning framework, CADRE, to achieve model-free vision-based autonomous urban driving. In CADRE, to derive representative latent features from raw observations, we first offline train a Co-attention Perception Module (CoPM) that leverages the co-attention mechanism to learn the inter-relationships between the visual and control information from a pre-collected driving dataset. Cascaded by the frozen CoPM, we then present an efficient distributed proximal policy optimization framework to online learn the driving policy under the guidance of particularly designed reward functions. We perform a comprehensive empirical study with the CARLA NoCrash benchmark as well as specific obstacle avoidance scenarios in autonomous urban driving tasks. The experimental results well justify the effectiveness of CADRE and its superiority over the state-of-the-art by a wide margin.","url_abs":"https://arxiv.org/abs/2202.08557v2","url_pdf":"https://arxiv.org/pdf/2202.08557v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cadre-a-cascade-deep-reinforcement-learning","repo_url":"https://github.com/BIT-MCS/Cadre","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"deep-reinforcement-learning","task_name":"Deep Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[{"method_slug":"carla","method_name":"CARLA"},{"method_slug":"entropy-regularization","method_name":"Entropy Regularization"},{"method_slug":"ppo","method_name":"PPO"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2202.08557","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.08557"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/BIT-MCS/Cadre","reach":null}],"summary":{"ran":8,"unverified":1},"by_repo_kind":{"official":{"samples":9,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c5c3e852207e4c0f","entry":"BCBranch","repo":"BIT-MCS/Cadre","repo_kind":"official","path":"carla_perception/Networks/danet.py","file_url":"https://github.com/BIT-MCS/Cadre/blob/HEAD/carla_perception/Networks/danet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c5c3e852207e4c0f"}},{"code_sha256_prefix":"e43df4e3aec06998","entry":"BasicBlock","repo":"BIT-MCS/Cadre","repo_kind":"official","path":"carla_perception/Networks/danet.py","file_url":"https://github.com/BIT-MCS/Cadre/blob/HEAD/carla_perception/Networks/danet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e43df4e3aec06998"}},{"code_sha256_prefix":"c0887ec4580aa5e6","entry":"Bottleneck","repo":"BIT-MCS/Cadre","repo_kind":"official","path":"carla_perception/Networks/danet.py","file_url":"https://github.com/BIT-MCS/Cadre/blob/HEAD/carla_perception/Networks/danet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c0887ec4580aa5e6"}},{"code_sha256_prefix":"941343f2a32b7c4d","entry":"DANetHead","repo":"BIT-MCS/Cadre","repo_kind":"official","path":"carla_perception/Networks/danet.py","file_url":"https://github.com/BIT-MCS/Cadre/blob/HEAD/carla_perception/Networks/danet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"941343f2a32b7c4d"}},{"code_sha256_prefix":"dc6c8f7c0c917429","entry":"InterTaskAtt","repo":"BIT-MCS/Cadre","repo_kind":"official","path":"carla_perception/Networks/danet.py","file_url":"https://github.com/BIT-MCS/Cadre/blob/HEAD/carla_perception/Networks/danet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc6c8f7c0c917429"}},{"code_sha256_prefix":"09ccd87f987a4776","entry":"ResNet","repo":"BIT-MCS/Cadre","repo_kind":"official","path":"carla_perception/Networks/danet.py","file_url":"https://github.com/BIT-MCS/Cadre/blob/HEAD/carla_perception/Networks/danet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09ccd87f987a4776"}},{"code_sha256_prefix":"28a1013ec99dc908","entry":"Reshape","repo":"BIT-MCS/Cadre","repo_kind":"official","path":"carla_perception/Networks/danet.py","file_url":"https://github.com/BIT-MCS/Cadre/blob/HEAD/carla_perception/Networks/danet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"28a1013ec99dc908"}},{"code_sha256_prefix":"2bd03eea7e216afb","entry":"VisualBranch","repo":"BIT-MCS/Cadre","repo_kind":"official","path":"carla_perception/Networks/danet.py","file_url":"https://github.com/BIT-MCS/Cadre/blob/HEAD/carla_perception/Networks/danet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2bd03eea7e216afb"}},{"code_sha256_prefix":"b93a125692583c0a","entry":"DANet","repo":"BIT-MCS/Cadre","repo_kind":"official","path":"carla_perception/Networks/danet.py","file_url":"https://github.com/BIT-MCS/Cadre/blob/HEAD/carla_perception/Networks/danet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b93a125692583c0a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}