{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/multi-view-radar-semantic-segmentation","title":"Multi-View Radar Semantic Segmentation","arxiv_id":"2103.16214","date":"2021-03-30","proceeding":"ICCV 2021 10","authors":["Arthur Ouaknine","Alasdair Newson","Patrick Pérez","Florence Tupin","Julien Rebut"],"abstract":"Understanding the scene around the ego-vehicle is key to assisted and autonomous driving. Nowadays, this is mostly conducted using cameras and laser scanners, despite their reduced performances in adverse weather conditions. Automotive radars are low-cost active sensors that measure properties of surrounding objects, including their relative speed, and have the key advantage of not being impacted by rain, snow or fog. However, they are seldom used for scene understanding due to the size and complexity of radar raw data and the lack of annotated datasets. Fortunately, recent open-sourced datasets have opened up research on classification, object detection and semantic segmentation with raw radar signals using end-to-end trainable models. In this work, we propose several novel architectures, and their associated losses, which analyse multiple \"views\" of the range-angle-Doppler radar tensor to segment it semantically. Experiments conducted on the recent CARRADA dataset demonstrate that our best model outperforms alternative models, derived either from the semantic segmentation of natural images or from radar scene understanding, while requiring significantly fewer parameters. Both our code and trained models are available at https://github.com/valeoai/MVRSS.","url_abs":"https://arxiv.org/abs/2103.16214v2","url_pdf":"https://arxiv.org/pdf/2103.16214v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"multi-view-radar-semantic-segmentation","repo_url":"https://github.com/valeoai/MVRSS","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"multi-view-radar-semantic-segmentation","repo_url":"https://github.com/SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"multi-view-radar-semantic-segmentation","repo_url":"https://github.com/zlw9161/carrada-rac","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null},{"paper_slug":"multi-view-radar-semantic-segmentation","repo_url":"https://github.com/zlw9161/pkc","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"scene-understanding","task_name":"Scene Understanding"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2103.16214","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.16214"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/valeoai/MVRSS","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zlw9161/pkc","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zlw9161/carrada-rac","reach":null}],"summary":{"ran":7,"ran_fixture":2,"unverified":4},"by_repo_kind":{"listed":{"samples":13,"ran":9,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":13,"samples":[{"code_sha256_prefix":"6df7b4702a1c0365","entry":"ASPPBlock","repo":"SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving","repo_kind":"listed","path":"mvrss/models/tmvanet.py","file_url":"https://github.com/SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving/blob/HEAD/mvrss/models/tmvanet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"6df7b4702a1c0365"}},{"code_sha256_prefix":"175c34969327a671","entry":"ConvBlock","repo":"SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving","repo_kind":"listed","path":"mvrss/models/tmvanet.py","file_url":"https://github.com/SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving/blob/HEAD/mvrss/models/tmvanet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"175c34969327a671"}},{"code_sha256_prefix":"e203bdd4cdd5eca3","entry":"Double3DConvBlock","repo":"SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving","repo_kind":"listed","path":"mvrss/models/tmvanet.py","file_url":"https://github.com/SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving/blob/HEAD/mvrss/models/tmvanet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"e203bdd4cdd5eca3"}},{"code_sha256_prefix":"c2331301d3f0c3b0","entry":"DoubleConvBlock","repo":"SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving","repo_kind":"listed","path":"mvrss/models/tmvanet.py","file_url":"https://github.com/SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving/blob/HEAD/mvrss/models/tmvanet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"c2331301d3f0c3b0"}},{"code_sha256_prefix":"19ec7de44730bfb3","entry":"EncodingBranch","repo":"SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving","repo_kind":"listed","path":"mvrss/models/tmvanet.py","file_url":"https://github.com/SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving/blob/HEAD/mvrss/models/tmvanet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"19ec7de44730bfb3"}},{"code_sha256_prefix":"483ce3e00a405fbf","entry":"PeakConv2D","repo":"zlw9161/pkc","repo_kind":"listed","path":"mvrss/models/pkcon.py","file_url":"https://github.com/zlw9161/pkc/blob/HEAD/mvrss/models/pkcon.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"483ce3e00a405fbf"}},{"code_sha256_prefix":"f6b77ecfe9098d49","entry":"TMVANet","repo":"SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving","repo_kind":"listed","path":"mvrss/models/tmvanet.py","file_url":"https://github.com/SaifeddineBarkia/Multi-view-radar-semantic-segmentation-for-scene-understanding-in-autonomous-driving/blob/HEAD/mvrss/models/tmvanet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f6b77ecfe9098d49"}},{"code_sha256_prefix":"b80ccae2717d7b4e","entry":"gen_ra_proposals_cfar","repo":"zlw9161/carrada-rac","repo_kind":"listed","path":"carrada_dataset/annotation_generators/ra_utils.py","file_url":"https://github.com/zlw9161/carrada-rac/blob/HEAD/carrada_dataset/annotation_generators/ra_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b80ccae2717d7b4e"}},{"code_sha256_prefix":"cf1d08a4383a5692","entry":"ra_threshold_filtering_cfar","repo":"zlw9161/carrada-rac","repo_kind":"listed","path":"carrada_dataset/annotation_generators/ra_utils.py","file_url":"https://github.com/zlw9161/carrada-rac/blob/HEAD/carrada_dataset/annotation_generators/ra_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"cf1d08a4383a5692"}},{"code_sha256_prefix":"2fc4d17bcde0f4ba","entry":"DoublePeakConv2D","repo":"zlw9161/pkc","repo_kind":"listed","path":"mvrss/models/pkcon.py","file_url":"https://github.com/zlw9161/pkc/blob/HEAD/mvrss/models/pkcon.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2fc4d17bcde0f4ba"}},{"code_sha256_prefix":"4920b9ab40e22283","entry":"DoubleTPKCBlock","repo":"zlw9161/pkc","repo_kind":"listed","path":"mvrss/models/pkcon.py","file_url":"https://github.com/zlw9161/pkc/blob/HEAD/mvrss/models/pkcon.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4920b9ab40e22283"}},{"code_sha256_prefix":"23bef5ace6ac07c9","entry":"EncodingBranch","repo":"zlw9161/pkc","repo_kind":"listed","path":"mvrss/models/pkcon.py","file_url":"https://github.com/zlw9161/pkc/blob/HEAD/mvrss/models/pkcon.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"23bef5ace6ac07c9"}},{"code_sha256_prefix":"99d17cebe30f0f9f","entry":"PKCOn","repo":"zlw9161/pkc","repo_kind":"listed","path":"mvrss/models/pkcon.py","file_url":"https://github.com/zlw9161/pkc/blob/HEAD/mvrss/models/pkcon.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"99d17cebe30f0f9f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}