{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2602-03371","title":"Multi-Resolution Alignment for Voxel Sparsity in Camera-Based 3D Semantic Scene Completion","arxiv_id":"2602.03371","date":"2026-02-03","proceeding":null,"authors":["Zhiwen Yang","Yuxin Peng"],"abstract":"Camera-based 3D semantic scene completion (SSC) offers a cost-effective solution for assessing the geometric occupancy and semantic labels of each voxel in the surrounding 3D scene with image inputs, providing a voxel-level scene perception foundation for the perception-prediction-planning autonomous driving systems. Although significant progress has been made in existing methods, their optimization rely solely on the supervision from voxel labels and face the challenge of voxel sparsity as a large portion of voxels in autonomous driving scenarios are empty, which limits both optimization efficiency and model performance. To address this issue, we propose a \\textit{Multi-Resolution Alignment (MRA)} approach to mitigate voxel sparsity in camera-based 3D semantic scene completion, which exploits the scene and instance level alignment across multi-resolution 3D features as auxiliary supervision. Specifically, we first propose the Multi-resolution View Transformer module, which projects 2D image features into multi-resolution 3D features and aligns them at the scene level through fusing discriminative seed features. Furthermore, we design the Cubic Semantic Anisotropy module to identify the instance-level semantic significance of each voxel, accounting for the semantic differences of a specific voxel against its neighboring voxels within a cubic area. Finally, we devise a Critical Distribution Alignment module, which selects critical voxels as instance-level anchors with the guidance of cubic semantic anisotropy, and applies a circulated loss for auxiliary supervision on the critical feature distribution consistency across different resolutions. The code is available at https://github.com/PKU-ICST-MIPL/MRA_TIP.","url_abs":"https://arxiv.org/abs/2602.03371","url_pdf":"https://arxiv.org/pdf/2602.03371","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2602.03371","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2602.03371"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/PKU-ICST-MIPL/MRA","reach":null}],"summary":{"ran_fixture":2,"ran_violates":1,"unverified":5},"by_repo_kind":{"found_in_text":{"samples":8,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"d94639b28b2134ff","entry":"iou","repo":"PKU-ICST-MIPL/MRA","repo_kind":"found_in_text","path":"projects/mmdet3d_plugin/mra/utils/lovasz_losses.py","file_url":"https://github.com/PKU-ICST-MIPL/MRA/blob/HEAD/projects/mmdet3d_plugin/mra/utils/lovasz_losses.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d94639b28b2134ff"}},{"code_sha256_prefix":"1211530cd527bd0b","entry":"iou_binary","repo":"PKU-ICST-MIPL/MRA","repo_kind":"found_in_text","path":"projects/mmdet3d_plugin/mra/utils/lovasz_losses.py","file_url":"https://github.com/PKU-ICST-MIPL/MRA/blob/HEAD/projects/mmdet3d_plugin/mra/utils/lovasz_losses.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1211530cd527bd0b"}},{"code_sha256_prefix":"e85b5d21dc5b8382","entry":"lovasz_grad","repo":"PKU-ICST-MIPL/MRA","repo_kind":"found_in_text","path":"projects/mmdet3d_plugin/mra/utils/lovasz_losses.py","file_url":"https://github.com/PKU-ICST-MIPL/MRA/blob/HEAD/projects/mmdet3d_plugin/mra/utils/lovasz_losses.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e85b5d21dc5b8382"}},{"code_sha256_prefix":"033da7a511cc1166","entry":"KL_sep","repo":"PKU-ICST-MIPL/MRA","repo_kind":"found_in_text","path":"projects/mmdet3d_plugin/mra/utils/ssc_loss.py","file_url":"https://github.com/PKU-ICST-MIPL/MRA/blob/HEAD/projects/mmdet3d_plugin/mra/utils/ssc_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"033da7a511cc1166"}},{"code_sha256_prefix":"1cf8e8cd991e96bb","entry":"geo_scal_loss","repo":"PKU-ICST-MIPL/MRA","repo_kind":"found_in_text","path":"projects/mmdet3d_plugin/mra/utils/ssc_loss.py","file_url":"https://github.com/PKU-ICST-MIPL/MRA/blob/HEAD/projects/mmdet3d_plugin/mra/utils/ssc_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1cf8e8cd991e96bb"}},{"code_sha256_prefix":"218ebd972c796d39","entry":"load_checkpoint","repo":"PKU-ICST-MIPL/MRA","repo_kind":"found_in_text","path":"preprocess/AdaBins/model_io.py","file_url":"https://github.com/PKU-ICST-MIPL/MRA/blob/HEAD/preprocess/AdaBins/model_io.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"218ebd972c796d39"}},{"code_sha256_prefix":"48c7d388933451e2","entry":"load_weights","repo":"PKU-ICST-MIPL/MRA","repo_kind":"found_in_text","path":"preprocess/AdaBins/model_io.py","file_url":"https://github.com/PKU-ICST-MIPL/MRA/blob/HEAD/preprocess/AdaBins/model_io.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"48c7d388933451e2"}},{"code_sha256_prefix":"8ea24bf0feee7f2c","entry":"precision_loss","repo":"PKU-ICST-MIPL/MRA","repo_kind":"found_in_text","path":"projects/mmdet3d_plugin/mra/utils/ssc_loss.py","file_url":"https://github.com/PKU-ICST-MIPL/MRA/blob/HEAD/projects/mmdet3d_plugin/mra/utils/ssc_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8ea24bf0feee7f2c"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":2,"rejected_by_independent_check":0,"refused_by_a_rule":2,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}