{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/unleashing-network-potentials-for-semantic","title":"Unleashing Network Potentials for Semantic Scene Completion","arxiv_id":"2403.07560","date":"2024-03-12","proceeding":"CVPR 2024 1","authors":["Fengyun Wang","Qianru Sun","Dong Zhang","Jinhui Tang"],"abstract":"Semantic scene completion (SSC) aims to predict complete 3D voxel occupancy and semantics from a single-view RGB-D image, and recent SSC methods commonly adopt multi-modal inputs. However, our investigation reveals two limitations: ineffective feature learning from single modalities and overfitting to limited datasets. To address these issues, this paper proposes a novel SSC framework - Adversarial Modality Modulation Network (AMMNet) - with a fresh perspective of optimizing gradient updates. The proposed AMMNet introduces two core modules: a cross-modal modulation enabling the interdependence of gradient flows between modalities, and a customized adversarial training scheme leveraging dynamic gradient competition. Specifically, the cross-modal modulation adaptively re-calibrates the features to better excite representation potentials from each single modality. The adversarial training employs a minimax game of evolving gradients, with customized guidance to strengthen the generator's perception of visual fidelity from both geometric completeness and semantic correctness. Extensive experimental results demonstrate that AMMNet outperforms state-of-the-art SSC methods by a large margin, providing a promising direction for improving the effectiveness and generalization of SSC methods.","url_abs":"https://arxiv.org/abs/2403.07560v2","url_pdf":"https://arxiv.org/pdf/2403.07560v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"unleashing-network-potentials-for-semantic","repo_url":"https://github.com/fereenwong/ammnet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2403.07560","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.07560"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fereenwong/ammnet","reach":{"status":"ok"}}],"summary":{"ran":2,"unverified":4},"by_repo_kind":{"official":{"samples":6,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"d89af417b0668f4b","entry":"get_num_layer_for_vit","repo":"fereenwong/ammnet","repo_kind":"official","path":"ammnet/optim/optim_factory.py","file_url":"https://github.com/fereenwong/ammnet/blob/HEAD/ammnet/optim/optim_factory.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d89af417b0668f4b"}},{"code_sha256_prefix":"2834d68f0b087828","entry":"get_parameter_groups","repo":"fereenwong/ammnet","repo_kind":"official","path":"ammnet/optim/optim_factory.py","file_url":"https://github.com/fereenwong/ammnet/blob/HEAD/ammnet/optim/optim_factory.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2834d68f0b087828"}},{"code_sha256_prefix":"b40701674badc944","entry":"add_weight_decay","repo":"fereenwong/ammnet","repo_kind":"official","path":"ammnet/optim/optim_factory.py","file_url":"https://github.com/fereenwong/ammnet/blob/HEAD/ammnet/optim/optim_factory.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b40701674badc944"}},{"code_sha256_prefix":"cd2a47ded9dd84cf","entry":"is_model","repo":"fereenwong/ammnet","repo_kind":"official","path":"ammnet/models/registry.py","file_url":"https://github.com/fereenwong/ammnet/blob/HEAD/ammnet/models/registry.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cd2a47ded9dd84cf"}},{"code_sha256_prefix":"d14a6ca5ff9d530e","entry":"list_models","repo":"fereenwong/ammnet","repo_kind":"official","path":"ammnet/models/registry.py","file_url":"https://github.com/fereenwong/ammnet/blob/HEAD/ammnet/models/registry.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d14a6ca5ff9d530e"}},{"code_sha256_prefix":"e13039fb1c347452","entry":"register_model","repo":"fereenwong/ammnet","repo_kind":"official","path":"ammnet/models/registry.py","file_url":"https://github.com/fereenwong/ammnet/blob/HEAD/ammnet/models/registry.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e13039fb1c347452"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}