{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cvsformer-cross-view-synthesis-transformer","title":"CVSformer: Cross-View Synthesis Transformer for Semantic Scene Completion","arxiv_id":"2307.07938","date":"2023-07-16","proceeding":"ICCV 2023 1","authors":["Haotian Dong","Enhui Ma","Lubo Wang","Miaohui Wang","Wuyuan Xie","Qing Guo","Ping Li","Lingyu Liang","Kairui Yang","Di Lin"],"abstract":"Semantic scene completion (SSC) requires an accurate understanding of the geometric and semantic relationships between the objects in the 3D scene for reasoning the occluded objects. The popular SSC methods voxelize the 3D objects, allowing the deep 3D convolutional network (3D CNN) to learn the object relationships from the complex scenes. However, the current networks lack the controllable kernels to model the object relationship across multiple views, where appropriate views provide the relevant information for suggesting the existence of the occluded objects. In this paper, we propose Cross-View Synthesis Transformer (CVSformer), which consists of Multi-View Feature Synthesis and Cross-View Transformer for learning cross-view object relationships. In the multi-view feature synthesis, we use a set of 3D convolutional kernels rotated differently to compute the multi-view features for each voxel. In the cross-view transformer, we employ the cross-view fusion to comprehensively learn the cross-view relationships, which form useful information for enhancing the features of individual views. We use the enhanced features to predict the geometric occupancies and semantic labels of all voxels. We evaluate CVSformer on public datasets, where CVSformer yields state-of-the-art results.","url_abs":"https://arxiv.org/abs/2307.07938v1","url_pdf":"https://arxiv.org/pdf/2307.07938v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"object","task_name":"Object"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.07938","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.07938"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/donghaotian123/CVSformer","reach":null}],"summary":{"ran":5,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":8,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"0a0fcecfaf674f5c","entry":"Attention_talking_head","repo":"donghaotian123/CVSformer","repo_kind":"found_in_text","path":"core/semantic_scene_completion/caitModule.py","file_url":"https://github.com/donghaotian123/CVSformer/blob/HEAD/core/semantic_scene_completion/caitModule.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0a0fcecfaf674f5c"}},{"code_sha256_prefix":"a56f68cd5218a589","entry":"Class_Attention","repo":"donghaotian123/CVSformer","repo_kind":"found_in_text","path":"core/semantic_scene_completion/caitModule.py","file_url":"https://github.com/donghaotian123/CVSformer/blob/HEAD/core/semantic_scene_completion/caitModule.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a56f68cd5218a589"}},{"code_sha256_prefix":"4124ef88bcc8d0c4","entry":"FC_block_layers","repo":"donghaotian123/CVSformer","repo_kind":"found_in_text","path":"core/semantic_scene_completion/caitModule.py","file_url":"https://github.com/donghaotian123/CVSformer/blob/HEAD/core/semantic_scene_completion/caitModule.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4124ef88bcc8d0c4"}},{"code_sha256_prefix":"0a05de3f50b09f7e","entry":"ISAB_origin","repo":"donghaotian123/CVSformer","repo_kind":"found_in_text","path":"core/semantic_scene_completion/caitModule.py","file_url":"https://github.com/donghaotian123/CVSformer/blob/HEAD/core/semantic_scene_completion/caitModule.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0a05de3f50b09f7e"}},{"code_sha256_prefix":"5bc34d63fe8293ba","entry":"MAB","repo":"donghaotian123/CVSformer","repo_kind":"found_in_text","path":"core/semantic_scene_completion/caitModule.py","file_url":"https://github.com/donghaotian123/CVSformer/blob/HEAD/core/semantic_scene_completion/caitModule.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5bc34d63fe8293ba"}},{"code_sha256_prefix":"a2a48983167b0a4f","entry":"LayerScale_Block","repo":"donghaotian123/CVSformer","repo_kind":"found_in_text","path":"core/semantic_scene_completion/caitModule.py","file_url":"https://github.com/donghaotian123/CVSformer/blob/HEAD/core/semantic_scene_completion/caitModule.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a2a48983167b0a4f"}},{"code_sha256_prefix":"f00e0eb90b1dad9a","entry":"LayerScale_Block_CA","repo":"donghaotian123/CVSformer","repo_kind":"found_in_text","path":"core/semantic_scene_completion/caitModule.py","file_url":"https://github.com/donghaotian123/CVSformer/blob/HEAD/core/semantic_scene_completion/caitModule.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f00e0eb90b1dad9a"}},{"code_sha256_prefix":"04cb69f88f774691","entry":"cait_models","repo":"donghaotian123/CVSformer","repo_kind":"found_in_text","path":"core/semantic_scene_completion/caitModule.py","file_url":"https://github.com/donghaotian123/CVSformer/blob/HEAD/core/semantic_scene_completion/caitModule.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"04cb69f88f774691"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}