{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/nu-mcc-multiview-compressive-coding-with-1","title":"NU-MCC: Multiview Compressive Coding with Neighborhood Decoder and Repulsive UDF","arxiv_id":"2307.09112","date":"2023-07-18","proceeding":"NeurIPS 2023 11","authors":["Stefan Lionar","Xiangyu Xu","Min Lin","Gim Hee Lee"],"abstract":"Remarkable progress has been made in 3D reconstruction from single-view RGB-D inputs. MCC is the current state-of-the-art method in this field, which achieves unprecedented success by combining vision Transformers with large-scale training. However, we identified two key limitations of MCC: 1) The Transformer decoder is inefficient in handling large number of query points; 2) The 3D representation struggles to recover high-fidelity details. In this paper, we propose a new approach called NU-MCC that addresses these limitations. NU-MCC includes two key innovations: a Neighborhood decoder and a Repulsive Unsigned Distance Function (Repulsive UDF). First, our Neighborhood decoder introduces center points as an efficient proxy of input visual features, allowing each query point to only attend to a small neighborhood. This design not only results in much faster inference speed but also enables the exploitation of finer-scale visual features for improved recovery of 3D textures. Second, our Repulsive UDF is a novel alternative to the occupancy field used in MCC, significantly improving the quality of 3D object reconstruction. Compared to standard UDFs that suffer from holes in results, our proposed Repulsive UDF can achieve more complete surface reconstruction. Experimental results demonstrate that NU-MCC is able to learn a strong 3D representation, significantly advancing the state of the art in single-view 3D reconstruction. Particularly, it outperforms MCC by 9.7% in terms of the F1-score on the CO3D-v2 dataset with more than 5x faster running speed.","url_abs":"https://arxiv.org/abs/2307.09112v2","url_pdf":"https://arxiv.org/pdf/2307.09112v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"nu-mcc-multiview-compressive-coding-with-1","repo_url":"https://github.com/sail-sg/numcc","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"3d-object-reconstruction","task_name":"3D Object Reconstruction"},{"task_slug":"3d-reconstruction","task_name":"3D Reconstruction"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"object-reconstruction","task_name":"Object Reconstruction"},{"task_slug":"single-view-3d-reconstruction","task_name":"Single-View 3D Reconstruction"},{"task_slug":"surface-reconstruction","task_name":"Surface Reconstruction"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"speed","method_name":"SPEED"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/single-view-3d-reconstruction-on-common","task":"Single-View 3D Reconstruction","dataset":"Common Objects in 3D","model":"NU-MCC","rank_in_archive_order":1,"of":3,"metrics":{"Avg. F1":"83.8"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.09112","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.09112"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sail-sg/numcc","reach":null}],"summary":{"ran":6,"ran_honours":1,"ran_fixture":2,"ran_draft_wrong":1,"ran_violates":1,"unverified":5},"by_repo_kind":{"official":{"samples":14,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"380854eb9ca9ccc7","entry":"CrossTransformerBlock_NoFine","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"380854eb9ca9ccc7"}},{"code_sha256_prefix":"c1419437fe7c93a0","entry":"DecoderAttentionCenters","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c1419437fe7c93a0"}},{"code_sha256_prefix":"113ee3c359efd24f","entry":"DecoderBlockCenters","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"113ee3c359efd24f"}},{"code_sha256_prefix":"1d2f8baaab7992c5","entry":"DecoderPredictCenters","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1d2f8baaab7992c5"}},{"code_sha256_prefix":"8e12757dead9cd1f","entry":"ResnetBlockFC","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8e12757dead9cd1f"}},{"code_sha256_prefix":"caca77a0bdc72e75","entry":"get_2d_sincos_pos_embed","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"caca77a0bdc72e75"}},{"code_sha256_prefix":"c7ac4b209ddab5c9","entry":"index_points","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"c7ac4b209ddab5c9"}},{"code_sha256_prefix":"2fb812fe9013eeb5","entry":"positional_encoding","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2fb812fe9013eeb5"}},{"code_sha256_prefix":"a10674d38f745127","entry":"preprocess_img","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a10674d38f745127"}},{"code_sha256_prefix":"15f6581a30d2365f","entry":"shrink_points_beyond_threshold","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"15f6581a30d2365f"}},{"code_sha256_prefix":"b1776b6ece5471d2","entry":"square_distance","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"b1776b6ece5471d2"}},{"code_sha256_prefix":"7f93eb2fa37c5e41","entry":"CrossTransformerBlock","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7f93eb2fa37c5e41"}},{"code_sha256_prefix":"2150a4637b729c46","entry":"FeatureAggregator","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2150a4637b729c46"}},{"code_sha256_prefix":"4ec5f3be0f2dfaf0","entry":"MCCEncoder","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4ec5f3be0f2dfaf0"}},{"code_sha256_prefix":"4d48613084231492","entry":"NUMCC","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4d48613084231492"}},{"code_sha256_prefix":"a0139963a83c6736","entry":"XYZPosEmbed","repo":"sail-sg/numcc","repo_kind":"official","path":"src/model/nu_mcc.py","file_url":"https://github.com/sail-sg/numcc/blob/HEAD/src/model/nu_mcc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a0139963a83c6736"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}