{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/coordinates-are-not-lonely-codebook-prior","title":"Coordinates Are NOT Lonely -- Codebook Prior Helps Implicit Neural 3D Representations","arxiv_id":"2210.11170","date":"2022-10-20","proceeding":null,"authors":["Fukun Yin","Wen Liu","Zilong Huang","Pei Cheng","Tao Chen","Gang Yu"],"abstract":"Implicit neural 3D representation has achieved impressive results in surface or scene reconstruction and novel view synthesis, which typically uses the coordinate-based multi-layer perceptrons (MLPs) to learn a continuous scene representation. However, existing approaches, such as Neural Radiance Field (NeRF) and its variants, usually require dense input views (i.e. 50-150) to obtain decent results. To relive the over-dependence on massive calibrated images and enrich the coordinate-based feature representation, we explore injecting the prior information into the coordinate-based network and introduce a novel coordinate-based model, CoCo-INR, for implicit neural 3D representation. The cores of our method are two attention modules: codebook attention and coordinate attention. The former extracts the useful prototypes containing rich geometry and appearance information from the prior codebook, and the latter propagates such prior information into each coordinate and enriches its feature representation for a scene or object surface. With the help of the prior information, our method can render 3D views with more photo-realistic appearance and geometries than the current methods using fewer calibrated images available. Experiments on various scene reconstruction datasets, including DTU and BlendedMVS, and the full 3D head reconstruction dataset, H3DS, demonstrate the robustness under fewer input views and fine detail-preserving capability of our proposed method.","url_abs":"https://arxiv.org/abs/2210.11170v2","url_pdf":"https://arxiv.org/pdf/2210.11170v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"coordinates-are-not-lonely-codebook-prior","repo_url":"https://github.com/fukunyin/coco-nerf","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"nerf","task_name":"NeRF"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2210.11170","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.11170"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/fukunyin/CoCo-NeRF","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fukunyin/coco-nerf","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3,"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"official":{"samples":6,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"dd67080fe3389024","entry":"Attention","repo":"fukunyin/coco-nerf","repo_kind":"official","path":"code/model/coco.py","file_url":"https://github.com/fukunyin/coco-nerf/blob/HEAD/code/model/coco.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dd67080fe3389024"}},{"code_sha256_prefix":"70d7745c9567cb54","entry":"CodebookAttention","repo":"fukunyin/coco-nerf","repo_kind":"official","path":"code/model/coco.py","file_url":"https://github.com/fukunyin/coco-nerf/blob/HEAD/code/model/coco.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"70d7745c9567cb54"}},{"code_sha256_prefix":"a89949a92957709d","entry":"FeedForward","repo":"fukunyin/coco-nerf","repo_kind":"official","path":"code/model/coco.py","file_url":"https://github.com/fukunyin/coco-nerf/blob/HEAD/code/model/coco.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a89949a92957709d"}},{"code_sha256_prefix":"9c5da28292cfa2f8","entry":"create_activation","repo":"fukunyin/coco-nerf","repo_kind":"official","path":"code/model/coco.py","file_url":"https://github.com/fukunyin/coco-nerf/blob/HEAD/code/model/coco.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9c5da28292cfa2f8"}},{"code_sha256_prefix":"fd5a9c0c42154239","entry":"CoordinateAttention","repo":"fukunyin/coco-nerf","repo_kind":"official","path":"code/model/coco.py","file_url":"https://github.com/fukunyin/coco-nerf/blob/HEAD/code/model/coco.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fd5a9c0c42154239"}},{"code_sha256_prefix":"67ae5e25999bc542","entry":"ImplicitAttentionNetwork","repo":"fukunyin/coco-nerf","repo_kind":"official","path":"code/model/coco.py","file_url":"https://github.com/fukunyin/coco-nerf/blob/HEAD/code/model/coco.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"67ae5e25999bc542"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}