{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/octattention-octree-based-large-scale","title":"OctAttention: Octree-Based Large-Scale Contexts Model for Point Cloud Compression","arxiv_id":"2202.06028","date":"2022-02-12","proceeding":null,"authors":["Chunyang Fu","Ge Li","Rui Song","Wei Gao","Shan Liu"],"abstract":"In point cloud compression, sufficient contexts are significant for modeling the point cloud distribution. However, the contexts gathered by the previous voxel-based methods decrease when handling sparse point clouds. To address this problem, we propose a multiple-contexts deep learning framework called OctAttention employing the octree structure, a memory-efficient representation for point clouds. Our approach encodes octree symbol sequences in a lossless way by gathering the information of sibling and ancestor nodes. Expressly, we first represent point clouds with octree to reduce spatial redundancy, which is robust for point clouds with different resolutions. We then design a conditional entropy model with a large receptive field that models the sibling and ancestor contexts to exploit the strong dependency among the neighboring nodes and employ an attention mechanism to emphasize the correlated nodes in the context. Furthermore, we introduce a mask operation during training and testing to make a trade-off between encoding time and performance. Compared to the previous state-of-the-art works, our approach obtains a 10%-35% BD-Rate gain on the LiDAR benchmark (e.g. SemanticKITTI) and object point cloud dataset (e.g. MPEG 8i, MVUB), and saves 95% coding time compared to the voxel-based baseline. The code is available at https://github.com/zb12138/OctAttention.","url_abs":"https://arxiv.org/abs/2202.06028v2","url_pdf":"https://arxiv.org/pdf/2202.06028v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"octattention-octree-based-large-scale","repo_url":"https://github.com/zb12138/octattention","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2202.06028","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.06028"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/zb12138/OctAttention","reach":null}],"summary":{"ran":4,"unverified":1},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e7a55736537ed4bd","entry":"PositionalEncoding","repo":"zb12138/OctAttention","repo_kind":"official","path":"octAttention.py","file_url":"https://github.com/zb12138/OctAttention/blob/HEAD/octAttention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e7a55736537ed4bd"}},{"code_sha256_prefix":"69a80903e8c7958e","entry":"SelfMultiheadAttention","repo":"zb12138/OctAttention","repo_kind":"official","path":"octAttention.py","file_url":"https://github.com/zb12138/OctAttention/blob/HEAD/octAttention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"69a80903e8c7958e"}},{"code_sha256_prefix":"fe7c5d69d63b47f1","entry":"TransformerLayer","repo":"zb12138/OctAttention","repo_kind":"official","path":"octAttention.py","file_url":"https://github.com/zb12138/OctAttention/blob/HEAD/octAttention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fe7c5d69d63b47f1"}},{"code_sha256_prefix":"6c927ce2bc5af651","entry":"TransformerModule","repo":"zb12138/OctAttention","repo_kind":"official","path":"octAttention.py","file_url":"https://github.com/zb12138/OctAttention/blob/HEAD/octAttention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6c927ce2bc5af651"}},{"code_sha256_prefix":"d8d0db2f26893d5b","entry":"TransformerModel","repo":"zb12138/OctAttention","repo_kind":"official","path":"octAttention.py","file_url":"https://github.com/zb12138/OctAttention/blob/HEAD/octAttention.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d8d0db2f26893d5b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}