{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/explore-in-context-learning-for-3d-point-1","title":"Explore In-Context Learning for 3D Point Cloud Understanding","arxiv_id":"2306.08659","date":"2023-06-14","proceeding":"NeurIPS 2023 11","authors":["Zhongbin Fang","Xiangtai Li","Xia Li","Joachim M. Buhmann","Chen Change Loy","Mengyuan Liu"],"abstract":"With the rise of large-scale models trained on broad data, in-context learning has become a new learning paradigm that has demonstrated significant potential in natural language processing and computer vision tasks. Meanwhile, in-context learning is still largely unexplored in the 3D point cloud domain. Although masked modeling has been successfully applied for in-context learning in 2D vision, directly extending it to 3D point clouds remains a formidable challenge. In the case of point clouds, the tokens themselves are the point cloud positions (coordinates) that are masked during inference. Moreover, position embedding in previous works may inadvertently introduce information leakage. To address these challenges, we introduce a novel framework, named Point-In-Context, designed especially for in-context learning in 3D point clouds, where both inputs and outputs are modeled as coordinates for each task. Additionally, we propose the Joint Sampling module, carefully designed to work in tandem with the general point sampling operator, effectively resolving the aforementioned technical issues. We conduct extensive experiments to validate the versatility and adaptability of our proposed methods in handling a wide range of tasks.","url_abs":"https://arxiv.org/abs/2306.08659v2","url_pdf":"https://arxiv.org/pdf/2306.08659v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"explore-in-context-learning-for-3d-point-1","repo_url":"https://github.com/fanglaosi/point-in-context","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"explore-in-context-learning-for-3d-point-1","repo_url":"https://github.com/fanglaosi/skeleton-in-context","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"in-context-learning","task_name":"In-Context Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2306.08659","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.08659"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fanglaosi/point-in-context","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fanglaosi/skeleton-in-context","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"official":{"samples":3,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"0cd1d098a5a4be0d","entry":"random_add_noise","repo":"fanglaosi/point-in-context","repo_kind":"official","path":"eval_seg.py","file_url":"https://github.com/fanglaosi/point-in-context/blob/HEAD/eval_seg.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0cd1d098a5a4be0d"}},{"code_sha256_prefix":"a7a165c52ecaebf7","entry":"eval","repo":"fanglaosi/point-in-context","repo_kind":"official","path":"eval_seg.py","file_url":"https://github.com/fanglaosi/point-in-context/blob/HEAD/eval_seg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a7a165c52ecaebf7"}},{"code_sha256_prefix":"4a1e86e494a49ed3","entry":"eval_cd","repo":"fanglaosi/point-in-context","repo_kind":"official","path":"eval_seg.py","file_url":"https://github.com/fanglaosi/point-in-context/blob/HEAD/eval_seg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4a1e86e494a49ed3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}