{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/find-any-part-in-3d","title":"Find Any Part in 3D","arxiv_id":"2411.13550","date":"2024-11-20","proceeding":null,"authors":["Ziqi Ma","Yisong Yue","Georgia Gkioxari"],"abstract":"Why don't we have foundation models in 3D yet? A key limitation is data scarcity. For 3D object part segmentation, existing datasets are small in size and lack diversity. We show that it is possible to break this data barrier by building a data engine powered by 2D foundation models. Our data engine automatically annotates any number of object parts: 1755x more unique part types than existing datasets combined. By training on our annotated data with a simple contrastive objective, we obtain an open-world model that generalizes to any part in any object based on any text query. Even when evaluated zero-shot, we outperform existing methods on the datasets they train on. We achieve 260% improvement in mIoU and boost speed by 6x to 300x. Our scaling analysis confirms that this generalization stems from the data scale, which underscores the impact of our data engine. Finally, to advance general-category open-world 3D part segmentation, we release a benchmark covering a wide range of objects and parts. Project website: https://ziqi-ma.github.io/find3dsite/","url_abs":"https://arxiv.org/abs/2411.13550v2","url_pdf":"https://arxiv.org/pdf/2411.13550v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"find-any-part-in-3d","repo_url":"https://github.com/ziqi-ma/find3d","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-part-segmentation","task_name":"3D Part Segmentation"},{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"object","task_name":"Object"},{"task_slug":"segmentation","task_name":"Segmentation"}],"methods":[{"method_slug":"speed","method_name":"SPEED"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2411.13550","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2411.13550"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ziqi-ma/find3d","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":7},"by_repo_kind":{"listed":{"samples":7,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"986baf8061fd0806","entry":"batch_iou","repo":"ziqi-ma/find3d","repo_kind":"listed","path":"model/evaluation/core.py","file_url":"https://github.com/ziqi-ma/find3d/blob/HEAD/model/evaluation/core.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"986baf8061fd0806"}},{"code_sha256_prefix":"e5616fc7014831ee","entry":"compute_overall_iou_objwise","repo":"ziqi-ma/find3d","repo_kind":"listed","path":"model/evaluation/core.py","file_url":"https://github.com/ziqi-ma/find3d/blob/HEAD/model/evaluation/core.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e5616fc7014831ee"}},{"code_sha256_prefix":"0086c892bd1df796","entry":"fnv_hash_vec","repo":"ziqi-ma/find3d","repo_kind":"listed","path":"model/evaluation/utils.py","file_url":"https://github.com/ziqi-ma/find3d/blob/HEAD/model/evaluation/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0086c892bd1df796"}},{"code_sha256_prefix":"29ac70a2986cf4bd","entry":"grid_sample_numpy","repo":"ziqi-ma/find3d","repo_kind":"listed","path":"model/evaluation/utils.py","file_url":"https://github.com/ziqi-ma/find3d/blob/HEAD/model/evaluation/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"29ac70a2986cf4bd"}},{"code_sha256_prefix":"d213559236b7abdd","entry":"parse_response","repo":"ziqi-ma/find3d","repo_kind":"listed","path":"dataengine/llm/name_single_part_gemini.py","file_url":"https://github.com/ziqi-ma/find3d/blob/HEAD/dataengine/llm/name_single_part_gemini.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d213559236b7abdd"}},{"code_sha256_prefix":"1de3152e134b486b","entry":"parse_response","repo":"ziqi-ma/find3d","repo_kind":"listed","path":"dataengine/llm/query_orientation.py","file_url":"https://github.com/ziqi-ma/find3d/blob/HEAD/dataengine/llm/query_orientation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1de3152e134b486b"}},{"code_sha256_prefix":"a2a4a4c2a82d91de","entry":"rotate_pts","repo":"ziqi-ma/find3d","repo_kind":"listed","path":"common/utils.py","file_url":"https://github.com/ziqi-ma/find3d/blob/HEAD/common/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a2a4a4c2a82d91de"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}