{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ov-parts-towards-open-vocabulary-part","title":"OV-PARTS: Towards Open-Vocabulary Part Segmentation","arxiv_id":"2310.05107","date":"2023-10-08","proceeding":"NeurIPS 2023 11","authors":["Meng Wei","Xiaoyu Yue","Wenwei Zhang","Shu Kong","Xihui Liu","Jiangmiao Pang"],"abstract":"Segmenting and recognizing diverse object parts is a crucial ability in applications spanning various computer vision and robotic tasks. While significant progress has been made in object-level Open-Vocabulary Semantic Segmentation (OVSS), i.e., segmenting objects with arbitrary text, the corresponding part-level research poses additional challenges. Firstly, part segmentation inherently involves intricate boundaries, while limited annotated data compounds the challenge. Secondly, part segmentation introduces an open granularity challenge due to the diverse and often ambiguous definitions of parts in the open world. Furthermore, the large-scale vision and language models, which play a key role in the open vocabulary setting, struggle to recognize parts as effectively as objects. To comprehensively investigate and tackle these challenges, we propose an Open-Vocabulary Part Segmentation (OV-PARTS) benchmark. OV-PARTS includes refined versions of two publicly available datasets: Pascal-Part-116 and ADE20K-Part-234. And it covers three specific tasks: Generalized Zero-Shot Part Segmentation, Cross-Dataset Part Segmentation, and Few-Shot Part Segmentation, providing insights into analogical reasoning, open granularity and few-shot adapting abilities of models. Moreover, we analyze and adapt two prevailing paradigms of existing object-level OVSS methods for OV-PARTS. Extensive experimental analysis is conducted to inspire future research in leveraging foundational models for OV-PARTS. The code and dataset are available at https://github.com/OpenRobotLab/OV_PARTS.","url_abs":"https://arxiv.org/abs/2310.05107v1","url_pdf":"https://arxiv.org/pdf/2310.05107v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ov-parts-towards-open-vocabulary-part","repo_url":"https://github.com/openrobotlab/ov_parts","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"jax","reach":{"status":"ok"}}],"tasks":[{"task_slug":"open-vocabulary-semantic-segmentation","task_name":"Open Vocabulary Semantic Segmentation"},{"task_slug":"open-vocabulary-semantic-segmentation-1","task_name":"Open-Vocabulary Semantic Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2310.05107","atlas_url":"https://app.syntology.ai/?focus=2310.05107","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.05107"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/openrobotlab/ov_parts","reach":{"status":"ok"}}],"summary":{"ran":8,"unverified":6},"by_repo_kind":{"official":{"samples":14,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"743ceb9025a7955d","entry":"booleans_processing","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modeling_tf_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modeling_tf_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"743ceb9025a7955d"}},{"code_sha256_prefix":"5168a172bbb363a5","entry":"convert_pytorch_state_dict_to_flax","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modeling_flax_pytorch_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modeling_flax_pytorch_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5168a172bbb363a5"}},{"code_sha256_prefix":"3c1eb64dde6b86af","entry":"dummy_loss","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modeling_tf_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modeling_tf_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3c1eb64dde6b86af"}},{"code_sha256_prefix":"dd8f7751ef859581","entry":"infer_metric_tags_from_eval_results","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modelcard.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modelcard.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dd8f7751ef859581"}},{"code_sha256_prefix":"6a3959a0ffd36577","entry":"keras_serializable","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modeling_tf_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modeling_tf_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6a3959a0ffd36577"}},{"code_sha256_prefix":"a4491b45d19b7a39","entry":"parse_keras_history","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modelcard.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modelcard.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a4491b45d19b7a39"}},{"code_sha256_prefix":"a66d2b78670c85e1","entry":"quick_gelu","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modeling_flax_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modeling_flax_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a66d2b78670c85e1"}},{"code_sha256_prefix":"61779b0406a59cfc","entry":"rename_key_and_reshape_tensor","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modeling_flax_pytorch_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modeling_flax_pytorch_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"61779b0406a59cfc"}},{"code_sha256_prefix":"f4075cdecbb730c5","entry":"check_imports","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/dynamic_module_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/dynamic_module_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f4075cdecbb730c5"}},{"code_sha256_prefix":"9d98806acb3144b7","entry":"dtype_byte_size","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modeling_flax_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modeling_flax_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9d98806acb3144b7"}},{"code_sha256_prefix":"e3ce70ca9258800e","entry":"flax_shard_checkpoint","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modeling_flax_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modeling_flax_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e3ce70ca9258800e"}},{"code_sha256_prefix":"00cc853a73f3aeb6","entry":"get_relative_import_files","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/dynamic_module_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/dynamic_module_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"00cc853a73f3aeb6"}},{"code_sha256_prefix":"450aeffe7f80f917","entry":"get_relative_imports","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/dynamic_module_utils.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/dynamic_module_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"450aeffe7f80f917"}},{"code_sha256_prefix":"ec7b1528a936234d","entry":"is_hf_dataset","repo":"openrobotlab/ov_parts","repo_kind":"official","path":"transformers/modelcard.py","file_url":"https://github.com/openrobotlab/ov_parts/blob/HEAD/transformers/modelcard.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ec7b1528a936234d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}