{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/omg-seg-is-one-model-good-enough-for-all","title":"OMG-Seg: Is One Model Good Enough For All Segmentation?","arxiv_id":"2401.10229","date":"2024-01-18","proceeding":"CVPR 2024 1","authors":["Xiangtai Li","Haobo Yuan","Wei Li","Henghui Ding","Size Wu","Wenwei Zhang","Yining Li","Kai Chen","Chen Change Loy"],"abstract":"In this work, we address various segmentation tasks, each traditionally tackled by distinct or partially unified models. We propose OMG-Seg, One Model that is Good enough to efficiently and effectively handle all the segmentation tasks, including image semantic, instance, and panoptic segmentation, as well as their video counterparts, open vocabulary settings, prompt-driven, interactive segmentation like SAM, and video object segmentation. To our knowledge, this is the first model to handle all these tasks in one model and achieve satisfactory performance. We show that OMG-Seg, a transformer-based encoder-decoder architecture with task-specific queries and outputs, can support over ten distinct segmentation tasks and yet significantly reduce computational and parameter overhead across various tasks and datasets. We rigorously evaluate the inter-task influences and correlations during co-training. Code and models are available at https://github.com/lxtGH/OMG-Seg.","url_abs":"https://arxiv.org/abs/2401.10229v2","url_pdf":"https://arxiv.org/pdf/2401.10229v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"omg-seg-is-one-model-good-enough-for-all","repo_url":"https://github.com/lxtgh/omg-seg","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"all","task_name":"All"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"interactive-segmentation","task_name":"Interactive Segmentation"},{"task_slug":"panoptic-segmentation","task_name":"Panoptic Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"video-object-segmentation","task_name":"Video Object Segmentation"},{"task_slug":"video-semantic-segmentation","task_name":"Video Semantic Segmentation"}],"methods":[{"method_slug":"sam","method_name":"SAM"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2401.10229","atlas_url":"https://app.syntology.ai/?focus=2401.10229","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2401.10229"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lxtgh/omg-seg","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/lxtGH/OMG-Seg","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":2,"unverified":2},"by_repo_kind":{"official":{"samples":4,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"34bdcec7a7a92c58","entry":"mask_pool","repo":"lxtGH/OMG-Seg","repo_kind":"official","path":"omg_llava/omg_llava/model/omg_seg/utils.py","file_url":"https://github.com/lxtGH/OMG-Seg/blob/HEAD/omg_llava/omg_llava/model/omg_seg/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"34bdcec7a7a92c58"}},{"code_sha256_prefix":"c43421dd4af62490","entry":"prepare_seg_pretrain_data","repo":"lxtGH/OMG-Seg","repo_kind":"official","path":"omg_llava/omg_llava/model/omg_llava.py","file_url":"https://github.com/lxtGH/OMG-Seg/blob/HEAD/omg_llava/omg_llava/model/omg_llava.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c43421dd4af62490"}},{"code_sha256_prefix":"dcdc7ef233f3e1e8","entry":"build_model","repo":"lxtGH/OMG-Seg","repo_kind":"official","path":"omg_llava/xtuner/apis/model.py","file_url":"https://github.com/lxtGH/OMG-Seg/blob/HEAD/omg_llava/xtuner/apis/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dcdc7ef233f3e1e8"}},{"code_sha256_prefix":"5d262d036acd1009","entry":"get_center_coords","repo":"lxtGH/OMG-Seg","repo_kind":"official","path":"omg_llava/omg_llava/model/omg_seg/mask2former_vid_semanticsam.py","file_url":"https://github.com/lxtGH/OMG-Seg/blob/HEAD/omg_llava/omg_llava/model/omg_seg/mask2former_vid_semanticsam.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5d262d036acd1009"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}