{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/weakly-supervised-semantic-segmentation-with-2","title":"Weakly-Supervised Semantic Segmentation with Image-Level Labels: from Traditional Models to Foundation Models","arxiv_id":"2310.13026","date":"2023-10-19","proceeding":null,"authors":["Zhaozheng Chen","Qianru Sun"],"abstract":"The rapid development of deep learning has driven significant progress in image semantic segmentation - a fundamental task in computer vision. Semantic segmentation algorithms often depend on the availability of pixel-level labels (i.e., masks of objects), which are expensive, time-consuming, and labor-intensive. Weakly-supervised semantic segmentation (WSSS) is an effective solution to avoid such labeling. It utilizes only partial or incomplete annotations and provides a cost-effective alternative to fully-supervised semantic segmentation. In this journal, our focus is on the WSSS with image-level labels, which is the most challenging form of WSSS. Our work has two parts. First, we conduct a comprehensive survey on traditional methods, primarily focusing on those presented at premier research conferences. We categorize them into four groups based on where their methods operate: pixel-wise, image-wise, cross-image, and external data. Second, we investigate the applicability of visual foundation models, such as the Segment Anything Model (SAM), in the context of WSSS. We scrutinize SAM in two intriguing scenarios: text prompting and zero-shot learning. We provide insights into the potential and challenges of deploying visual foundational models for WSSS, facilitating future developments in this exciting research area.","url_abs":"https://arxiv.org/abs/2310.13026v2","url_pdf":"https://arxiv.org/pdf/2310.13026v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"weakly-supervised-semantic-segmentation-with-2","repo_url":"https://github.com/zhaozhengchen/sam_wsss","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"weakly-supervised-semantic-segmentation-1","task_name":"Weakly supervised Semantic Segmentation"},{"task_slug":"weakly-supervised-semantic-segmentation","task_name":"Weakly-Supervised Semantic Segmentation"},{"task_slug":"zero-shot-learning","task_name":"Zero-Shot Learning"}],"methods":[{"method_slug":"focus","method_name":"Focus"},{"method_slug":"sam","method_name":"SAM"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.13026","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.13026"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhaozhengchen/sam_wsss","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"ran_draft_wrong":1,"ran_fixture":1,"unverified":6},"by_repo_kind":{"official":{"samples":13,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e194cab1dccca09a","entry":"generate","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"Tag2Text/batch_inference.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/Tag2Text/batch_inference.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e194cab1dccca09a"}},{"code_sha256_prefix":"b4f24ac8435b57c1","entry":"inference","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"Tag2Text/batch_inference.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/Tag2Text/batch_inference.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b4f24ac8435b57c1"}},{"code_sha256_prefix":"7713626e31bbda13","entry":"inference","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"Tag2Text/inference_ram.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/Tag2Text/inference_ram.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7713626e31bbda13"}},{"code_sha256_prefix":"9b4c9877a282501e","entry":"inference","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"Tag2Text/inference_ram_zeroshot_class.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/Tag2Text/inference_ram_zeroshot_class.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b4c9877a282501e"}},{"code_sha256_prefix":"9ff2304ed114ed16","entry":"parse_xml_to_dict","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"sam_text_input_coco.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/sam_text_input_coco.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9ff2304ed114ed16"}},{"code_sha256_prefix":"5bd180a934a83565","entry":"reshape_transform","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"sam_text_input_coco.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/sam_text_input_coco.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5bd180a934a83565"}},{"code_sha256_prefix":"198c3be080d6e91e","entry":"split_dataset","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"sam_text_input_coco.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/sam_text_input_coco.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"198c3be080d6e91e"}},{"code_sha256_prefix":"957efa1b3700423a","entry":"build_sam_hq_vit_b","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"segment_anything/segment_anything/build_sam_hq.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/segment_anything/segment_anything/build_sam_hq.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"957efa1b3700423a"}},{"code_sha256_prefix":"50c73fdc283b7123","entry":"build_sam_hq_vit_h","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"segment_anything/segment_anything/build_sam_hq.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/segment_anything/segment_anything/build_sam_hq.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"50c73fdc283b7123"}},{"code_sha256_prefix":"19d2d2941e261783","entry":"build_sam_hq_vit_l","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"segment_anything/segment_anything/build_sam_hq.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/segment_anything/segment_anything/build_sam_hq.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"19d2d2941e261783"}},{"code_sha256_prefix":"f9bc5f31ce61cee8","entry":"build_sam_vit_b","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"segment_anything/segment_anything/build_sam.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/segment_anything/segment_anything/build_sam.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f9bc5f31ce61cee8"}},{"code_sha256_prefix":"6b77c1f11fff3ed6","entry":"build_sam_vit_h","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"segment_anything/segment_anything/build_sam.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/segment_anything/segment_anything/build_sam.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6b77c1f11fff3ed6"}},{"code_sha256_prefix":"3f8890e695469246","entry":"build_sam_vit_l","repo":"zhaozhengchen/sam_wsss","repo_kind":"official","path":"segment_anything/segment_anything/build_sam.py","file_url":"https://github.com/zhaozhengchen/sam_wsss/blob/HEAD/segment_anything/segment_anything/build_sam.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3f8890e695469246"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}