{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/isnet-integrate-image-level-and-semantic","title":"ISNet: Integrate Image-Level and Semantic-Level Context for Semantic Segmentation","arxiv_id":"2108.12382","date":"2021-08-27","proceeding":"ICCV 2021 10","authors":["Zhenchao Jin","Bin Liu","Qi Chu","Nenghai Yu"],"abstract":"Co-occurrent visual pattern makes aggregating contextual information a common paradigm to enhance the pixel representation for semantic image segmentation. The existing approaches focus on modeling the context from the perspective of the whole image, i.e., aggregating the image-level contextual information. Despite impressive, these methods weaken the significance of the pixel representations of the same category, i.e., the semantic-level contextual information. To address this, this paper proposes to augment the pixel representations by aggregating the image-level and semantic-level contextual information, respectively. First, an image-level context module is designed to capture the contextual information for each pixel in the whole image. Second, we aggregate the representations of the same category for each pixel where the category regions are learned under the supervision of the ground-truth segmentation. Third, we compute the similarities between each pixel representation and the image-level contextual information, the semantic-level contextual information, respectively. At last, a pixel representation is augmented by weighted aggregating both the image-level contextual information and the semantic-level contextual information with the similarities as the weights. Integrating the image-level and semantic-level context allows this paper to report state-of-the-art accuracy on four benchmarks, i.e., ADE20K, LIP, COCOStuff and Cityscapes.","url_abs":"https://arxiv.org/abs/2108.12382v1","url_pdf":"https://arxiv.org/pdf/2108.12382v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"isnet-integrate-image-level-and-semantic","repo_url":"https://github.com/segmentationblwx/sssegmentation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2108.12382","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2108.12382"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/segmentationblwx/sssegmentation","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":6},"by_repo_kind":{"official":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8164b80626d96e1c","entry":"BaseSegmentor","repo":"segmentationblwx/sssegmentation","repo_kind":"official","path":"ssseg/modules/models/segmentors/isnet/isnet.py","file_url":"https://github.com/segmentationblwx/sssegmentation/blob/HEAD/ssseg/modules/models/segmentors/isnet/isnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8164b80626d96e1c"}},{"code_sha256_prefix":"4fcc1754205ec369","entry":"ISNet","repo":"segmentationblwx/sssegmentation","repo_kind":"official","path":"ssseg/modules/models/segmentors/isnet/isnet.py","file_url":"https://github.com/segmentationblwx/sssegmentation/blob/HEAD/ssseg/modules/models/segmentors/isnet/isnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4fcc1754205ec369"}},{"code_sha256_prefix":"47f9bbb1a1cb2932","entry":"ImageLevelContext","repo":"segmentationblwx/sssegmentation","repo_kind":"official","path":"ssseg/modules/models/segmentors/isnet/isnet.py","file_url":"https://github.com/segmentationblwx/sssegmentation/blob/HEAD/ssseg/modules/models/segmentors/isnet/isnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"47f9bbb1a1cb2932"}},{"code_sha256_prefix":"9eb51459a81b0dff","entry":"SemanticLevelContext","repo":"segmentationblwx/sssegmentation","repo_kind":"official","path":"ssseg/modules/models/segmentors/isnet/isnet.py","file_url":"https://github.com/segmentationblwx/sssegmentation/blob/HEAD/ssseg/modules/models/segmentors/isnet/isnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9eb51459a81b0dff"}},{"code_sha256_prefix":"f13040fad8f617bb","entry":"calculateloss","repo":"segmentationblwx/sssegmentation","repo_kind":"official","path":"ssseg/modules/models/segmentors/isnet/isnet.py","file_url":"https://github.com/segmentationblwx/sssegmentation/blob/HEAD/ssseg/modules/models/segmentors/isnet/isnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f13040fad8f617bb"}},{"code_sha256_prefix":"6ab4243f8ce85bea","entry":"calculatelosses","repo":"segmentationblwx/sssegmentation","repo_kind":"official","path":"ssseg/modules/models/segmentors/isnet/isnet.py","file_url":"https://github.com/segmentationblwx/sssegmentation/blob/HEAD/ssseg/modules/models/segmentors/isnet/isnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6ab4243f8ce85bea"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}