{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sam-assisted-remote-sensing-imagery-semantic","title":"SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraints","arxiv_id":"2312.02464","date":"2023-12-05","proceeding":null,"authors":["Xianping Ma","Qianqian Wu","Xingyu Zhao","Xiaokang Zhang","Man-on Pun","Bo Huang"],"abstract":"Semantic segmentation of remote sensing imagery plays a pivotal role in extracting precise information for diverse down-stream applications. Recent development of the Segment Anything Model (SAM), an advanced general-purpose segmentation model, has revolutionized this field, presenting new avenues for accurate and efficient segmentation. However, SAM is limited to generating segmentation results without class information. Consequently, the utilization of such a powerful general vision model for semantic segmentation in remote sensing images has become a focal point of research. In this paper, we present a streamlined framework aimed at leveraging the raw output of SAM by exploiting two novel concepts called SAM-Generated Object (SGO) and SAM-Generated Boundary (SGB). More specifically, we propose a novel object loss and further introduce a boundary loss as augmentative components to aid in model optimization in a general semantic segmentation framework. Taking into account the content characteristics of SGO, we introduce the concept of object consistency to leverage segmented regions lacking semantic information. By imposing constraints on the consistency of predicted values within objects, the object loss aims to enhance semantic segmentation performance. Furthermore, the boundary loss capitalizes on the distinctive features of SGB by directing the model's attention to the boundary information of the object. Experimental results on two well-known datasets, namely ISPRS Vaihingen and LoveDA Urban, demonstrate the effectiveness of our proposed method. The source code for this work will be accessible at https://github.com/sstary/SSRS.","url_abs":"https://arxiv.org/abs/2312.02464v2","url_pdf":"https://arxiv.org/pdf/2312.02464v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sam-assisted-remote-sensing-imagery-semantic","repo_url":"https://github.com/sstary/ssrs","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"sam-assisted-remote-sensing-imagery-semantic","repo_url":"https://github.com/ctrlovefly/df4lcz","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"model-optimization","task_name":"Model Optimization"},{"task_slug":"novel-concepts","task_name":"Novel Concepts"},{"task_slug":"object","task_name":"Object"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"segmentation-of-remote-sensing-imagery","task_name":"Segmentation Of Remote Sensing Imagery"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"sam","method_name":"SAM"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2312.02464","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.02464"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ctrlovefly/df4lcz","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sstary/ssrs","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":13},"by_repo_kind":{"listed":{"samples":13,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3401d0b189909f84","entry":"cohen_kappa","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"fusion.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/fusion.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3401d0b189909f84"}},{"code_sha256_prefix":"4dd45258f3b7cd08","entry":"convert_to_binary_adjacency","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"data_loader_single.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/data_loader_single.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4dd45258f3b7cd08"}},{"code_sha256_prefix":"7a157ccf306a9b96","entry":"convolutional_block","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7a157ccf306a9b96"}},{"code_sha256_prefix":"f0506533eea30438","entry":"dense_block","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"model.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f0506533eea30438"}},{"code_sha256_prefix":"a950387c2c634731","entry":"get_model","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"call_model.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/call_model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a950387c2c634731"}},{"code_sha256_prefix":"2ce069bd528094fd","entry":"identity_block","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ce069bd528094fd"}},{"code_sha256_prefix":"3e9fda97b5d4ccf3","entry":"overall_accuracy_last_classes","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"fusion.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/fusion.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3e9fda97b5d4ccf3"}},{"code_sha256_prefix":"1b2799c803962944","entry":"overall_accuracy_top_classes","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"fusion.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/fusion.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1b2799c803962944"}},{"code_sha256_prefix":"d7a2e386f04634f5","entry":"se_block","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d7a2e386f04634f5"}},{"code_sha256_prefix":"5f189803b90f4a97","entry":"step_decay_schedule","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"lr.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/lr.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f189803b90f4a97"}},{"code_sha256_prefix":"6736ce9253a49a0d","entry":"to_one_hot","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"data_loader_single.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/data_loader_single.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6736ce9253a49a0d"}},{"code_sha256_prefix":"bca427442a2f9bbe","entry":"transition_block","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"model.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bca427442a2f9bbe"}},{"code_sha256_prefix":"aa78d3677c5d9a1d","entry":"xywh_to_center","repo":"ctrlovefly/df4lcz","repo_kind":"listed","path":"testmask.py","file_url":"https://github.com/ctrlovefly/df4lcz/blob/HEAD/testmask.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aa78d3677c5d9a1d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}