{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/rotated-multi-scale-interaction-network-for","title":"Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentation","arxiv_id":"2312.12470","date":"2023-12-19","proceeding":"CVPR 2024 1","authors":["Sihan Liu","Yiwei Ma","Xiaoqing Zhang","Haowei Wang","Jiayi Ji","Xiaoshuai Sun","Rongrong Ji"],"abstract":"Referring Remote Sensing Image Segmentation (RRSIS) is a new challenge that combines computer vision and natural language processing, delineating specific regions in aerial images as described by textual queries. Traditional Referring Image Segmentation (RIS) approaches have been impeded by the complex spatial scales and orientations found in aerial imagery, leading to suboptimal segmentation results. To address these challenges, we introduce the Rotated Multi-Scale Interaction Network (RMSIN), an innovative approach designed for the unique demands of RRSIS. RMSIN incorporates an Intra-scale Interaction Module (IIM) to effectively address the fine-grained detail required at multiple scales and a Cross-scale Interaction Module (CIM) for integrating these details coherently across the network. Furthermore, RMSIN employs an Adaptive Rotated Convolution (ARC) to account for the diverse orientations of objects, a novel contribution that significantly enhances segmentation accuracy. To assess the efficacy of RMSIN, we have curated an expansive dataset comprising 17,402 image-caption-mask triplets, which is unparalleled in terms of scale and variety. This dataset not only presents the model with a wide range of spatial and rotational scenarios but also establishes a stringent benchmark for the RRSIS task, ensuring a rigorous evaluation of performance. Our experimental evaluations demonstrate the exceptional performance of RMSIN, surpassing existing state-of-the-art models by a significant margin. All datasets and code are made available at https://github.com/Lsan2401/RMSIN.","url_abs":"https://arxiv.org/abs/2312.12470v3","url_pdf":"https://arxiv.org/pdf/2312.12470v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"rotated-multi-scale-interaction-network-for","repo_url":"https://github.com/lsan2401/rmsin","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"arc","task_name":"ARC"},{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2312.12470","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.12470"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lsan2401/rmsin","reach":{"status":"ok"}}],"summary":{"ran_fixture":1,"ran":8,"ran_draft_wrong":1,"unverified":4},"by_repo_kind":{"official":{"samples":14,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"144d10b49baeb8a6","entry":"window_partition","repo":"lsan2401/rmsin","repo_kind":"official","path":"lib/backbone.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/lib/backbone.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":2,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"144d10b49baeb8a6"}},{"code_sha256_prefix":"b239247b87d4f3dc","entry":"find_pruneable_heads_and_indices","repo":"lsan2401/rmsin","repo_kind":"official","path":"bert/modeling_utils.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/bert/modeling_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b239247b87d4f3dc"}},{"code_sha256_prefix":"de8700e1e2ede257","entry":"load_weights","repo":"lsan2401/rmsin","repo_kind":"official","path":"lib/_utils.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/lib/_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"de8700e1e2ede257"}},{"code_sha256_prefix":"22b41155e451683b","entry":"mish","repo":"lsan2401/rmsin","repo_kind":"official","path":"bert/modeling_bert.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/bert/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"22b41155e451683b"}},{"code_sha256_prefix":"452475fb6da97402","entry":"pad_if_smaller","repo":"lsan2401/rmsin","repo_kind":"official","path":"transforms.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/transforms.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"452475fb6da97402"}},{"code_sha256_prefix":"b3ee64494a3b6d38","entry":"prune_conv1d_layer","repo":"lsan2401/rmsin","repo_kind":"official","path":"bert/modeling_utils.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/bert/modeling_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b3ee64494a3b6d38"}},{"code_sha256_prefix":"a37615738b3ddcd3","entry":"prune_linear_layer","repo":"lsan2401/rmsin","repo_kind":"official","path":"bert/modeling_utils.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/bert/modeling_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a37615738b3ddcd3"}},{"code_sha256_prefix":"3f05c83630ea58a0","entry":"transIII_1x1_kxk","repo":"lsan2401/rmsin","repo_kind":"official","path":"lib/various_receptive.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/lib/various_receptive.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3f05c83630ea58a0"}},{"code_sha256_prefix":"3d03a81f4f36abda","entry":"transIV_depthconcat","repo":"lsan2401/rmsin","repo_kind":"official","path":"lib/various_receptive.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/lib/various_receptive.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3d03a81f4f36abda"}},{"code_sha256_prefix":"61bf152e6a42a184","entry":"window_reverse","repo":"lsan2401/rmsin","repo_kind":"official","path":"lib/backbone.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/lib/backbone.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"61bf152e6a42a184"}},{"code_sha256_prefix":"d4585e4e8e216bab","entry":"lavt","repo":"lsan2401/rmsin","repo_kind":"official","path":"lib/segmentation.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/lib/segmentation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d4585e4e8e216bab"}},{"code_sha256_prefix":"2944cc78660b63ff","entry":"lavt_one","repo":"lsan2401/rmsin","repo_kind":"official","path":"lib/segmentation.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/lib/segmentation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2944cc78660b63ff"}},{"code_sha256_prefix":"fb9398de2966d6de","entry":"load_tf_weights_in_bert","repo":"lsan2401/rmsin","repo_kind":"official","path":"bert/modeling_bert.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/bert/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fb9398de2966d6de"}},{"code_sha256_prefix":"079d0a85a0bfbb47","entry":"transI_fusebn","repo":"lsan2401/rmsin","repo_kind":"official","path":"lib/various_receptive.py","file_url":"https://github.com/lsan2401/rmsin/blob/HEAD/lib/various_receptive.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"079d0a85a0bfbb47"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}