{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/fusionmamba-efficient-image-fusion-with-state","title":"FusionMamba: Efficient Remote Sensing Image Fusion with State Space Model","arxiv_id":"2404.07932","date":"2024-04-11","proceeding":null,"authors":["Siran Peng","Xiangyu Zhu","Haoyu Deng","Liang-Jian Deng","Zhen Lei"],"abstract":"Remote sensing image fusion aims to generate a high-resolution multi/hyper-spectral image by combining a high-resolution image with limited spectral data and a low-resolution image rich in spectral information. Current deep learning (DL) methods typically employ convolutional neural networks (CNNs) or Transformers for feature extraction and information integration. While CNNs are efficient, their limited receptive fields restrict their ability to capture global context. Transformers excel at learning global information but are computationally expensive. Recent advancements in the state space model (SSM), particularly Mamba, present a promising alternative by enabling global perception with low complexity. However, the potential of SSM for information integration remains largely unexplored. Therefore, we propose FusionMamba, an innovative method for efficient remote sensing image fusion. Our contributions are twofold. First, to effectively merge spatial and spectral features, we expand the single-input Mamba block to accommodate dual inputs, creating the FusionMamba block, which serves as a plug-and-play solution for information integration. Second, we incorporate Mamba and FusionMamba blocks into an interpretable network architecture tailored for remote sensing image fusion. Our designs utilize two U-shaped network branches, each primarily composed of four-directional Mamba blocks, to extract spatial and spectral features separately and hierarchically. The resulting feature maps are sufficiently merged in an auxiliary network branch constructed with FusionMamba blocks. Furthermore, we improve the representation of spectral information through an enhanced channel attention module. Quantitative and qualitative valuation results across six datasets demonstrate that our method achieves SOTA performance. The code is available at https://github.com/PSRben/FusionMamba.","url_abs":"https://arxiv.org/abs/2404.07932v3","url_pdf":"https://arxiv.org/pdf/2404.07932v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"fusionmamba-efficient-image-fusion-with-state","repo_url":"https://github.com/PSRben/FusionMamba","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"mamba","task_name":"Mamba"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2404.07932","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.07932"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/PSRben/FusionMamba","reach":{"status":"ok"}}],"summary":{"ran_honours":2,"ran":5},"by_repo_kind":{"official":{"samples":7,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"6dcedc9119590eb5","entry":"create_window","repo":"PSRben/FusionMamba","repo_kind":"official","path":"utils/tools.py","file_url":"https://github.com/PSRben/FusionMamba/blob/HEAD/utils/tools.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6dcedc9119590eb5"}},{"code_sha256_prefix":"c56b7ef16f309a45","entry":"gaussian","repo":"PSRben/FusionMamba","repo_kind":"official","path":"utils/tools.py","file_url":"https://github.com/PSRben/FusionMamba/blob/HEAD/utils/tools.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c56b7ef16f309a45"}},{"code_sha256_prefix":"bdc4273032c58caa","entry":"get_edge","repo":"PSRben/FusionMamba","repo_kind":"official","path":"utils/load_train_data.py","file_url":"https://github.com/PSRben/FusionMamba/blob/HEAD/utils/load_train_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bdc4273032c58caa"}},{"code_sha256_prefix":"f9e3ffc1c6330022","entry":"get_edge_h5py","repo":"PSRben/FusionMamba","repo_kind":"official","path":"utils/load_test_data.py","file_url":"https://github.com/PSRben/FusionMamba/blob/HEAD/utils/load_test_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f9e3ffc1c6330022"}},{"code_sha256_prefix":"6376c1ff4f8789e7","entry":"get_edge_mat","repo":"PSRben/FusionMamba","repo_kind":"official","path":"utils/load_test_data.py","file_url":"https://github.com/PSRben/FusionMamba/blob/HEAD/utils/load_test_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6376c1ff4f8789e7"}},{"code_sha256_prefix":"ee229909086a1b8f","entry":"load_mat","repo":"PSRben/FusionMamba","repo_kind":"official","path":"utils/load_test_data.py","file_url":"https://github.com/PSRben/FusionMamba/blob/HEAD/utils/load_test_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ee229909086a1b8f"}},{"code_sha256_prefix":"d383d091cdef3810","entry":"ssim","repo":"PSRben/FusionMamba","repo_kind":"official","path":"utils/tools.py","file_url":"https://github.com/PSRben/FusionMamba/blob/HEAD/utils/tools.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d383d091cdef3810"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}