{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/bsafusion-a-bidirectional-stepwise-feature","title":"BSAFusion: A Bidirectional Stepwise Feature Alignment Network for Unaligned Medical Image Fusion","arxiv_id":"2412.08050","date":"2024-12-11","proceeding":null,"authors":["Huafeng Li","Dayong Su","Qing Cai","Yafei Zhang"],"abstract":"If unaligned multimodal medical images can be simultaneously aligned and fused using a single-stage approach within a unified processing framework, it will not only achieve mutual promotion of dual tasks but also help reduce the complexity of the model. However, the design of this model faces the challenge of incompatible requirements for feature fusion and alignment; specifically, feature alignment requires consistency among corresponding features, whereas feature fusion requires the features to be complementary to each other. To address this challenge, this paper proposes an unaligned medical image fusion method called Bidirectional Stepwise Feature Alignment and Fusion (BSFA-F) strategy. To reduce the negative impact of modality differences on cross-modal feature matching, we incorporate the Modal Discrepancy-Free Feature Representation (MDF-FR) method into BSFA-F. MDF-FR utilizes a Modality Feature Representation Head (MFRH) to integrate the global information of the input image. By injecting the information contained in MFRH of the current image into other modality images, it effectively reduces the impact of modality differences on feature alignment while preserving the complementary information carried by different images. In terms of feature alignment, BSFA-F employs a bidirectional stepwise alignment deformation field prediction strategy based on the path independence of vector displacement between two points. This strategy solves the problem of large spans and inaccurate deformation field prediction in single-step alignment. Finally, Multi-Modal Feature Fusion block achieves the fusion of aligned features. The experimental results across multiple datasets demonstrate the effectiveness of our method. The source code is available at https://github.com/slrl123/BSAFusion.","url_abs":"https://arxiv.org/abs/2412.08050v2","url_pdf":"https://arxiv.org/pdf/2412.08050v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"bsafusion-a-bidirectional-stepwise-feature","repo_url":"https://github.com/slrl123/bsafusion","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2412.08050","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2412.08050"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/slrl123/bsafusion","reach":{"status":"ok"}}],"summary":{"unverified":8},"by_repo_kind":{"official":{"samples":8,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"773f1babf7d9930d","entry":"L1_loss","repo":"slrl123/bsafusion","repo_kind":"official","path":"utils_2d/loss.py","file_url":"https://github.com/slrl123/bsafusion/blob/HEAD/utils_2d/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"773f1babf7d9930d"}},{"code_sha256_prefix":"ca607a1433d3a9a2","entry":"create_affine_transformation_matrix","repo":"slrl123/bsafusion","repo_kind":"official","path":"utils_2d/utils.py","file_url":"https://github.com/slrl123/bsafusion/blob/HEAD/utils_2d/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ca607a1433d3a9a2"}},{"code_sha256_prefix":"6567dbe79d2b3b98","entry":"flow_integration_ir","repo":"slrl123/bsafusion","repo_kind":"official","path":"modal_2d/RegFusion_lite.py","file_url":"https://github.com/slrl123/bsafusion/blob/HEAD/modal_2d/RegFusion_lite.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6567dbe79d2b3b98"}},{"code_sha256_prefix":"26d16ac5c45409d2","entry":"min_max","repo":"slrl123/bsafusion","repo_kind":"official","path":"dataset/BrainDataset_2D.py","file_url":"https://github.com/slrl123/bsafusion/blob/HEAD/dataset/BrainDataset_2D.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"26d16ac5c45409d2"}},{"code_sha256_prefix":"110bc4890e0ce118","entry":"non_affine","repo":"slrl123/bsafusion","repo_kind":"official","path":"utils_2d/utils.py","file_url":"https://github.com/slrl123/bsafusion/blob/HEAD/utils_2d/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"110bc4890e0ce118"}},{"code_sha256_prefix":"f78dcf637c59cac9","entry":"project","repo":"slrl123/bsafusion","repo_kind":"official","path":"BSAFusion_train.py","file_url":"https://github.com/slrl123/bsafusion/blob/HEAD/BSAFusion_train.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f78dcf637c59cac9"}},{"code_sha256_prefix":"6b2db085cc64cd05","entry":"r_loss","repo":"slrl123/bsafusion","repo_kind":"official","path":"utils_2d/loss.py","file_url":"https://github.com/slrl123/bsafusion/blob/HEAD/utils_2d/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6b2db085cc64cd05"}},{"code_sha256_prefix":"efc9226c593f78cd","entry":"ssim_loss","repo":"slrl123/bsafusion","repo_kind":"official","path":"utils_2d/loss.py","file_url":"https://github.com/slrl123/bsafusion/blob/HEAD/utils_2d/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"efc9226c593f78cd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}