{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mutual-guided-dynamic-network-for-image","title":"Mutual-Guided Dynamic Network for Image Fusion","arxiv_id":"2308.12538","date":"2023-08-24","proceeding":null,"authors":["Yuanshen Guan","Ruikang Xu","Mingde Yao","Lizhi Wang","Zhiwei Xiong"],"abstract":"Image fusion aims to generate a high-quality image from multiple images captured under varying conditions. The key problem of this task is to preserve complementary information while filtering out irrelevant information for the fused result. However, existing methods address this problem by leveraging static convolutional neural networks (CNNs), suffering two inherent limitations during feature extraction, i.e., being unable to handle spatial-variant contents and lacking guidance from multiple inputs. In this paper, we propose a novel mutual-guided dynamic network (MGDN) for image fusion, which allows for effective information utilization across different locations and inputs. Specifically, we design a mutual-guided dynamic filter (MGDF) for adaptive feature extraction, composed of a mutual-guided cross-attention (MGCA) module and a dynamic filter predictor, where the former incorporates additional guidance from different inputs and the latter generates spatial-variant kernels for different locations. In addition, we introduce a parallel feature fusion (PFF) module to effectively fuse local and global information of the extracted features. To further reduce the redundancy among the extracted features while simultaneously preserving their shared structural information, we devise a novel loss function that combines the minimization of normalized mutual information (NMI) with an estimated gradient mask. Experimental results on five benchmark datasets demonstrate that our proposed method outperforms existing methods on four image fusion tasks. The code and model are publicly available at: https://github.com/Guanys-dar/MGDN.","url_abs":"https://arxiv.org/abs/2308.12538v2","url_pdf":"https://arxiv.org/pdf/2308.12538v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mutual-guided-dynamic-network-for-image","repo_url":"https://github.com/guanys-dar/mgdn","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2308.12538","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.12538"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/guanys-dar/mgdn","reach":{"status":"ok"}}],"summary":{"ran":9,"unverified":5},"by_repo_kind":{"official":{"samples":14,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"2b960fadee1d8d32","entry":"define_F","repo":"guanys-dar/mgdn","repo_kind":"official","path":"models/select_network.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/models/select_network.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2b960fadee1d8d32"}},{"code_sha256_prefix":"d5bc647d990afa0f","entry":"define_Model","repo":"guanys-dar/mgdn","repo_kind":"official","path":"models/select_model.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/models/select_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d5bc647d990afa0f"}},{"code_sha256_prefix":"21ad939a92284e3f","entry":"find_last_checkpoint","repo":"guanys-dar/mgdn","repo_kind":"official","path":"utils/utils_model.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/utils/utils_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"21ad939a92284e3f"}},{"code_sha256_prefix":"236d44054916d8c6","entry":"get_model_activation","repo":"guanys-dar/mgdn","repo_kind":"official","path":"utils/utils_modelsummary.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/utils/utils_modelsummary.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"236d44054916d8c6"}},{"code_sha256_prefix":"ef0baf7f6dc2b269","entry":"remove_module","repo":"guanys-dar/mgdn","repo_kind":"official","path":"Inference_MGDN_MEF.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/Inference_MGDN_MEF.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ef0baf7f6dc2b269"}},{"code_sha256_prefix":"9d9797faa4a1aa94","entry":"setup","repo":"guanys-dar/mgdn","repo_kind":"official","path":"Inference_MGDN_MEF.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/Inference_MGDN_MEF.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9d9797faa4a1aa94"}},{"code_sha256_prefix":"8094cb64a822aac9","entry":"setup","repo":"guanys-dar/mgdn","repo_kind":"official","path":"Inference_MGDN_MFF.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/Inference_MGDN_MFF.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8094cb64a822aac9"}},{"code_sha256_prefix":"8afaf26fe2391d00","entry":"test","repo":"guanys-dar/mgdn","repo_kind":"official","path":"utils/utils_model.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/utils/utils_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8afaf26fe2391d00"}},{"code_sha256_prefix":"8dbcf37e2f8460e4","entry":"weights2tensor","repo":"guanys-dar/mgdn","repo_kind":"official","path":"utils/utils_matconvnet.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/utils/utils_matconvnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8dbcf37e2f8460e4"}},{"code_sha256_prefix":"46f02175c95e06d1","entry":"define_D","repo":"guanys-dar/mgdn","repo_kind":"official","path":"models/select_network.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/models/select_network.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"46f02175c95e06d1"}},{"code_sha256_prefix":"ea69fdcafe3acac4","entry":"define_G","repo":"guanys-dar/mgdn","repo_kind":"official","path":"models/select_network.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/models/select_network.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ea69fdcafe3acac4"}},{"code_sha256_prefix":"6ef91108ba92f025","entry":"get_model_complexity_info","repo":"guanys-dar/mgdn","repo_kind":"official","path":"utils/utils_modelsummary.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/utils/utils_modelsummary.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6ef91108ba92f025"}},{"code_sha256_prefix":"e39e724b057d5bec","entry":"get_model_flops","repo":"guanys-dar/mgdn","repo_kind":"official","path":"utils/utils_modelsummary.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/utils/utils_modelsummary.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e39e724b057d5bec"}},{"code_sha256_prefix":"fbc6fe6b67e310f3","entry":"valid","repo":"guanys-dar/mgdn","repo_kind":"official","path":"Inference_MGDN_GDSR.py","file_url":"https://github.com/guanys-dar/mgdn/blob/HEAD/Inference_MGDN_GDSR.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fbc6fe6b67e310f3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}