{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/controlfusion-a-controllable-image-fusion","title":"ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Prompts","arxiv_id":"2503.23356","date":"2025-03-30","proceeding":null,"authors":["Linfeng Tang","Yeda Wang","Zhanchuan Cai","Junjun Jiang","Jiayi Ma"],"abstract":"Current image fusion methods struggle to address the composite degradations encountered in real-world imaging scenarios and lack the flexibility to accommodate user-specific requirements. In response to these challenges, we propose a controllable image fusion framework with language-vision prompts, termed ControlFusion, which adaptively neutralizes composite degradations. On the one hand, we develop a degraded imaging model that integrates physical imaging mechanisms, including the Retinex theory and atmospheric scattering principle, to simulate composite degradations, thereby providing potential for addressing real-world complex degradations from the data level. On the other hand, we devise a prompt-modulated restoration and fusion network that dynamically enhances features with degradation prompts, enabling our method to accommodate composite degradation of varying levels. Specifically, considering individual variations in quality perception of users, we incorporate a text encoder to embed user-specified degradation types and severity levels as degradation prompts. We also design a spatial-frequency collaborative visual adapter that autonomously perceives degradations in source images, thus eliminating the complete dependence on user instructions. Extensive experiments demonstrate that ControlFusion outperforms SOTA fusion methods in fusion quality and degradation handling, particularly in countering real-world and compound degradations with various levels.","url_abs":"https://arxiv.org/abs/2503.23356v1","url_pdf":"https://arxiv.org/pdf/2503.23356v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[],"methods":[{"method_slug":"adapter","method_name":"Adapter"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2503.23356","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.23356"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/Linfeng-Tang/ControlFusion","reach":null}],"summary":{"ran":4,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"81c9126ff30f676e","entry":"CBAM","repo":"Linfeng-Tang/ControlFusion","repo_kind":"found_in_text","path":"model/ControlFusion.py","file_url":"https://github.com/Linfeng-Tang/ControlFusion/blob/HEAD/model/ControlFusion.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"81c9126ff30f676e"}},{"code_sha256_prefix":"6a8e0a2cdf7f3144","entry":"ChannelAttention","repo":"Linfeng-Tang/ControlFusion","repo_kind":"found_in_text","path":"model/ControlFusion.py","file_url":"https://github.com/Linfeng-Tang/ControlFusion/blob/HEAD/model/ControlFusion.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6a8e0a2cdf7f3144"}},{"code_sha256_prefix":"f8dfe4829be56442","entry":"FeatureWiseAffine","repo":"Linfeng-Tang/ControlFusion","repo_kind":"found_in_text","path":"model/ControlFusion.py","file_url":"https://github.com/Linfeng-Tang/ControlFusion/blob/HEAD/model/ControlFusion.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f8dfe4829be56442"}},{"code_sha256_prefix":"4a9889e4b1b18fc3","entry":"SpatialAttention","repo":"Linfeng-Tang/ControlFusion","repo_kind":"found_in_text","path":"model/ControlFusion.py","file_url":"https://github.com/Linfeng-Tang/ControlFusion/blob/HEAD/model/ControlFusion.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4a9889e4b1b18fc3"}},{"code_sha256_prefix":"8c5aad72ddb1c773","entry":"ControlFusion","repo":"Linfeng-Tang/ControlFusion","repo_kind":"found_in_text","path":"model/ControlFusion.py","file_url":"https://github.com/Linfeng-Tang/ControlFusion/blob/HEAD/model/ControlFusion.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8c5aad72ddb1c773"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}