{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cunsb-rfie-context-aware-unpaired-neural-schr","title":"CUNSB-RFIE: Context-aware Unpaired Neural Schr\"{o}dinger Bridge in Retinal Fundus Image Enhancement","arxiv_id":"2409.10966","date":"2024-09-17","proceeding":null,"authors":["Xuanzhao Dong","Vamsi Krishna Vasa","Wenhui Zhu","Peijie Qiu","Xiwen Chen","Yi Su","Yujian Xiong","Zhangsihao Yang","Yanxi Chen","Yalin Wang"],"abstract":"Retinal fundus photography is significant in diagnosing and monitoring retinal diseases. However, systemic imperfections and operator/patient-related factors can hinder the acquisition of high-quality retinal images. Previous efforts in retinal image enhancement primarily relied on GANs, which are limited by the trade-off between training stability and output diversity. In contrast, the Schr\\\"{o}dinger Bridge (SB), offers a more stable solution by utilizing Optimal Transport (OT) theory to model a stochastic differential equation (SDE) between two arbitrary distributions. This allows SB to effectively transform low-quality retinal images into their high-quality counterparts. In this work, we leverage the SB framework to propose an image-to-image translation pipeline for retinal image enhancement. Additionally, previous methods often fail to capture fine structural details, such as blood vessels. To address this, we enhance our pipeline by introducing Dynamic Snake Convolution, whose tortuous receptive field can better preserve tubular structures. We name the resulting retinal fundus image enhancement framework the Context-aware Unpaired Neural Schr\\\"{o}dinger Bridge (CUNSB-RFIE). To the best of our knowledge, this is the first endeavor to use the SB approach for retinal image enhancement. Experimental results on a large-scale dataset demonstrate the advantage of the proposed method compared to several state-of-the-art supervised and unsupervised methods in terms of image quality and performance on downstream tasks.The code is available at \\url{https://github.com/Retinal-Research/CUNSB-RFIE}.","url_abs":"https://arxiv.org/abs/2409.10966v1","url_pdf":"https://arxiv.org/pdf/2409.10966v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cunsb-rfie-context-aware-unpaired-neural-schr","repo_url":"https://github.com/retinal-research/cunsb-rfie","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"image-enhancement","task_name":"Image Enhancement"},{"task_slug":"image-to-image-translation","task_name":"Image-to-Image Translation"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.10966","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.10966"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/retinal-research/cunsb-rfie","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":4,"ran_draft_wrong":3,"ran_honours":1,"ran_fixture":1,"unverified":1},"by_repo_kind":{"official":{"samples":10,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"37a68ec0a708024d","entry":"cal_gradient_penalty","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/losses_sesim.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/losses_sesim.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"37a68ec0a708024d"}},{"code_sha256_prefix":"44c69c91b5434020","entry":"fused_leaky_relu","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/stylegan_networks.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/stylegan_networks.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"44c69c91b5434020"}},{"code_sha256_prefix":"acc24402a2d089fa","entry":"get_filter","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/ncsn_networks.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/ncsn_networks.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"acc24402a2d089fa"}},{"code_sha256_prefix":"a27960b817996d15","entry":"get_interpolated_feature","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/DSConv.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/DSConv.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"a27960b817996d15"}},{"code_sha256_prefix":"b27dffc0609fbec0","entry":"get_norm_layer","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/networks.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/networks.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b27dffc0609fbec0"}},{"code_sha256_prefix":"50aa4a59fe718c61","entry":"get_pad_layer","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/networks.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/networks.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"50aa4a59fe718c61"}},{"code_sha256_prefix":"4f8e8738883964be","entry":"get_timestep_embedding","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/ncsn_networks.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/ncsn_networks.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4f8e8738883964be"}},{"code_sha256_prefix":"4f24c959d9487279","entry":"get_timestep_embedding","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/stylegan_networks.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/stylegan_networks.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4f24c959d9487279"}},{"code_sha256_prefix":"200baf9e83c9a4de","entry":"upfirdn2d_native","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/stylegan_networks.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/stylegan_networks.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"200baf9e83c9a4de"}},{"code_sha256_prefix":"88c1b8b85995768e","entry":"get_coordinate_map_2D","repo":"retinal-research/cunsb-rfie","repo_kind":"official","path":"models/DSConv.py","file_url":"https://github.com/retinal-research/cunsb-rfie/blob/HEAD/models/DSConv.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"88c1b8b85995768e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}