{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/nitedr-nighttime-image-de-raining-with-cross","title":"NiteDR: Nighttime Image De-Raining with Cross-View Sensor Cooperative Learning for Dynamic Driving Scenes","arxiv_id":"2402.18172","date":"2024-02-28","proceeding":null,"authors":["Cidan Shi","Lihuang Fang","Han Wu","Xiaoyu Xian","Yukai Shi","Liang Lin"],"abstract":"In real-world environments, outdoor imaging systems are often affected by disturbances such as rain degradation. Especially, in nighttime driving scenes, insufficient and uneven lighting shrouds the scenes in darkness, resulting degradation of both the image quality and visibility. Particularly, in the field of autonomous driving, the visual perception ability of RGB sensors experiences a sharp decline in such harsh scenarios. Additionally, driving assistance systems suffer from reduced capabilities in capturing and discerning the surrounding environment, posing a threat to driving safety. Single-view information captured by single-modal sensors cannot comprehensively depict the entire scene. To address these challenges, we developed an image de-raining framework tailored for rainy nighttime driving scenes. It aims to remove rain artifacts, enrich scene representation, and restore useful information. Specifically, we introduce cooperative learning between visible and infrared images captured by different sensors. By cross-view fusion of these multi-source data, the scene within the images gains richer texture details and enhanced contrast. We constructed an information cleaning module called CleanNet as the first stage of our framework. Moreover, we designed an information fusion module called FusionNet as the second stage to fuse the clean visible images with infrared images. Using this stage-by-stage learning strategy, we obtain de-rained fusion images with higher quality and better visual perception. Extensive experiments demonstrate the effectiveness of our proposed Cross-View Cooperative Learning (CVCL) in adverse driving scenarios in low-light rainy environments. The proposed approach addresses the gap in the utilization of existing rain removal algorithms in specific low-light conditions.","url_abs":"https://arxiv.org/abs/2402.18172v2","url_pdf":"https://arxiv.org/pdf/2402.18172v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"nitedr-nighttime-image-de-raining-with-cross","repo_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"rain-removal","task_name":"Rain Removal"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2402.18172","atlas_url":"https://app.syntology.ai/?focus=2402.18172","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.18172"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining","reach":{"status":"ok"}}],"summary":{"ran":9,"ran_fixture":2,"unverified":2},"by_repo_kind":{"official":{"samples":11,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":13,"samples":[{"code_sha256_prefix":"7cbb04a462daa1fe","entry":"YCrCb2rgb","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"utils.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7cbb04a462daa1fe"}},{"code_sha256_prefix":"d0cd1206ff733044","entry":"calc_psnr","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"utils_image.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/utils_image.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d0cd1206ff733044"}},{"code_sha256_prefix":"ac7e5f845682283a","entry":"get_img_seq","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"utils.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ac7e5f845682283a"}},{"code_sha256_prefix":"d19e187b654b9154","entry":"get_patch","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"Fu_train.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/Fu_train.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d19e187b654b9154"}},{"code_sha256_prefix":"ac62432dc5134b0d","entry":"make_layers","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"vgg.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/vgg.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ac62432dc5134b0d"}},{"code_sha256_prefix":"b1c1acd3c89a39f3","entry":"quantize","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"utils_image.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/utils_image.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b1c1acd3c89a39f3"}},{"code_sha256_prefix":"a1190a52f547bf0d","entry":"rgb2YCrCb","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"utils.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a1190a52f547bf0d"}},{"code_sha256_prefix":"82a15cc1e46f7e4d","entry":"to_3d","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"82a15cc1e46f7e4d"}},{"code_sha256_prefix":"b20f2a5df739a59e","entry":"to_4d","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"b20f2a5df739a59e"}},{"code_sha256_prefix":"5e2ed862866e2532","entry":"vgg11","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"vgg.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/vgg.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5e2ed862866e2532"}},{"code_sha256_prefix":"d567ea1f3c15e875","entry":"vgg13","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"vgg.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/vgg.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d567ea1f3c15e875"}},{"code_sha256_prefix":"31dbda2e5a03e391","entry":"clean_process","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"Fu_train.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/Fu_train.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"31dbda2e5a03e391"}},{"code_sha256_prefix":"baa92b42cf87a142","entry":"get_weights_and_parameters","repo":"cidanshi/nitedr-nighttime-image-de-raining","repo_kind":"official","path":"Fu_train.py","file_url":"https://github.com/cidanshi/nitedr-nighttime-image-de-raining/blob/HEAD/Fu_train.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"baa92b42cf87a142"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}