{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sparse-sampling-transformer-with-uncertainty","title":"Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streaks","arxiv_id":"2308.14153","date":"2023-08-27","proceeding":"ICCV 2023 1","authors":["Sixiang Chen","Tian Ye","Jinbin Bai","ErKang Chen","Jun Shi","Lei Zhu"],"abstract":"In the real world, image degradations caused by rain often exhibit a combination of rain streaks and raindrops, thereby increasing the challenges of recovering the underlying clean image. Note that the rain streaks and raindrops have diverse shapes, sizes, and locations in the captured image, and thus modeling the correlation relationship between irregular degradations caused by rain artifacts is a necessary prerequisite for image deraining. This paper aims to present an efficient and flexible mechanism to learn and model degradation relationships in a global view, thereby achieving a unified removal of intricate rain scenes. To do so, we propose a Sparse Sampling Transformer based on Uncertainty-Driven Ranking, dubbed UDR-S2Former. Compared to previous methods, our UDR-S2Former has three merits. First, it can adaptively sample relevant image degradation information to model underlying degradation relationships. Second, explicit application of the uncertainty-driven ranking strategy can facilitate the network to attend to degradation features and understand the reconstruction process. Finally, experimental results show that our UDR-S2Former clearly outperforms state-of-the-art methods for all benchmarks.","url_abs":"https://arxiv.org/abs/2308.14153v1","url_pdf":"https://arxiv.org/pdf/2308.14153v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sparse-sampling-transformer-with-uncertainty","repo_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"rain-removal","task_name":"Rain Removal"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2308.14153","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.14153"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Ephemeral182/UDR-S2Former_deraining","reach":null}],"summary":{"ran":7,"ran_fixture":3,"ran_draft_wrong":1,"unverified":6},"by_repo_kind":{"official":{"samples":15,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":17,"samples":[{"code_sha256_prefix":"e505e5b4c6c05324","entry":"Attention","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e505e5b4c6c05324"}},{"code_sha256_prefix":"0c94ca3829ffbf2a","entry":"CALayer","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0c94ca3829ffbf2a"}},{"code_sha256_prefix":"f2cb8865abc71d7b","entry":"Local_Reconstruction","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f2cb8865abc71d7b"}},{"code_sha256_prefix":"a66a16cc66d05c73","entry":"MFFN","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a66a16cc66d05c73"}},{"code_sha256_prefix":"808687d27e8153df","entry":"Refine","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"808687d27e8153df"}},{"code_sha256_prefix":"3295f55d5d3d8a9d","entry":"Refine_Block","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3295f55d5d3d8a9d"}},{"code_sha256_prefix":"97d59e71977a3409","entry":"SALayer","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"97d59e71977a3409"}},{"code_sha256_prefix":"b1d0826f40fc7925","entry":"_to_channel_first","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b1d0826f40fc7925"}},{"code_sha256_prefix":"9cac1208ec415f9a","entry":"_to_channel_last","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9cac1208ec415f9a"}},{"code_sha256_prefix":"dd907925970ddfba","entry":"window_partition","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"dd907925970ddfba"}},{"code_sha256_prefix":"f4c2cb74d3356bc2","entry":"window_reverse","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"f4c2cb74d3356bc2"}},{"code_sha256_prefix":"289066a83594258a","entry":"Reconstruction_Module","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"289066a83594258a"}},{"code_sha256_prefix":"29783b729413c6df","entry":"Reconstruction_Module_layer","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"29783b729413c6df"}},{"code_sha256_prefix":"28975d206a409582","entry":"Refine_stage","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"28975d206a409582"}},{"code_sha256_prefix":"c73433459c1cc399","entry":"SparseSamplingAttention","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c73433459c1cc399"}},{"code_sha256_prefix":"28f73f8883f04c99","entry":"Transformer","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"28f73f8883f04c99"}},{"code_sha256_prefix":"f633af10438188ed","entry":"Transformer_block","repo":"Ephemeral182/UDR-S2Former_deraining","repo_kind":"official","path":"UDR_S2Former.py","file_url":"https://github.com/Ephemeral182/UDR-S2Former_deraining/blob/HEAD/UDR_S2Former.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f633af10438188ed"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}