{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/bsrt-improving-burst-super-resolution-with","title":"BSRT: Improving Burst Super-Resolution with Swin Transformer and Flow-Guided Deformable Alignment","arxiv_id":"2204.08332","date":"2022-04-18","proceeding":null,"authors":["Ziwei Luo","Youwei Li","Shen Cheng","Lei Yu","Qi Wu","Zhihong Wen","Haoqiang Fan","Jian Sun","Shuaicheng Liu"],"abstract":"This work addresses the Burst Super-Resolution (BurstSR) task using a new architecture, which requires restoring a high-quality image from a sequence of noisy, misaligned, and low-resolution RAW bursts. To overcome the challenges in BurstSR, we propose a Burst Super-Resolution Transformer (BSRT), which can significantly improve the capability of extracting inter-frame information and reconstruction. To achieve this goal, we propose a Pyramid Flow-Guided Deformable Convolution Network (Pyramid FG-DCN) and incorporate Swin Transformer Blocks and Groups as our main backbone. More specifically, we combine optical flows and deformable convolutions, hence our BSRT can handle misalignment and aggregate the potential texture information in multi-frames more efficiently. In addition, our Transformer-based structure can capture long-range dependency to further improve the performance. The evaluation on both synthetic and real-world tracks demonstrates that our approach achieves a new state-of-the-art in BurstSR task. Further, our BSRT wins the championship in the NTIRE2022 Burst Super-Resolution Challenge.","url_abs":"https://arxiv.org/abs/2204.08332v2","url_pdf":"https://arxiv.org/pdf/2204.08332v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"bsrt-improving-burst-super-resolution-with","repo_url":"https://github.com/algolzw/bsrt","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"burst-image-reconstruction","task_name":"Burst Image Reconstruction"},{"task_slug":"burst-image-super-resolution","task_name":"Burst Image Super-Resolution"},{"task_slug":"multi-frame-super-resolution","task_name":"Multi-Frame Super-Resolution"},{"task_slug":"optical-flow-estimation","task_name":"Optical Flow Estimation"},{"task_slug":"super-resolution","task_name":"Super-Resolution"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"deformable-convolution","method_name":"Deformable Convolution"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"stochastic-depth","method_name":"Stochastic Depth"},{"method_slug":"swin-transformer","method_name":"Swin Transformer"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/burst-image-super-resolution-on-burstsr","task":"Burst Image Super-Resolution","dataset":"BurstSR","model":"BSRT-Large","rank_in_archive_order":3,"of":9,"metrics":{"LPIPS":"0.021","PSNR":"48.57","SSIM":"0.986"},"uses_additional_data":false},{"leaderboard":"/sota/burst-image-super-resolution-on-burstsr","task":"Burst Image Super-Resolution","dataset":"BurstSR","model":"BSRT-Small","rank_in_archive_order":5,"of":9,"metrics":{"LPIPS":"0.021","PSNR":"48.48","SSIM":"0.985"},"uses_additional_data":false},{"leaderboard":"/sota/burst-image-super-resolution-on","task":"Burst Image Super-Resolution","dataset":"SyntheticBurst","model":"BSRT-Large","rank_in_archive_order":1,"of":8,"metrics":{"LPIPS":"0.025","PSNR":"43.62","SSIM":"0.975"},"uses_additional_data":false},{"leaderboard":"/sota/burst-image-super-resolution-on","task":"Burst Image Super-Resolution","dataset":"SyntheticBurst","model":"BSRT-Small","rank_in_archive_order":4,"of":8,"metrics":{"LPIPS":"0.031","PSNR":"42.72","SSIM":"0.971"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2204.08332","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.08332"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/algolzw/bsrt","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":1,"ran_draft_wrong":3,"ran_honours":1,"unverified":8},"by_repo_kind":{"official":{"samples":13,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"144d10b49baeb8a6","entry":"window_partition","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/swin_util.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/swin_util.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":2,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"144d10b49baeb8a6"}},{"code_sha256_prefix":"8b0e794d4d8f9b13","entry":"default_conv","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/common.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/common.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8b0e794d4d8f9b13"}},{"code_sha256_prefix":"c56b7ef16f309a45","entry":"gaussian","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/loss/mssim.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/loss/mssim.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c56b7ef16f309a45"}},{"code_sha256_prefix":"c04a23de0531da4a","entry":"make_layer","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/arch_util.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/arch_util.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c04a23de0531da4a"}},{"code_sha256_prefix":"61bf152e6a42a184","entry":"window_reverse","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/swin_util.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/swin_util.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"61bf152e6a42a184"}},{"code_sha256_prefix":"4207be9abb47f822","entry":"calculate_mask","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/swin_util.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/swin_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4207be9abb47f822"}},{"code_sha256_prefix":"12673020c3dd4547","entry":"conv_layer","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/arch_util.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/arch_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"12673020c3dd4547"}},{"code_sha256_prefix":"443341084ce76798","entry":"create_window","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/loss/mssim.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/loss/mssim.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"443341084ce76798"}},{"code_sha256_prefix":"0164a82edf7c189a","entry":"detach_variable","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/checkpoint.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/checkpoint.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0164a82edf7c189a"}},{"code_sha256_prefix":"ce51ac527b1a8912","entry":"lanczos_kernel","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/common.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/common.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce51ac527b1a8912"}},{"code_sha256_prefix":"cbfba08000a4b667","entry":"lanczos_shift","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/common.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/common.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cbfba08000a4b667"}},{"code_sha256_prefix":"b630516ce93f40f9","entry":"make_layer_idx","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/model/arch_util.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/model/arch_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b630516ce93f40f9"}},{"code_sha256_prefix":"8bcd6627e53013bf","entry":"ssim","repo":"algolzw/bsrt","repo_kind":"official","path":"code/real/bsrt/loss/mssim.py","file_url":"https://github.com/algolzw/bsrt/blob/HEAD/code/real/bsrt/loss/mssim.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8bcd6627e53013bf"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}