Papers › Channel-Partitioned Windowed Attention And Frequency Learning for Single Image Super-Resolution

Channel-Partitioned Windowed Attention And Frequency Learning for Single Image Super-Resolution

23 Jul 2024arXiv:2407.16232archive 2025-07-28

Dinh Phu Tran, Dao Duy Hung, Daeyoung Kim

Recently, window-based attention methods have shown great potential for computer vision tasks, particularly in Single Image Super-Resolution (SISR). However, it may fall short in capturing long-range dependencies and relationships between distant tokens. Additionally, we find that learning on spatial domain does not convey the frequency content of the image, which is a crucial aspect in SISR. To tackle these issues, we propose a new Channel-Partitioned Attention Transformer (CPAT) to better capture long-range dependencies by sequentially expanding windows along the height and width of feature maps. In addition, we propose a novel Spatial-Frequency Interaction Module (SFIM), which incorporates information from spatial and frequency domains to provide a more comprehensive information from feature maps. This includes information about the frequency content and enhances the receptive field across the entire image. Experimental findings show the effectiveness of our proposed modules and architecture. In particular, CPAT surpasses current state-of-the-art methods by up to 0.31dB at x2 SR on Urban100.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image Super-ResolutionSuper-Resolution

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Super-Resolution BSD100 - 2x upscaling CPAT+ PSNR 32.66 #10 of 30 Archive leaderboard report
Image Super-Resolution BSD100 - 2x upscaling CPAT+ SSIM 0.9058 #10 of 30 Archive leaderboard report
Image Super-Resolution BSD100 - 2x upscaling CPAT PSNR 32.64 #11 of 30 Archive leaderboard report
Image Super-Resolution BSD100 - 2x upscaling CPAT SSIM 0.9056 #11 of 30 Archive leaderboard report
Image Super-Resolution BSD100 - 3x upscaling CPAT+ PSNR 29.59 #6 of 21 Archive leaderboard report
Image Super-Resolution BSD100 - 3x upscaling CPAT+ SSIM 0.8177 #6 of 21 Archive leaderboard report
Image Super-Resolution BSD100 - 3x upscaling CPAT PSNR 29.56 #7 of 21 Archive leaderboard report
Image Super-Resolution BSD100 - 3x upscaling CPAT SSIM 0.8174 #7 of 21 Archive leaderboard report
Image Super-Resolution BSD100 - 4x upscaling CPAT+ PSNR 28.06 #7 of 71 Archive leaderboard report
Image Super-Resolution BSD100 - 4x upscaling CPAT+ SSIM 0.7532 #7 of 71 Archive leaderboard report
Image Super-Resolution BSD100 - 4x upscaling CPAT PSNR 28.04 #9 of 71 Archive leaderboard report
Image Super-Resolution BSD100 - 4x upscaling CPAT SSIM 0.7527 #9 of 71 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling CPAT+ PSNR 40.59 #8 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling CPAT+ SSIM 0.9816 #8 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling CPAT PSNR 40.48 #9 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling CPAT SSIM 0.9814 #9 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling CPAT+ PSNR 35.77 #7 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling CPAT+ SSIM 0.9563 #7 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling CPAT PSNR 35.66 #8 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling CPAT SSIM 0.9559 #8 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 4x upscaling CPAT+ PSNR 32.85 #7 of 50 Archive leaderboard report
Image Super-Resolution Manga109 - 4x upscaling CPAT+ SSIM 0.9318 #7 of 50 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling CPAT+ PSNR 34.97 #7 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling CPAT+ SSIM 0.9280 #7 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling CPAT PSNR 34.91 #10 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling CPAT SSIM 0.9277 #10 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling CPAT+ PSNR 31.19 #7 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling CPAT+ SSIM 0.8559 #7 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling CPAT PSNR 31.15 #8 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling CPAT SSIM 0.8557 #8 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling CPAT+ PSNR 29.36 #8 of 104 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling CPAT+ SSIM 0.7996 #8 of 104 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling CPAT PSNR 29.34 #10 of 104 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling CPAT SSIM 0.7991 #10 of 104 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling CPAT+ PSNR 38.72 #8 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling CPAT+ SSIM 0.9635 #8 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling CPAT PSNR 38.68 #9 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling CPAT SSIM 0.9633 #9 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling CPAT+ PSNR 35.19 #6 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling CPAT+ SSIM 0.9335 #6 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling CPAT PSNR 35.16 #9 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling CPAT SSIM 0.9334 #9 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling CPAT+ PSNR 33.24 #3 of 12 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling CPAT+ SSIM 0.9071 #3 of 12 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling CPAT PSNR 33.19 #5 of 12 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling CPAT SSIM 0.9069 #5 of 12 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling CPAT+ PSNR 34.89 #6 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling CPAT+ SSIM 0.9487 #6 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling CPAT PSNR 34.76 #8 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling CPAT SSIM 0.9481 #8 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling CPAT+ PSNR 30.63 #6 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling CPAT+ SSIM 0.8934 #6 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling CPAT PSNR 30.52 #7 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling CPAT SSIM 0.8923 #7 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling CPAT+ PSNR 28.33 #8 of 65 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling CPAT+ SSIM 0.8425 #8 of 65 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling CPAT PSNR 28.22 #9 of 65 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling CPAT SSIM 0.8408 #9 of 65 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionBPEDense ConnectionsDropoutLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections