Papers › ML-CrAIST: Multi-scale Low-high Frequency Information-based Cross black Attention with...

ML-CrAIST: Multi-scale Low-high Frequency Information-based Cross black Attention with Image Super-resolving Transformer

19 Aug 2024arXiv:2408.09940archive 2025-07-28

Alik Pramanick, Utsav Bheda, Arijit Sur

Recently, transformers have captured significant interest in the area of single-image super-resolution tasks, demonstrating substantial gains in performance. Current models heavily depend on the network's extensive ability to extract high-level semantic details from images while overlooking the effective utilization of multi-scale image details and intermediate information within the network. Furthermore, it has been observed that high-frequency areas in images present significant complexity for super-resolution compared to low-frequency areas. This work proposes a transformer-based super-resolution architecture called ML-CrAIST that addresses this gap by utilizing low-high frequency information in multiple scales. Unlike most of the previous work (either spatial or channel), we operate spatial and channel self-attention, which concurrently model pixel interaction from both spatial and channel dimensions, exploiting the inherent correlations across spatial and channel axis. Further, we devise a cross-attention block for super-resolution, which explores the correlations between low and high-frequency information. Quantitative and qualitative assessments indicate that our proposed ML-CrAIST surpasses state-of-the-art super-resolution methods (e.g., 0.15 dB gain @Manga109 ×4). Code is available on: https://github.com/Alik033/ML-CrAIST.

PaperPDFCode

Code

alik033/ml-craist officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image Super-ResolutionSuper-Resolution

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Super-Resolution 2x upscaling ML-CrAIST #params (K) 1259 #1 of 2 Archive leaderboard report
Image Super-Resolution 2x upscaling ML-CrAIST FLOPs(G) 165.7 #1 of 2 Archive leaderboard report
Image Super-Resolution 2x upscaling ML-CrAIST-Li #params (K) 743 #2 of 2 Archive leaderboard report
Image Super-Resolution 2x upscaling ML-CrAIST-Li FLOPs(G) 97.2 #2 of 2 Archive leaderboard report
Image Super-Resolution 3x upscaling ML-CrAIST #params (K) 1268 #1 of 2 Archive leaderboard report
Image Super-Resolution 3x upscaling ML-CrAIST FLOPs(G) 84.1 #1 of 2 Archive leaderboard report
Image Super-Resolution 3x upscaling ML-CrAIST-Li #params (K) 749 #2 of 2 Archive leaderboard report
Image Super-Resolution 3x upscaling ML-CrAIST-Li FLOPs(G) 49.6 #2 of 2 Archive leaderboard report
Image Super-Resolution 4x upscaling ML-CrAIST #params (K) 1280 #1 of 2 Archive leaderboard report
Image Super-Resolution 4x upscaling ML-CrAIST FLOPs(G) 42.9 #1 of 2 Archive leaderboard report
Image Super-Resolution 4x upscaling ML-CrAIST-Li #params (K) 758 #2 of 2 Archive leaderboard report
Image Super-Resolution 4x upscaling ML-CrAIST-Li FLOPs(G) 25.5 #2 of 2 Archive leaderboard report
Image Super-Resolution B100 - 2x upscaling ML-CrAIST SSIM 0.9022 #1 of 2 Archive leaderboard report
Image Super-Resolution B100 - 2x upscaling ML-CrAIST-Li PSNR 32.36 #2 of 2 Archive leaderboard report
Image Super-Resolution B100 - 2x upscaling ML-CrAIST-Li SSIM 0.902 #2 of 2 Archive leaderboard report
Image Super-Resolution B100 - 3x upscaling ML-CrAIST SSIM 0.8111 #1 of 2 Archive leaderboard report
Image Super-Resolution B100 - 3x upscaling ML-CrAIST-Li PSNR 29.28 #2 of 2 Archive leaderboard report
Image Super-Resolution B100 - 3x upscaling ML-CrAIST-Li SSIM 0.8106 #2 of 2 Archive leaderboard report
Image Super-Resolution B100 - 4x upscaling ML-CrAIST PSNR 27.78 #1 of 2 Archive leaderboard report
Image Super-Resolution B100 - 4x upscaling ML-CrAIST SSIM 0.7446 #1 of 2 Archive leaderboard report
Image Super-Resolution B100 - 4x upscaling ML-CrAIST-Li PSNR 27.73 #2 of 2 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling ML-CrAIST PSNR 39.26 #16 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling ML-CrAIST SSIM 0.9786 #16 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling ML-CrAIST-Li PSNR 39.23 #17 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling ML-CrAIST-Li SSIM 0.9785 #17 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling ML-CrAIST PSNR 34.42 #12 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling ML-CrAIST SSIM 0.9501 #12 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling ML-CrAIST-Li PSNR 34.26 #13 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling ML-CrAIST-Li SSIM 0.9492 #13 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 4x upscaling ML-CrAIST PSNR 31.17 #29 of 50 Archive leaderboard report
Image Super-Resolution Manga109 - 4x upscaling ML-CrAIST SSIM 0.9176 #29 of 50 Archive leaderboard report
Image Super-Resolution Manga109 - 4x upscaling ML-CrAIST-Li PSNR 31.11 #32 of 50 Archive leaderboard report
Image Super-Resolution Manga109 - 4x upscaling ML-CrAIST-Li SSIM 0.9162 #32 of 50 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling ML-CrAIST PSNR 33.77 #21 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling ML-CrAIST SSIM 0.922 #21 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling ML-CrAIST-Li PSNR 33.64 #23 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling ML-CrAIST-Li SSIM 0.9213 #23 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling ML-CrAIST PSNR 30.39 #15 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling ML-CrAIST SSIM 0.8488 #15 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling ML-CrAIST-Li PSNR 30.23 #17 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling ML-CrAIST-Li SSIM 0.8474 #17 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling ML-CrAIST PSNR 28.53 #61 of 104 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling ML-CrAIST SSIM 0.7895 #61 of 104 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling ML-CrAIST-Li PSNR 28.4 #68 of 104 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling ML-CrAIST-Li SSIM 0.7863 #68 of 104 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling ML-CrAIST PSNR 38.19 #21 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling ML-CrAIST SSIM 0.9617 #21 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling ML-CrAIST-Li PSNR 38.15 #22 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling ML-CrAIST-Li SSIM 0.9615 #22 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling ML-CrAIST PSNR 34.7 #17 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling ML-CrAIST SSIM 0.9302 #17 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling ML-CrAIST-Li PSNR 34.58 #21 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling ML-CrAIST-Li SSIM 0.9294 #21 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling ML-CrAIST PSNR 32.36 #9 of 12 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling ML-CrAIST SSIM 0.8984 #9 of 12 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling ML-CrAIST-Li PSNR 32.15 #10 of 12 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling ML-CrAIST-Li SSIM 0.8962 #10 of 12 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling ML-CrAIST PSNR 33.04 #16 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling ML-CrAIST SSIM 0.937 #16 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling ML-CrAIST-Li PSNR 32.93 #17 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling ML-CrAIST-Li SSIM 0.9361 #17 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling ML-CrAIST PSNR 28.89 #14 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling ML-CrAIST SSIM 0.8676 #14 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling ML-CrAIST-Li PSNR 28.73 #17 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling ML-CrAIST-Li SSIM 0.8651 #17 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling ML-CrAIST PSNR 26.68 #30 of 65 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling ML-CrAIST SSIM 0.8057 #30 of 65 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling ML-CrAIST-Li PSNR 26.53 #36 of 65 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling ML-CrAIST-Li SSIM 0.8019 #36 of 65 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections