Papers › Hierarchical Information Flow for Generalized Efficient Image Restoration

Hierarchical Information Flow for Generalized Efficient Image Restoration

27 Nov 2024arXiv:2411.18588archive 2025-07-28

Yawei Li, Bin Ren, Jingyun Liang, Rakesh Ranjan, Mengyuan Liu, Nicu Sebe, Ming-Hsuan Yang, Luca Benini

While vision transformers show promise in numerous image restoration (IR) tasks, the challenge remains in efficiently generalizing and scaling up a model for multiple IR tasks. To strike a balance between efficiency and model capacity for a generalized transformer-based IR method, we propose a hierarchical information flow mechanism for image restoration, dubbed Hi-IR, which progressively propagates information among pixels in a bottom-up manner. Hi-IR constructs a hierarchical information tree representing the degraded image across three levels. Each level encapsulates different types of information, with higher levels encompassing broader objects and concepts and lower levels focusing on local details. Moreover, the hierarchical tree architecture removes long-range self-attention, improves the computational efficiency and memory utilization, thus preparing it for effective model scaling. Based on that, we explore model scaling to improve our method's capabilities, which is expected to positively impact IR in large-scale training settings. Extensive experimental results show that Hi-IR achieves state-of-the-art performance in seven common image restoration tasks, affirming its effectiveness and generalizability.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Color Image DenoisingGrayscale Image DenoisingImage DeblurringImage RestorationImage Super-ResolutionJPEG Artifact CorrectionJPEG Artifact RemovalJpeg Compression Artifact Reduction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Color Image Denoising Kodak24 sigma15 Hi-IR PSNR 35.42 #2 of 2 Archive leaderboard report
Color Image Denoising Kodak24 sigma25 Hi-IR PSNR 33.01 #2 of 3 Archive leaderboard report
Color Image Denoising Kodak24 sigma50 Hi-IR PSNR 29.98 #5 of 9 Archive leaderboard report
Color Image Denoising McMaster sigma15 Hi-IR PSNR 35.69 #3 of 4 Archive leaderboard report
Color Image Denoising McMaster sigma25 Hi-IR PSNR 33.44 #3 of 4 Archive leaderboard report
Color Image Denoising McMaster sigma50 Hi-IR PSNR 30.42 #3 of 7 Archive leaderboard report
Color Image Denoising Urban100 sigma25 Hi-IR PSNR 33.34 #1 of 6 Archive leaderboard report
Color Image Denoising Urban100 sigma50 Hi-IR PSNR 30.59 #1 of 9 Archive leaderboard report
Color Image Denoising urban100 sigma15 Hi-IR PSNR 35.46 #8 of 8 Archive leaderboard report
Grayscale Image Denoising Set12 sigma15 Hi-IR PSNR 33.48 #1 of 8 Archive leaderboard report
Grayscale Image Denoising Set12 sigma25 Hi-IR PSNR 31.19 #1 of 6 Archive leaderboard report
Grayscale Image Denoising Set12 sigma50 Hi-IR PSNR 28.15 #1 of 8 Archive leaderboard report
Grayscale Image Denoising Urban100 sigma25 Hi-IR PSNR 31.92 #1 of 10 Archive leaderboard report
Grayscale Image Denoising Urban100 sigma50 Hi-IR PSNR 28.91 #1 of 10 Archive leaderboard report
Grayscale Image Denoising urban100 sigma15 Hi-IR PSNR 34.11 #1 of 3 Archive leaderboard report
Image Deblurring GoPro Hi-IR-L PSNR 33.99 #9 of 55 Archive leaderboard report
Image Deblurring HIDE (trained on GOPRO) Hi-IR-L PSNR 31.64 #1 of 3 Archive leaderboard report
Image Super-Resolution BSD100 - 2x upscaling Hi-IR-L PSNR 32.77 #5 of 30 Archive leaderboard report
Image Super-Resolution BSD100 - 2x upscaling Hi-IR-L SSIM 0.9092 #5 of 30 Archive leaderboard report
Image Super-Resolution BSD100 - 3x upscaling Hi-IR-L PSNR 29.67 #1 of 21 Archive leaderboard report
Image Super-Resolution BSD100 - 3x upscaling Hi-IR-L SSIM 0.8256 #1 of 21 Archive leaderboard report
Image Super-Resolution BSD100 - 4x upscaling Hi-IR-L PSNR 28.13 #2 of 71 Archive leaderboard report
Image Super-Resolution BSD100 - 4x upscaling Hi-IR-L SSIM 0.7622 #2 of 71 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling Hi-IR-L PSNR 41.22 #1 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 2x upscaling Hi-IR-L SSIM 0.9846 #1 of 21 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling Hi-IR-L PSNR 36.12 #1 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 3x upscaling Hi-IR-L SSIM 0.9588 #1 of 17 Archive leaderboard report
Image Super-Resolution Manga109 - 4x upscaling Hi-IR-L PSNR 33.13 #1 of 50 Archive leaderboard report
Image Super-Resolution Manga109 - 4x upscaling Hi-IR-L SSIM 0.9366 #1 of 50 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling Hi-IR-L PSNR 35.27 #4 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 2x upscaling Hi-IR-L SSIM 0.9311 #4 of 35 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling Hi-IR-L PSNR 31.55 #1 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 3x upscaling Hi-IR-L SSIM 0.8616 #1 of 24 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling Hi-IR-L PSNR 29.49 #3 of 104 Archive leaderboard report
Image Super-Resolution Set14 - 4x upscaling Hi-IR-L SSIM 0.8041 #3 of 104 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling Hi-IR-L PSNR 38.87 #4 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 2x upscaling Hi-IR-L SSIM 0.9663 #4 of 41 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling Hi-IR-L PSNR 35.2 #5 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 3x upscaling Hi-IR-L SSIM 0.938 #5 of 32 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling Hi-IR-L PSNR 33.22 #4 of 12 Archive leaderboard report
Image Super-Resolution Set5 - 4x upscaling Hi-IR-L SSIM 0.9103 #4 of 12 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling Hi-IR-L PSNR 35.16 #3 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 2x upscaling Hi-IR-L SSIM 0.9505 #3 of 29 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling Hi-IR-L PSNR 31.07 #1 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 3x upscaling Hi-IR-L SSIM 0.902 #1 of 22 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling Hi-IR-L PSNR 28.72 #1 of 65 Archive leaderboard report
Image Super-Resolution Urban100 - 4x upscaling Hi-IR-L SSIM 0.8514 #1 of 65 Archive leaderboard report
JPEG Artifact Correction BSD500 (Quality 10 Color) Hi-IR PSNR 28.35 #1 of 1 Archive leaderboard report
JPEG Artifact Correction BSD500 (Quality 10 Color) Hi-IR SSIM 0.8092 #1 of 1 Archive leaderboard report
JPEG Artifact Correction BSD500 (Quality 20 Color) Hi-IR PSNR 30.61 #1 of 1 Archive leaderboard report
JPEG Artifact Correction BSD500 (Quality 20 Color) Hi-IR SSIM 0.874 #1 of 1 Archive leaderboard report
JPEG Artifact Correction BSD500 (Quality 30 Color) Hi-IR PSNR 31.99 #1 of 1 Archive leaderboard report
JPEG Artifact Correction BSD500 (Quality 30 Color) Hi-IR SSIM 0.9035 #1 of 1 Archive leaderboard report
JPEG Artifact Correction BSD500 (Quality 40 Color) Hi-IR PSNR 32.92 #1 of 1 Archive leaderboard report
JPEG Artifact Correction BSD500 (Quality 40 Color) Hi-IR SSIM 0.9195 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Classic5 (Quality 10 Grayscale) Hi-IR PSNR 30.38 #1 of 7 Archive leaderboard report
JPEG Artifact Correction Classic5 (Quality 10 Grayscale) Hi-IR SSIM 0.8266 #1 of 7 Archive leaderboard report
JPEG Artifact Correction Classic5 (Quality 20 Grayscale) Hi-IR PSNR 32.62 #1 of 6 Archive leaderboard report
JPEG Artifact Correction Classic5 (Quality 20 Grayscale) Hi-IR SSIM 0.8751 #1 of 6 Archive leaderboard report
JPEG Artifact Correction Classic5 (Quality 30 Grayscale) Hi-IR PSNR 33.8 #1 of 6 Archive leaderboard report
JPEG Artifact Correction Classic5 (Quality 30 Grayscale) Hi-IR SSIM 0.8962 #1 of 6 Archive leaderboard report
JPEG Artifact Correction Classic5 (Quality 40 Grayscale) Hi-IR PSNR 34.61 #1 of 5 Archive leaderboard report
JPEG Artifact Correction Classic5 (Quality 40 Grayscale) Hi-IR SSIM 0.9082 #1 of 5 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 10 Color) Hi-IR PSNR 28.36 #1 of 9 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 10 Color) Hi-IR SSIM 0.818 #1 of 9 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 20 Color) Hi-IR PSNR 30.66 #1 of 9 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 20 Color) Hi-IR SSIM 0.8797 #1 of 9 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 20 Grayscale) Hi-IR PSNR 32.31 #1 of 12 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 20 Grayscale) Hi-IR SSIM 0.8938 #1 of 12 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 30 Color) Hi-IR PSNR 32.02 #1 of 3 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 30 Color) Hi-IR SSIM 0.9063 #1 of 3 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 30 Grayscale) Hi-IR PSNR 33.73 #1 of 7 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 30 Grayscale) Hi-IR SSIM 0.9223 #1 of 7 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 40 Color) Hi-IR PSNR 32.94 #1 of 1 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 40 Color) Hi-IR SSIM 0.921 #1 of 1 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 40 Grayscale) Hi-IR PSNR 34.71 #1 of 5 Archive leaderboard report
JPEG Artifact Correction LIVE1 (Quality 40 Grayscale) Hi-IR SSIM 0.9347 #1 of 5 Archive leaderboard report
JPEG Artifact Correction Live1 (Quality 10 Grayscale) Hi-IR PSNR 29.94 #1 of 13 Archive leaderboard report
JPEG Artifact Correction Live1 (Quality 10 Grayscale) Hi-IR SSIM 0.8359 #1 of 13 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 10 Color) Hi-IR PSNR 29.11 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 10 Color) Hi-IR SSIM 0.8727 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 10 Grayscale) Hi-IR PSNR 31.07 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 10 Grayscale) Hi-IR SSIM 0.895 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 20 Color) Hi-IR PSNR 31.36 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 20 Color) Hi-IR SSIM 0.9115 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 20 Grayscale) Hi-IR PSNR 33.51 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 20 Grayscale) Hi-IR SSIM 0.925 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 30 Color) Hi-IR PSNR 32.57 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 30 Color) Hi-IR SSIM 0.9279 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 30 Grayscale) Hi-IR PSNR 34.86 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 30 Grayscale) Hi-IR SSIM 0.9459 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 40 Color) Hi-IR PSNR 33.37 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 40 Color) Hi-IR SSIM 0.9373 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 40 Grayscale) Hi-IR PSNR 35.77 #1 of 1 Archive leaderboard report
JPEG Artifact Correction Urban100 (Quality 40 Grayscale) Hi-IR SSIM 0.9561 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections