Papers › Joint multi-dimensional dynamic attention and transformer for general image restoration

Joint multi-dimensional dynamic attention and transformer for general image restoration

12 Nov 2024arXiv:2411.07893archive 2025-07-28

huan zhang, Xu Zhang, Nian Cai, Jianglei Di, Yun Zhang

Outdoor images often suffer from severe degradation due to rain, haze, and noise, impairing image quality and challenging high-level tasks. Current image restoration methods struggle to handle complex degradation while maintaining efficiency. This paper introduces a novel image restoration architecture that combines multi-dimensional dynamic attention and self-attention within a U-Net framework. To leverage the global modeling capabilities of transformers and the local modeling capabilities of convolutions, we integrate sole CNNs in the encoder-decoder and sole transformers in the latent layer. Additionally, we design convolutional kernels with selected multi-dimensional dynamic attention to capture diverse degraded inputs efficiently. A transformer block with transposed self-attention further enhances global feature extraction while maintaining efficiency. Extensive experiments demonstrate that our method achieves a better balance between performance and computational complexity across five image restoration tasks: deraining, deblurring, denoising, dehazing, and enhancement, as well as superior performance for high-level vision tasks. The source code will be available at https://github.com/House-yuyu/MDDA-former.

PaperPDFCode

Code

house-yuyu/mdda-former officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DeblurringDecoderDenoisingImage RestorationRain Removal

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

AttentionConcatenated Skip ConnectionConvolutionMax PoolingReLUSoftmaxU-Net

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections