Papers › Swin2-MoSE: A New Single Image Super-Resolution Model for Remote Sensing

Swin2-MoSE: A New Single Image Super-Resolution Model for Remote Sensing

29 Apr 2024arXiv:2404.18924archive 2025-07-28

Leonardo Rossi, Vittorio Bernuzzi, Tomaso Fontanini, Massimo Bertozzi, Andrea Prati

Due to the limitations of current optical and sensor technologies and the high cost of updating them, the spectral and spatial resolution of satellites may not always meet desired requirements. For these reasons, Remote-Sensing Single-Image Super-Resolution (RS-SISR) techniques have gained significant interest. In this paper, we propose Swin2-MoSE model, an enhanced version of Swin2SR. Our model introduces MoE-SM, an enhanced Mixture-of-Experts (MoE) to replace the Feed-Forward inside all Transformer block. MoE-SM is designed with Smart-Merger, and new layer for merging the output of individual experts, and with a new way to split the work between experts, defining a new per-example strategy instead of the commonly used per-token one. Furthermore, we analyze how positional encodings interact with each other, demonstrating that per-channel bias and per-head bias can positively cooperate. Finally, we propose to use a combination of Normalized-Cross-Correlation (NCC) and Structural Similarity Index Measure (SSIM) losses, to avoid typical MSE loss limitations. Experimental results demonstrate that Swin2-MoSE outperforms any Swin derived models by up to 0.377 - 0.958 dB (PSNR) on task of 2x, 3x and 4x resolution-upscaling (Sen2Venus and OLI2MSI datasets). It also outperforms SOTA models by a good margin, proving to be competitive and with excellent potential, especially for complex tasks. Additionally, an analysis of computational costs is also performed. Finally, we show the efficacy of Swin2-MoSE, applying it to a semantic segmentation task (SeasoNet dataset). Code and pretrained are available on https://github.com/IMPLabUniPr/swin2-mose/tree/official_code

PaperPDFCode

Code

IMPLabUniPr/swin2-mose officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image Super-ResolutionMixture-of-ExpertsMultispectral Image Super-resolutionSSIMSemantic SegmentationSuper-Resolution

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Multispectral Image Super-resolution OLI2MSI - 3x upscaling Swin2SR-MoSE PSNR 45.9194 #1 of 1 Archive leaderboard report
Multispectral Image Super-resolution OLI2MSI - 3x upscaling Swin2SR-MoSE SSIM 0.9912 #1 of 1 Archive leaderboard report
Multispectral Image Super-resolution Sen2venus - 2x upscaling Swin2SR-MoSE PSNR 49.4784 #1 of 2 Archive leaderboard report
Multispectral Image Super-resolution Sen2venus - 2x upscaling Swin2SR-MoSE SSIM 0.9948 #1 of 2 Archive leaderboard report
Multispectral Image Super-resolution Sen2venus - 4x upscaling Swin2SR-MoSE PSNR 45.9272 #1 of 1 Archive leaderboard report
Multispectral Image Super-resolution Sen2venus - 4x upscaling Swin2SR-MoSE SSIM 0.9849 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionBPEDense ConnectionsDropoutLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections