Papers › ShadowMaskFormer: Mask Augmented Patch Embeddings for Shadow Removal
ShadowMaskFormer: Mask Augmented Patch Embeddings for Shadow Removal
Zhuohao Li, Guoyang Xie, Guannan Jiang, Zhichao Lu
Transformer recently emerged as the de facto model for computer vision tasks and has also been successfully applied to shadow removal. However, these existing methods heavily rely on intricate modifications to the attention mechanisms within the transformer blocks while using a generic patch embedding. As a result, it often leads to complex architectural designs requiring additional computation resources. In this work, we aim to explore the efficacy of incorporating shadow information within the early processing stage. Accordingly, we propose a transformer-based framework with a novel patch embedding that is tailored for shadow removal, dubbed ShadowMaskFormer. Specifically, we present a simple and effective mask-augmented patch embedding to integrate shadow information and promote the model's emphasis on acquiring knowledge for shadow regions. Extensive experiments conducted on the ISTD, ISTD+, and SRD benchmark datasets demonstrate the efficacy of our method against state-of-the-art approaches while using fewer model parameters.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Shadow Removal | ISTD+ | ShadowMaskFormer (arXiv 2024) (512x512) | LPIPS | 0.211 | #3 of 26 | Archive leaderboard | report |
| Shadow Removal | ISTD+ | ShadowMaskFormer (arXiv 2024) (512x512) | PSNR | 28.34 | #3 of 26 | Archive leaderboard | report |
| Shadow Removal | ISTD+ | ShadowMaskFormer (arXiv 2024) (512x512) | RMSE | 2.95 | #3 of 26 | Archive leaderboard | report |
| Shadow Removal | ISTD+ | ShadowMaskFormer (arXiv 2024) (512x512) | SSIM | 0.849 | #3 of 26 | Archive leaderboard | report |
| Shadow Removal | ISTD+ | ShadowMaskFormer (arXiv 2024) (256x256) | LPIPS | 0.395 | #16 of 26 | Archive leaderboard | report |
| Shadow Removal | ISTD+ | ShadowMaskFormer (arXiv 2024) (256x256) | PSNR | 26.57 | #16 of 26 | Archive leaderboard | report |
| Shadow Removal | ISTD+ | ShadowMaskFormer (arXiv 2024) (256x256) | RMSE | 3.39 | #16 of 26 | Archive leaderboard | report |
| Shadow Removal | ISTD+ | ShadowMaskFormer (arXiv 2024) (256x256) | SSIM | 0.698 | #16 of 26 | Archive leaderboard | report |
| Shadow Removal | SRD | ShadowMaskFormer (arXiv 2024) (512x512) | LPIPS | 0.249 | #9 of 25 | Archive leaderboard | report |
| Shadow Removal | SRD | ShadowMaskFormer (arXiv 2024) (512x512) | PSNR | 25.13 | #9 of 25 | Archive leaderboard | report |
| Shadow Removal | SRD | ShadowMaskFormer (arXiv 2024) (512x512) | RMSE | 4.15 | #9 of 25 | Archive leaderboard | report |
| Shadow Removal | SRD | ShadowMaskFormer (arXiv 2024) (512x512) | SSIM | 0.798 | #9 of 25 | Archive leaderboard | report |
| Shadow Removal | SRD | ShadowMaskFormer (arXiv 2024) (256x256) | LPIPS | 0.386 | #18 of 25 | Archive leaderboard | report |
| Shadow Removal | SRD | ShadowMaskFormer (arXiv 2024) (256x256) | PSNR | 23.85 | #18 of 25 | Archive leaderboard | report |
| Shadow Removal | SRD | ShadowMaskFormer (arXiv 2024) (256x256) | RMSE | 4.69 | #18 of 25 | Archive leaderboard | report |
| Shadow Removal | SRD | ShadowMaskFormer (arXiv 2024) (256x256) | SSIM | 0.671 | #18 of 25 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections