Papers › ShadowMaskFormer: Mask Augmented Patch Embeddings for Shadow Removal

ShadowMaskFormer: Mask Augmented Patch Embeddings for Shadow Removal

29 Apr 2024arXiv:2404.18433archive 2025-07-28

Zhuohao Li, Guoyang Xie, Guannan Jiang, Zhichao Lu

Transformer recently emerged as the de facto model for computer vision tasks and has also been successfully applied to shadow removal. However, these existing methods heavily rely on intricate modifications to the attention mechanisms within the transformer blocks while using a generic patch embedding. As a result, it often leads to complex architectural designs requiring additional computation resources. In this work, we aim to explore the efficacy of incorporating shadow information within the early processing stage. Accordingly, we propose a transformer-based framework with a novel patch embedding that is tailored for shadow removal, dubbed ShadowMaskFormer. Specifically, we present a simple and effective mask-augmented patch embedding to integrate shadow information and promote the model's emphasis on acquiring knowledge for shadow regions. Extensive experiments conducted on the ISTD, ISTD+, and SRD benchmark datasets demonstrate the efficacy of our method against state-of-the-art approaches while using fewer model parameters.

PaperPDFCode

Code

lizhh268/shadowmaskformer officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Shadow Removal

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Shadow Removal ISTD+ ShadowMaskFormer (arXiv 2024) (512x512) LPIPS 0.211 #3 of 26 Archive leaderboard report
Shadow Removal ISTD+ ShadowMaskFormer (arXiv 2024) (512x512) PSNR 28.34 #3 of 26 Archive leaderboard report
Shadow Removal ISTD+ ShadowMaskFormer (arXiv 2024) (512x512) RMSE 2.95 #3 of 26 Archive leaderboard report
Shadow Removal ISTD+ ShadowMaskFormer (arXiv 2024) (512x512) SSIM 0.849 #3 of 26 Archive leaderboard report
Shadow Removal ISTD+ ShadowMaskFormer (arXiv 2024) (256x256) LPIPS 0.395 #16 of 26 Archive leaderboard report
Shadow Removal ISTD+ ShadowMaskFormer (arXiv 2024) (256x256) PSNR 26.57 #16 of 26 Archive leaderboard report
Shadow Removal ISTD+ ShadowMaskFormer (arXiv 2024) (256x256) RMSE 3.39 #16 of 26 Archive leaderboard report
Shadow Removal ISTD+ ShadowMaskFormer (arXiv 2024) (256x256) SSIM 0.698 #16 of 26 Archive leaderboard report
Shadow Removal SRD ShadowMaskFormer (arXiv 2024) (512x512) LPIPS 0.249 #9 of 25 Archive leaderboard report
Shadow Removal SRD ShadowMaskFormer (arXiv 2024) (512x512) PSNR 25.13 #9 of 25 Archive leaderboard report
Shadow Removal SRD ShadowMaskFormer (arXiv 2024) (512x512) RMSE 4.15 #9 of 25 Archive leaderboard report
Shadow Removal SRD ShadowMaskFormer (arXiv 2024) (512x512) SSIM 0.798 #9 of 25 Archive leaderboard report
Shadow Removal SRD ShadowMaskFormer (arXiv 2024) (256x256) LPIPS 0.386 #18 of 25 Archive leaderboard report
Shadow Removal SRD ShadowMaskFormer (arXiv 2024) (256x256) PSNR 23.85 #18 of 25 Archive leaderboard report
Shadow Removal SRD ShadowMaskFormer (arXiv 2024) (256x256) RMSE 4.69 #18 of 25 Archive leaderboard report
Shadow Removal SRD ShadowMaskFormer (arXiv 2024) (256x256) SSIM 0.671 #18 of 25 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections