Papers › Cloud Removal in Satellite Images Using Spatiotemporal Generative Networks

Cloud Removal in Satellite Images Using Spatiotemporal Generative Networks

14 Dec 2019arXiv:1912.06838archive 2025-07-28

Vishnu Sarukkai, Anirudh Jain, Burak Uzkent, Stefano Ermon

Satellite images hold great promise for continuous environmental monitoring and earth observation. Occlusions cast by clouds, however, can severely limit coverage, making ground information extraction more difficult. Existing pipelines typically perform cloud removal with simple temporal composites and hand-crafted filters. In contrast, we cast the problem of cloud removal as a conditional image synthesis challenge, and we propose a trainable spatiotemporal generator network (STGAN) to remove clouds. We train our model on a new large-scale spatiotemporal dataset that we construct, containing 97640 image pairs covering all continents. We demonstrate experimentally that the proposed STGAN model outperforms standard models and can generate realistic cloud-free images with high PSNR and SSIM values across a variety of atmospheric conditions, leading to improved performance in downstream tasks such as land cover classification.

PaperPDFCode

Code

PatrickTUM/SEN12MS-CR-TS mentioned on GitHubpytorch report
VSAnimator/stgan mentioned on GitHubpytorch report
come880412/CTGAN mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Cloud RemovalEarth ObservationImage GenerationLand Cover ClassificationSSIM

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Cloud Removal SEN12MS-CR-TS STGAN PSNR 25.42 #6 of 7 Archive leaderboard report
Cloud Removal SEN12MS-CR-TS STGAN RMSE 0.057 #6 of 7 Archive leaderboard report
Cloud Removal SEN12MS-CR-TS STGAN SAM 12.548 #6 of 7 Archive leaderboard report
Cloud Removal SEN12MS-CR-TS STGAN SSIM 0.818 #6 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections