Papers › Cloud removal in Sentinel-2 imagery using a deep residual neural network and...

Cloud removal in Sentinel-2 imagery using a deep residual neural network and SAR-optical data fusion

2 Jul 2020archive 2025-07-28

Andrea Meraner, Patrick Ebel, Xiao Xiang Zhu, Michael Schmitt

Optical remote sensing imagery is at the core of many Earth observation activities. The regular, consistent and global-scale nature of the satellite data is exploited in many applications, such as cropland monitoring, climate change assessment, land-cover and land-use classification, and disaster assessment. However, one main problem severely affects the temporal and spatial availability of surface observations, namely cloud cover. The task of removing clouds from optical images has been subject of studies since decades. The advent of the Big Data era in satellite remote sensing opens new possibilities for tackling the problem using powerful data-driven deep learning methods. In this paper, a deep residual neural network architecture is designed to remove clouds from multispectral Sentinel-2 imagery. SAR-optical data fusion is used to exploit the synergistic properties of the two imaging systems to guide the image reconstruction. Additionally, a novel cloud-adaptive loss is proposed to maximize the retainment of original information. The network is trained and tested on a globally sampled dataset comprising real cloudy and cloud-free images. The proposed setup allows to remove even optically thick clouds by reconstructing an optical representation of the underlying land surface structure.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Cloud RemovalEarth ObservationImage Reconstruction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Cloud Removal SEN12MS-CR DSen2-CR MAE 0.031 #5 of 10 Archive leaderboard report
Cloud Removal SEN12MS-CR DSen2-CR PSNR 27.76 #5 of 10 Archive leaderboard report
Cloud Removal SEN12MS-CR DSen2-CR SAM 9.472 #5 of 10 Archive leaderboard report
Cloud Removal SEN12MS-CR DSen2-CR SSIM 0.874 #5 of 10 Archive leaderboard report
Cloud Removal SEN12MS-CR-TS DSen2-CR PSNR 26.04 #7 of 7 Archive leaderboard report
Cloud Removal SEN12MS-CR-TS DSen2-CR RMSE 0.060 #7 of 7 Archive leaderboard report
Cloud Removal SEN12MS-CR-TS DSen2-CR SAM 12.147 #7 of 7 Archive leaderboard report
Cloud Removal SEN12MS-CR-TS DSen2-CR SSIM 0.810 #7 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Batch NormalizationConvolutionReLUResidual BlockResidual Connection

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections