Papers › Cloud Removal with Fusion of High Resolution Optical and SAR Images Using Generative...
Cloud Removal with Fusion of High Resolution Optical and SAR Images Using Generative Adversarial Networks
Jianhao Gao, Qiangqiang Yuan, Jie Li, Hai Zhang, Xin Su
The existence of clouds is one of the main factors that contributes to missing information in optical remote sensing images, restricting their further applications for Earth observation, so how to reconstruct the missing information caused by clouds is of great concern. Inspired by the image-to-image translation work based on convolutional neural network model and the heterogeneous information fusion thought, we propose a novel cloud removal method in this paper. The approach can be roughly divided into two steps: in the first step, a specially designed convolutional neural network (CNN) translates the synthetic aperture radar (SAR) images into simulated optical images in an object-to-object manner; in the second step, the simulated optical image, together with the SAR image and the optical image corrupted by clouds, is fused to reconstruct the corrupted area by a generative adversarial network (GAN) with a particular loss function. Between the first step and the second step, the contrast and luminance of the simulated optical image are randomly altered to make the model more robust. Two simulation experiments and one real-data experiment are conducted to confirm the effectiveness of the proposed method on Sentinel 1/2, GF 2/3 and airborne SAR/optical data. The results demonstrate that the proposed method outperforms state-of-the-art algorithms that also employ SAR images as auxiliary data.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
1 archive task tag without a task page not shown.
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Cloud Removal | SEN12MS-CR | Simulation-Fusion GAN | MAE | 0.045 | #8 of 10 | Archive leaderboard | report |
| Cloud Removal | SEN12MS-CR | Simulation-Fusion GAN | PSNR | 24.73 | #8 of 10 | Archive leaderboard | report |
| Cloud Removal | SEN12MS-CR | Simulation-Fusion GAN | SAM | 16.633 | #8 of 10 | Archive leaderboard | report |
| Cloud Removal | SEN12MS-CR | Simulation-Fusion GAN | SSIM | 0.701 | #8 of 10 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections