Papers › Dancing under the stars: video denoising in starlight

Dancing under the stars: video denoising in starlight

8 Apr 2022CVPR 2022 1arXiv:2204.04210archive 2025-07-28

Kristina Monakhova, Stephan R. Richter, Laura Waller, Vladlen Koltun

Imaging in low light is extremely challenging due to low photon counts. Using sensitive CMOS cameras, it is currently possible to take videos at night under moonlight (0.05-0.3 lux illumination). In this paper, we demonstrate photorealistic video under starlight (no moon present, $<$0.001 lux) for the first time. To enable this, we develop a GAN-tuned physics-based noise model to more accurately represent camera noise at the lowest light levels. Using this noise model, we train a video denoiser using a combination of simulated noisy video clips and real noisy still images. We capture a 5-10 fps video dataset with significant motion at approximately 0.6-0.7 millilux with no active illumination. Comparing against alternative methods, we achieve improved video quality at the lowest light levels, demonstrating photorealistic video denoising in starlight for the first time.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DenoisingImage DenoisingVideo Denoising

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Denoising ELD SonyA7S2 x100 Starlight PSNR (Raw) 43.80 #8 of 9 Archive leaderboard report
Image Denoising ELD SonyA7S2 x100 Starlight SSIM (Raw) 0.936 #8 of 9 Archive leaderboard report
Image Denoising ELD SonyA7S2 x200 Starlight PSNR (Raw) 40.86 #8 of 10 Archive leaderboard report
Image Denoising ELD SonyA7S2 x200 Starlight SSIM (Raw) 0.884 #8 of 10 Archive leaderboard report
Image Denoising SID SonyA7S2 x250 Starlight PSNR (Raw) 36.25 #9 of 10 Archive leaderboard report
Image Denoising SID SonyA7S2 x250 Starlight SSIM (Raw) 0.858 #9 of 10 Archive leaderboard report
Image Denoising SID x100 Starlight PSNR (Raw) 40.47 #7 of 8 Archive leaderboard report
Image Denoising SID x100 Starlight SSIM 0.926 #7 of 8 Archive leaderboard report
Image Denoising SID x300 Starlight PSNR (Raw) 32.99 #7 of 8 Archive leaderboard report
Image Denoising SID x300 Starlight SSIM 0.780 #7 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections