Papers › DDP: Diffusion Model for Dense Visual Prediction

DDP: Diffusion Model for Dense Visual Prediction

30 Mar 2023ICCV 2023 1arXiv:2303.17559archive 2025-07-28

Yuanfeng Ji, Zhe Chen, Enze Xie, Lanqing Hong, Xihui Liu, Zhaoqiang Liu, Tong Lu, Zhenguo Li, Ping Luo

We propose a simple, efficient, yet powerful framework for dense visual predictions based on the conditional diffusion pipeline. Our approach follows a "noise-to-map" generative paradigm for prediction by progressively removing noise from a random Gaussian distribution, guided by the image. The method, called DDP, efficiently extends the denoising diffusion process into the modern perception pipeline. Without task-specific design and architecture customization, DDP is easy to generalize to most dense prediction tasks, e.g., semantic segmentation and depth estimation. In addition, DDP shows attractive properties such as dynamic inference and uncertainty awareness, in contrast to previous single-step discriminative methods. We show top results on three representative tasks with six diverse benchmarks, without tricks, DDP achieves state-of-the-art or competitive performance on each task compared to the specialist counterparts. For example, semantic segmentation (83.9 mIoU on Cityscapes), BEV map segmentation (70.6 mIoU on nuScenes), and depth estimation (0.05 REL on KITTI). We hope that our approach will serve as a solid baseline and facilitate future research

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

jiyuanfeng/ddp officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DenoisingDepth EstimationMonocular Depth EstimationPredictionSegmentationSemantic Segmentationmodel

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Monocular Depth Estimation KITTI Eigen split DDP (Swin-L, step-3) Delta < 1.25 0.975 #22 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split DDP (Swin-L, step-3) Delta < 1.25^2 0.997 #22 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split DDP (Swin-L, step-3) Delta < 1.25^3 0.999 #22 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split DDP (Swin-L, step-3) RMSE 2.072 #22 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split DDP (Swin-L, step-3) RMSE log 0.076 #22 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split DDP (Swin-L, step-3) Sq Rel 0.148 #22 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split DDP (Swin-L, step-3) absolute relative error 0.050 #22 of 79 Archive leaderboard report
Monocular Depth Estimation NYU-Depth V2 DDP (step3) Delta < 1.25 0.921 #41 of 85 Archive leaderboard report
Monocular Depth Estimation NYU-Depth V2 DDP (step3) Delta < 1.25^2 0.990 #41 of 85 Archive leaderboard report
Monocular Depth Estimation NYU-Depth V2 DDP (step3) Delta < 1.25^3 0.998 #41 of 85 Archive leaderboard report
Monocular Depth Estimation NYU-Depth V2 DDP (step3) RMSE 0.329 #41 of 85 Archive leaderboard report
Monocular Depth Estimation NYU-Depth V2 DDP (step3) absolute relative error 0.094 #41 of 85 Archive leaderboard report
Monocular Depth Estimation NYU-Depth V2 DDP (step3) log 10 0.040 #41 of 85 Archive leaderboard report
Monocular Depth Estimation SUN-RGBD DDP (step-3) Delta < 1.25 0.825 #3 of 3 Archive leaderboard report
Monocular Depth Estimation SUN-RGBD DDP (step-3) Delta < 1.25^2 0.973 #3 of 3 Archive leaderboard report
Monocular Depth Estimation SUN-RGBD DDP (step-3) Delta < 1.25^3 0.994 #3 of 3 Archive leaderboard report
Monocular Depth Estimation SUN-RGBD DDP (step-3) RMSE 0.397 #3 of 3 Archive leaderboard report
Monocular Depth Estimation SUN-RGBD DDP (step-3) absolute relative error 0.128 #3 of 3 Archive leaderboard report
Monocular Depth Estimation SUN-RGBD DDP (step-3) log 10 0.056 #3 of 3 Archive leaderboard report
Semantic Segmentation ADE20K DDP (Swin-L, step-3) Params (M) 207 #60 of 235 Archive leaderboard report
Semantic Segmentation ADE20K DDP (Swin-L, step-3) Validation mIoU 54.4 #60 of 235 Archive leaderboard report
Semantic Segmentation Cityscapes val DDP (ConvNeXt-L, step-3) mIoU 83.9 #22 of 99 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Diffusion

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections