Papers › Learning Generative Models using Denoising Density Estimators

Learning Generative Models using Denoising Density Estimators

8 Jan 2020arXiv:2001.02728archive 2025-07-28

Siavash A. Bigdeli, Geng Lin, Tiziano Portenier, L. Andrea Dunbar, Matthias Zwicker

Learning probabilistic models that can estimate the density of a given set of samples, and generate samples from that density, is one of the fundamental challenges in unsupervised machine learning. We introduce a new generative model based on denoising density estimators (DDEs), which are scalar functions parameterized by neural networks, that are efficiently trained to represent kernel density estimators of the data. Leveraging DDEs, our main contribution is a novel technique to obtain generative models by minimizing the KL-divergence directly. We prove that our algorithm for obtaining generative models is guaranteed to converge to the correct solution. Our approach does not require specific network architecture as in normalizing flows, nor use ordinary differential equation solvers as in continuous normalizing flows. Experimental results demonstrate substantial improvement in density estimation and competitive performance in generative model training.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

logchan/dde mentioned on GitHubpytorch report
siavashBigdeli/DDE mentioned on GitHubtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DenoisingDensity Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Density Estimation UCI GAS DDE Log-likelihood 9.73 #2 of 5 Archive leaderboard report
Density Estimation UCI HEPMASS DDE Log-likelihood -11.3 #5 of 5 Archive leaderboard report
Density Estimation UCI MINIBOONE DDE Log-likelihood -6.94 #1 of 5 Archive leaderboard report
Density Estimation UCI MINIBOONE DDE NLL 6.94 #1 of 5 Archive leaderboard report
Density Estimation UCI POWER DDE Log-likelihood 0.97 #2 of 6 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections