Papers › Neural-g: A Deep Learning Framework for Mixing Density Estimation

Neural-g: A Deep Learning Framework for Mixing Density Estimation

10 Jun 2024arXiv:2406.05986archive 2025-07-28

Shijie Wang, Saptarshi Chakraborty, Qian Qin, Ray Bai

Mixing (or prior) density estimation is an important problem in machine learning and statistics, especially in empirical Bayes g-modeling where accurately estimating the prior is necessary for making good posterior inferences. In this paper, we propose neural-g, a new neural network-based estimator for g-modeling. Neural-g uses a softmax output layer to ensure that the estimated prior is a valid probability density. Under default hyperparameters, we show that neural-g is very flexible and capable of capturing many unknown densities, including those with flat regions, heavy tails, and/or discontinuities. In contrast, existing methods struggle to capture all of these prior shapes. We provide justification for neural-g by establishing a new universal approximation theorem regarding the capability of neural networks to learn arbitrary probability mass functions. To accelerate convergence of our numerical implementation, we utilize a weighted average gradient descent approach to update the network parameters. Finally, we extend neural-g to multivariate prior density estimation. We illustrate the efficacy of our approach through simulations and analyses of real datasets. A software package to implement neural-g is publicly available at https://github.com/shijiew97/neuralG.

PaperPDFCode

Code

shijiew97/neuralg officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Deep LearningDensity Estimation

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Softmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections