{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/deep-gaussian-processes-with-importance","title":"Deep Gaussian Processes with Importance-Weighted Variational Inference","arxiv_id":"1905.05435","date":"2019-05-14","proceeding":null,"authors":["Hugh Salimbeni","Vincent Dutordoir","James Hensman","Marc Peter Deisenroth"],"abstract":"Deep Gaussian processes (DGPs) can model complex marginal densities as well as complex mappings. Non-Gaussian marginals are essential for modelling real-world data, and can be generated from the DGP by incorporating uncorrelated variables to the model. Previous work on DGP models has introduced noise additively and used variational inference with a combination of sparse Gaussian processes and mean-field Gaussians for the approximate posterior. Additive noise attenuates the signal, and the Gaussian form of variational distribution may lead to an inaccurate posterior. We instead incorporate noisy variables as latent covariates, and propose a novel importance-weighted objective, which leverages analytic results and provides a mechanism to trade off computation for improved accuracy. Our results demonstrate that the importance-weighted objective works well in practice and consistently outperforms classical variational inference, especially for deeper models.","url_abs":"https://arxiv.org/abs/1905.05435v1","url_pdf":"https://arxiv.org/pdf/1905.05435v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deep-gaussian-processes-with-importance","repo_url":"https://github.com/hughsalimbeni/DGPs_with_IWVI","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"gaussian-processes","task_name":"Gaussian Processes"},{"task_slug":"variational-inference","task_name":"Variational Inference"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1905.05435","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1905.05435"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hughsalimbeni/DGPs_with_IWVI","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":3},"by_repo_kind":{"official":{"samples":3,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"cadf9bf21bebbdc4","entry":"make_experiment_combinations","repo":"hughsalimbeni/DGPs_with_IWVI","repo_kind":"official","path":"experiments/make_experiments.py","file_url":"https://github.com/hughsalimbeni/DGPs_with_IWVI/blob/HEAD/experiments/make_experiments.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cadf9bf21bebbdc4"}},{"code_sha256_prefix":"c56944be77cd39ef","entry":"rank_array","repo":"hughsalimbeni/DGPs_with_IWVI","repo_kind":"official","path":"experiments/view_results.py","file_url":"https://github.com/hughsalimbeni/DGPs_with_IWVI/blob/HEAD/experiments/view_results.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c56944be77cd39ef"}},{"code_sha256_prefix":"6ae901fda77d6151","entry":"sort_data_by_N","repo":"hughsalimbeni/DGPs_with_IWVI","repo_kind":"official","path":"experiments/view_results.py","file_url":"https://github.com/hughsalimbeni/DGPs_with_IWVI/blob/HEAD/experiments/view_results.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6ae901fda77d6151"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}