{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/thin-and-deep-gaussian-processes-1","title":"Thin and Deep Gaussian Processes","arxiv_id":"2310.11527","date":"2023-10-17","proceeding":"NeurIPS 2023 11","authors":["Daniel Augusto de Souza","Alexander Nikitin","ST John","Magnus Ross","Mauricio A. Álvarez","Marc Peter Deisenroth","João P. P. Gomes","Diego Mesquita","César Lincoln C. Mattos"],"abstract":"Gaussian processes (GPs) can provide a principled approach to uncertainty quantification with easy-to-interpret kernel hyperparameters, such as the lengthscale, which controls the correlation distance of function values. However, selecting an appropriate kernel can be challenging. Deep GPs avoid manual kernel engineering by successively parameterizing kernels with GP layers, allowing them to learn low-dimensional embeddings of the inputs that explain the output data. Following the architecture of deep neural networks, the most common deep GPs warp the input space layer-by-layer but lose all the interpretability of shallow GPs. An alternative construction is to successively parameterize the lengthscale of a kernel, improving the interpretability but ultimately giving away the notion of learning lower-dimensional embeddings. Unfortunately, both methods are susceptible to particular pathologies which may hinder fitting and limit their interpretability. This work proposes a novel synthesis of both previous approaches: Thin and Deep GP (TDGP). Each TDGP layer defines locally linear transformations of the original input data maintaining the concept of latent embeddings while also retaining the interpretation of lengthscales of a kernel. Moreover, unlike the prior solutions, TDGP induces non-pathological manifolds that admit learning lower-dimensional representations. We show with theoretical and experimental results that i) TDGP is, unlike previous models, tailored to specifically discover lower-dimensional manifolds in the input data, ii) TDGP behaves well when increasing the number of layers, and iii) TDGP performs well in standard benchmark datasets.","url_abs":"https://arxiv.org/abs/2310.11527v1","url_pdf":"https://arxiv.org/pdf/2310.11527v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"thin-and-deep-gaussian-processes-1","repo_url":"https://github.com/spectraldani/thindeepgps","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"gaussian-processes","task_name":"Gaussian Processes"},{"task_slug":"uncertainty-quantification","task_name":"Uncertainty Quantification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.11527","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.11527"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/spectraldani/thindeepgps","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":5},"by_repo_kind":{"listed":{"samples":5,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"fc3f521b90df2b7a","entry":"mean_relative_absolute_error","repo":"spectraldani/thindeepgps","repo_kind":"listed","path":"tdgplib/metrics.py","file_url":"https://github.com/spectraldani/thindeepgps/blob/HEAD/tdgplib/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fc3f521b90df2b7a"}},{"code_sha256_prefix":"8005ff109e9e5c6a","entry":"negative_log_predictive_density","repo":"spectraldani/thindeepgps","repo_kind":"listed","path":"tdgplib/metrics.py","file_url":"https://github.com/spectraldani/thindeepgps/blob/HEAD/tdgplib/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8005ff109e9e5c6a"}},{"code_sha256_prefix":"cc14ff737fc4dbf4","entry":"op_matrix","repo":"spectraldani/thindeepgps","repo_kind":"listed","path":"tdgplib/helper/tensor_ops.py","file_url":"https://github.com/spectraldani/thindeepgps/blob/HEAD/tdgplib/helper/tensor_ops.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cc14ff737fc4dbf4"}},{"code_sha256_prefix":"fe40885c24416cd2","entry":"root_mean_squared_error","repo":"spectraldani/thindeepgps","repo_kind":"listed","path":"tdgplib/metrics.py","file_url":"https://github.com/spectraldani/thindeepgps/blob/HEAD/tdgplib/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fe40885c24416cd2"}},{"code_sha256_prefix":"640e2050aa8ed75f","entry":"scale_data","repo":"spectraldani/thindeepgps","repo_kind":"listed","path":"tdgplib/data_utils.py","file_url":"https://github.com/spectraldani/thindeepgps/blob/HEAD/tdgplib/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"640e2050aa8ed75f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}