{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-02909","title":"Scalable Derivative Gaussian Processes via Exact Gradient Reduction","arxiv_id":"2606.02909","date":"2026-06-01","proceeding":null,"authors":["Hyunseok Seung","Matthias Katzfuss"],"abstract":"Gradient observations can substantially improve Gaussian process (GP) surrogates, particularly in high-dimensional settings where function evaluations are expensive. However, exact inference with $n$ function values and $n$ full gradients in $d$ dimensions scales cubically in the joint state size, imposing an intractable $\\mathcal{O}(n^3 d^3)$ computational bottleneck. We introduce TERA, a highly scalable derivative GP method based on target-specific exact gradient reduction. We prove that for stationary kernels, the gradient components orthogonal to the directions connecting the target and conditioning points are conditionally independent of the target function value; consequently, the exact conditional density is fully characterized by at most $m^2$ directional derivatives once a conditioning set of size $m$ is specified. By using these reduced, dimension-free conditionals as local factors in a Vecchia approximation, TERA effectively decouples $n$ and $d$ from the dense matrix inversion. This reduces the per-target evaluation cost to $\\mathcal{O}(dm^2 + m^6)$ time and $\\mathcal{O}(dm^2 + m^4)$ memory, leaving the underlying derivative GP model mathematically unchanged. Empirical evaluations demonstrate that TERA achieves state-of-the-art predictive accuracy while operating orders of magnitude faster than standard derivative GPs. Crucially, both computation time and peak GPU memory remain essentially flat with respect to $d$, enabling highly scalable inference in high-dimensional spaces.","url_abs":"https://arxiv.org/abs/2606.02909","url_pdf":"https://arxiv.org/pdf/2606.02909","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.02909","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.02909"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/hseung88/tera","reach":null}],"summary":{"ran":6,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":9,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1c2d67611de1396b","entry":"function_covariance","repo":"hseung88/tera","repo_kind":"found_in_text","path":"src/gp_sim_kl/deroos.py","file_url":"https://github.com/hseung88/tera/blob/HEAD/src/gp_sim_kl/deroos.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c2d67611de1396b"}},{"code_sha256_prefix":"2ab4d3e86172d1ea","entry":"get_problem","repo":"hseung88/tera","repo_kind":"found_in_text","path":"src/bo_experiments/benchmarks.py","file_url":"https://github.com/hseung88/tera/blob/HEAD/src/bo_experiments/benchmarks.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ab4d3e86172d1ea"}},{"code_sha256_prefix":"d1e48973f4f5d7d5","entry":"initial_design","repo":"hseung88/tera","repo_kind":"found_in_text","path":"src/bo_experiments/benchmarks.py","file_url":"https://github.com/hseung88/tera/blob/HEAD/src/bo_experiments/benchmarks.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d1e48973f4f5d7d5"}},{"code_sha256_prefix":"eb723ac3050b75c8","entry":"inv_lengthscale_sq","repo":"hseung88/tera","repo_kind":"found_in_text","path":"src/gp_sim_kl/deroos.py","file_url":"https://github.com/hseung88/tera/blob/HEAD/src/gp_sim_kl/deroos.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eb723ac3050b75c8"}},{"code_sha256_prefix":"d9caefa1bb4a34f4","entry":"k_kp_kpp_from_r","repo":"hseung88/tera","repo_kind":"found_in_text","path":"src/gp_sim_kl/deroos.py","file_url":"https://github.com/hseung88/tera/blob/HEAD/src/gp_sim_kl/deroos.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d9caefa1bb4a34f4"}},{"code_sha256_prefix":"9600a3cb290e1f9d","entry":"plot_bo_main_regret","repo":"hseung88/tera","repo_kind":"found_in_text","path":"src/bo_experiments/plotting.py","file_url":"https://github.com/hseung88/tera/blob/HEAD/src/bo_experiments/plotting.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9600a3cb290e1f9d"}},{"code_sha256_prefix":"cde0fc6339392bd7","entry":"load_config","repo":"hseung88/tera","repo_kind":"found_in_text","path":"src/bo_experiments/config.py","file_url":"https://github.com/hseung88/tera/blob/HEAD/src/bo_experiments/config.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cde0fc6339392bd7"}},{"code_sha256_prefix":"e645fd505836af7b","entry":"plot_bo_appendix_time_regret","repo":"hseung88/tera","repo_kind":"found_in_text","path":"src/bo_experiments/plotting.py","file_url":"https://github.com/hseung88/tera/blob/HEAD/src/bo_experiments/plotting.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e645fd505836af7b"}},{"code_sha256_prefix":"fd6638b97c989a4a","entry":"plot_bo_resource_summary","repo":"hseung88/tera","repo_kind":"found_in_text","path":"src/bo_experiments/plotting.py","file_url":"https://github.com/hseung88/tera/blob/HEAD/src/bo_experiments/plotting.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fd6638b97c989a4a"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}