{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/uncertainty-quantification-using-martingales","title":"Uncertainty quantification using martingales for misspecified Gaussian processes","arxiv_id":"2006.07368","date":"2020-06-12","proceeding":null,"authors":["Willie Neiswanger","Aaditya Ramdas"],"abstract":"We address uncertainty quantification for Gaussian processes (GPs) under misspecified priors, with an eye towards Bayesian Optimization (BO). GPs are widely used in BO because they easily enable exploration based on posterior uncertainty bands. However, this convenience comes at the cost of robustness: a typical function encountered in practice is unlikely to have been drawn from the data scientist's prior, in which case uncertainty estimates can be misleading, and the resulting exploration can be suboptimal. We present a frequentist approach to GP/BO uncertainty quantification. We utilize the GP framework as a working model, but do not assume correctness of the prior. We instead construct a confidence sequence (CS) for the unknown function using martingale techniques. There is a necessary cost to achieving robustness: if the prior was correct, posterior GP bands are narrower than our CS. Nevertheless, when the prior is wrong, our CS is statistically valid and empirically outperforms standard GP methods, in terms of both coverage and utility for BO. Additionally, we demonstrate that powered likelihoods provide robustness against model misspecification.","url_abs":"https://arxiv.org/abs/2006.07368v2","url_pdf":"https://arxiv.org/pdf/2006.07368v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"uncertainty-quantification-using-martingales","repo_url":"https://github.com/willieneis/gp-martingales","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"bayesian-optimization","task_name":"Bayesian Optimization"},{"task_slug":"gaussian-processes","task_name":"Gaussian Processes"},{"task_slug":"uncertainty-quantification","task_name":"Uncertainty Quantification"},{"task_slug":null,"task_name":"valid"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2006.07368","atlas_url":"https://app.syntology.ai/?focus=2006.07368","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.07368"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/willieneis/gp-martingales","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":8,"ran_draft_wrong":1},"by_repo_kind":{"listed":{"samples":9,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"7437e0f18c2fdb52","entry":"branin","repo":"willieneis/gp-martingales","repo_kind":"listed","path":"src/branin.py","file_url":"https://github.com/willieneis/gp-martingales/blob/HEAD/src/branin.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7437e0f18c2fdb52"}},{"code_sha256_prefix":"dd191a4fa4ed3f21","entry":"branin_on_matrix","repo":"willieneis/gp-martingales","repo_kind":"listed","path":"src/branin.py","file_url":"https://github.com/willieneis/gp-martingales/blob/HEAD/src/branin.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dd191a4fa4ed3f21"}},{"code_sha256_prefix":"c2531c541561e89f","entry":"branin_single","repo":"willieneis/gp-martingales","repo_kind":"listed","path":"src/branin.py","file_url":"https://github.com/willieneis/gp-martingales/blob/HEAD/src/branin.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c2531c541561e89f"}},{"code_sha256_prefix":"8a3545000b23b4c3","entry":"dict_to_namespace","repo":"willieneis/gp-martingales","repo_kind":"listed","path":"src/simple_gp.py","file_url":"https://github.com/willieneis/gp-martingales/blob/HEAD/src/simple_gp.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8a3545000b23b4c3"}},{"code_sha256_prefix":"ced0f63b21189618","entry":"get_data_from_sample_path","repo":"willieneis/gp-martingales","repo_kind":"listed","path":"src/gp_util.py","file_url":"https://github.com/willieneis/gp-martingales/blob/HEAD/src/gp_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ced0f63b21189618"}},{"code_sha256_prefix":"89ca0dbdec25a646","entry":"get_noisy_sample_path","repo":"willieneis/gp-martingales","repo_kind":"listed","path":"src/gp_util.py","file_url":"https://github.com/willieneis/gp-martingales/blob/HEAD/src/gp_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"89ca0dbdec25a646"}},{"code_sha256_prefix":"ca0287c7d6d9a2aa","entry":"get_sample_path","repo":"willieneis/gp-martingales","repo_kind":"listed","path":"src/gp_util.py","file_url":"https://github.com/willieneis/gp-martingales/blob/HEAD/src/gp_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ca0287c7d6d9a2aa"}},{"code_sha256_prefix":"6b4a712b6acac1eb","entry":"normal_quotient","repo":"willieneis/gp-martingales","repo_kind":"listed","path":"src/quotient.py","file_url":"https://github.com/willieneis/gp-martingales/blob/HEAD/src/quotient.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6b4a712b6acac1eb"}},{"code_sha256_prefix":"b0b4e1d7e5cb31cd","entry":"normal_quotient_log_z","repo":"willieneis/gp-martingales","repo_kind":"listed","path":"src/quotient.py","file_url":"https://github.com/willieneis/gp-martingales/blob/HEAD/src/quotient.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b0b4e1d7e5cb31cd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}