{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/log-linear-time-gaussian-processes-using","title":"Log-Linear-Time Gaussian Processes Using Binary Tree Kernels","arxiv_id":"2210.01633","date":"2022-10-04","proceeding":null,"authors":["Michael K. Cohen","Samuel Daulton","Michael A. Osborne"],"abstract":"Gaussian processes (GPs) produce good probabilistic models of functions, but most GP kernels require $O((n+m)n^2)$ time, where $n$ is the number of data points and $m$ the number of predictive locations. We present a new kernel that allows for Gaussian process regression in $O((n+m)\\log(n+m))$ time. Our \"binary tree\" kernel places all data points on the leaves of a binary tree, with the kernel depending only on the depth of the deepest common ancestor. We can store the resulting kernel matrix in $O(n)$ space in $O(n \\log n)$ time, as a sum of sparse rank-one matrices, and approximately invert the kernel matrix in $O(n)$ time. Sparse GP methods also offer linear run time, but they predict less well than higher dimensional kernels. On a classic suite of regression tasks, we compare our kernel against Mat\\'ern, sparse, and sparse variational kernels. The binary tree GP assigns the highest likelihood to the test data on a plurality of datasets, usually achieves lower mean squared error than the sparse methods, and often ties or beats the Mat\\'ern GP. On large datasets, the binary tree GP is fastest, and much faster than a Mat\\'ern GP.","url_abs":"https://arxiv.org/abs/2210.01633v1","url_pdf":"https://arxiv.org/pdf/2210.01633v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"log-linear-time-gaussian-processes-using","repo_url":"https://github.com/mkc1000/btgp","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"gaussian-processes","task_name":"Gaussian Processes"},{"task_slug":"regression-1","task_name":"regression"}],"methods":[{"method_slug":"gaussian-process","method_name":"Gaussian Process"},{"method_slug":"test","method_name":"Test"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2210.01633","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.01633"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/mkc1000/btgp","reach":null}],"summary":{"ran":1,"ran_draft_wrong":12,"ran_violates":1,"unverified":5},"by_repo_kind":{"official":{"samples":19,"ran":14,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":19,"samples":[{"code_sha256_prefix":"f1ea9d43bf8bc3da","entry":"BFGS","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f1ea9d43bf8bc3da"}},{"code_sha256_prefix":"c69003d8e9a8dfdd","entry":"binary","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c69003d8e9a8dfdd"}},{"code_sha256_prefix":"b3e9c1bc2677dc5f","entry":"bit_array_to_byte_array","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b3e9c1bc2677dc5f"}},{"code_sha256_prefix":"8ddc19ad3623ca0f","entry":"bit_order_to_inv_permutation","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8ddc19ad3623ca0f"}},{"code_sha256_prefix":"8892f81b297d34be","entry":"bit_order_to_permutation","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8892f81b297d34be"}},{"code_sha256_prefix":"1cda28abf6ff2dc0","entry":"box_vec_grad_to_rn_vec_grad","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1cda28abf6ff2dc0"}},{"code_sha256_prefix":"3c596893088a81ae","entry":"boxize","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3c596893088a81ae"}},{"code_sha256_prefix":"d247a0dd31c8d9c1","entry":"extra_loss","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d247a0dd31c8d9c1"}},{"code_sha256_prefix":"898799d19a538ff1","entry":"grad_to_vec_grad","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"898799d19a538ff1"}},{"code_sha256_prefix":"993e6ca5da924527","entry":"linesearch","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"993e6ca5da924527"}},{"code_sha256_prefix":"687350d731a12c03","entry":"permutation_to_bit_order","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"687350d731a12c03"}},{"code_sha256_prefix":"fd7cabe7d679d108","entry":"rmse","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fd7cabe7d679d108"}},{"code_sha256_prefix":"4f1d408b2a9d8c6d","entry":"rn_to_box","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4f1d408b2a9d8c6d"}},{"code_sha256_prefix":"f9d17c71b3899ba9","entry":"vec_to_perm_and_weights","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f9d17c71b3899ba9"}},{"code_sha256_prefix":"559dbda750466784","entry":"ONGP","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"559dbda750466784"}},{"code_sha256_prefix":"f3ee8772aaa6df3f","entry":"matvec","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f3ee8772aaa6df3f"}},{"code_sha256_prefix":"def28e47a55365e8","entry":"matvec_vectorizable","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"def28e47a55365e8"}},{"code_sha256_prefix":"b6665889451f7558","entry":"matvec_with_just_weights","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b6665889451f7558"}},{"code_sha256_prefix":"4c85cd4668ec7247","entry":"matvec_with_just_weights_vectorizable","repo":"mkc1000/btgp","repo_kind":"official","path":"btgp/gp.py","file_url":"https://github.com/mkc1000/btgp/blob/HEAD/btgp/gp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4c85cd4668ec7247"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}