{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/scalable-gaussian-process-regression-enables","title":"Linear-scaling kernels for protein sequences and small molecules outperform deep learning while providing uncertainty quantitation and improved interpretability","arxiv_id":"2302.03294","date":"2023-02-07","proceeding":null,"authors":["Jonathan Parkinson","Wei Wang"],"abstract":"Gaussian process (GP) is a Bayesian model which provides several advantages for regression tasks in machine learning such as reliable quantitation of uncertainty and improved interpretability. Their adoption has been precluded by their excessive computational cost and by the difficulty in adapting them for analyzing sequences (e.g. amino acid and nucleotide sequences) and graphs (e.g. ones representing small molecules). In this study, we develop efficient and scalable approaches for fitting GP models as well as fast convolution kernels which scale linearly with graph or sequence size. We implement these improvements by building an open-source Python library called xGPR. We compare the performance of xGPR with the reported performance of various deep learning models on 20 benchmarks, including small molecule, protein sequence and tabular data. We show that xGRP achieves highly competitive performance with much shorter training time. Furthermore, we also develop new kernels for sequence and graph data and show that xGPR generally outperforms convolutional neural networks on predicting key properties of proteins and small molecules. Importantly, xGPR provides uncertainty information not available from typical deep learning models. Additionally, xGPR provides a representation of the input data that can be used for clustering and data visualization. These results demonstrate that xGPR provides a powerful and generic tool that can be broadly useful in protein engineering and drug discovery.","url_abs":"https://arxiv.org/abs/2302.03294v2","url_pdf":"https://arxiv.org/pdf/2302.03294v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"scalable-gaussian-process-regression-enables","repo_url":"https://github.com/jlparki/xgpr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"scalable-gaussian-process-regression-enables","repo_url":"https://github.com/jlparkI/benchmarking_xGPR","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"data-visualization","task_name":"Data Visualization"},{"task_slug":"drug-discovery","task_name":"Drug Discovery"},{"task_slug":"formation-energy","task_name":"Formation Energy"},{"task_slug":"protein-function-prediction","task_name":"Protein Function Prediction"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":null,"method_name":"Library"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/formation-energy-on-qm9","task":"Formation Energy","dataset":"QM9","model":"xGPR -- Gaussian process, graph convolution kernel","rank_in_archive_order":8,"of":18,"metrics":{"MAE":"0.167"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2302.03294","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2302.03294"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jlparkI/benchmarking_xGPR","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jlparki/xgpr","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"unverified":2},"by_repo_kind":{"official":{"samples":2,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1080b9585be72274","entry":"get_id","repo":"jlparkI/benchmarking_xGPR","repo_kind":"official","path":"chemtools/soap_maker.py","file_url":"https://github.com/jlparkI/benchmarking_xGPR/blob/HEAD/chemtools/soap_maker.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1080b9585be72274"}},{"code_sha256_prefix":"a7e08634088cea7b","entry":"get_target_qm9_files","repo":"jlparkI/benchmarking_xGPR","repo_kind":"official","path":"core_experiments/core_exp_funcs.py","file_url":"https://github.com/jlparkI/benchmarking_xGPR/blob/HEAD/core_experiments/core_exp_funcs.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a7e08634088cea7b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}