{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/expressive-priors-in-bayesian-neural-networks","title":"Expressive Priors in Bayesian Neural Networks: Kernel Combinations and Periodic Functions","arxiv_id":"1905.06076","date":"2019-05-15","proceeding":null,"authors":["Tim Pearce","Russell Tsuchida","Mohamed Zaki","Alexandra Brintrup","Andy Neely"],"abstract":"A simple, flexible approach to creating expressive priors in Gaussian process (GP) models makes new kernels from a combination of basic kernels, e.g. summing a periodic and linear kernel can capture seasonal variation with a long term trend. Despite a well-studied link between GPs and Bayesian neural networks (BNNs), the BNN analogue of this has not yet been explored. This paper derives BNN architectures mirroring such kernel combinations. Furthermore, it shows how BNNs can produce periodic kernels, which are often useful in this context. These ideas provide a principled approach to designing BNNs that incorporate prior knowledge about a function. We showcase the practical value of these ideas with illustrative experiments in supervised and reinforcement learning settings.","url_abs":"https://arxiv.org/abs/1905.06076v2","url_pdf":"https://arxiv.org/pdf/1905.06076v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"expressive-priors-in-bayesian-neural-networks","repo_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[{"method_slug":"gaussian-process","method_name":"Gaussian Process"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1905.06076","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1905.06076"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":9},"by_repo_kind":{"listed":{"samples":9,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8ac77fe0875d7eb0","entry":"compare_dist","repo":"TeaPearce/Expressive_Priors_in_BNNs","repo_kind":"listed","path":"code/gpc_utils.py","file_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs/blob/HEAD/code/gpc_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8ac77fe0875d7eb0"}},{"code_sha256_prefix":"06f3c20828fd8121","entry":"gauss_neg_log_like","repo":"TeaPearce/Expressive_Priors_in_BNNs","repo_kind":"listed","path":"code/gpc_utils.py","file_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs/blob/HEAD/code/gpc_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"06f3c20828fd8121"}},{"code_sha256_prefix":"cb597d434f118a2b","entry":"metrics_calc","repo":"TeaPearce/Expressive_Priors_in_BNNs","repo_kind":"listed","path":"code/gpc_utils.py","file_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs/blob/HEAD/code/gpc_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cb597d434f118a2b"}},{"code_sha256_prefix":"6802e5d7fe4d2d58","entry":"np_k_0","repo":"TeaPearce/Expressive_Priors_in_BNNs","repo_kind":"listed","path":"code/gpc_module_gp_combo.py","file_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs/blob/HEAD/code/gpc_module_gp_combo.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6802e5d7fe4d2d58"}},{"code_sha256_prefix":"7796962d8760fb27","entry":"np_step","repo":"TeaPearce/Expressive_Priors_in_BNNs","repo_kind":"listed","path":"code/gpc_module_gp_combo.py","file_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs/blob/HEAD/code/gpc_module_gp_combo.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7796962d8760fb27"}},{"code_sha256_prefix":"c3529256b7b082a6","entry":"np_step_kernel","repo":"TeaPearce/Expressive_Priors_in_BNNs","repo_kind":"listed","path":"code/gpc_module_gp_combo.py","file_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs/blob/HEAD/code/gpc_module_gp_combo.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c3529256b7b082a6"}},{"code_sha256_prefix":"34092ab8e212ce4a","entry":"obs_tidy","repo":"TeaPearce/Expressive_Priors_in_BNNs","repo_kind":"listed","path":"code/RL_qlearn_pendulum_05.py","file_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs/blob/HEAD/code/RL_qlearn_pendulum_05.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"34092ab8e212ce4a"}},{"code_sha256_prefix":"51d28e6eb6d8ed82","entry":"pre_process_rbf_per","repo":"TeaPearce/Expressive_Priors_in_BNNs","repo_kind":"listed","path":"code/timeseries_hmc_05.py","file_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs/blob/HEAD/code/timeseries_hmc_05.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"51d28e6eb6d8ed82"}},{"code_sha256_prefix":"479d482abed0b4ff","entry":"sigmoid_array","repo":"TeaPearce/Expressive_Priors_in_BNNs","repo_kind":"listed","path":"code/gpc_DataGen.py","file_url":"https://github.com/TeaPearce/Expressive_Priors_in_BNNs/blob/HEAD/code/gpc_DataGen.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"479d482abed0b4ff"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}