{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-ridgelet-prior-a-covariance-function","title":"The Ridgelet Prior: A Covariance Function Approach to Prior Specification for Bayesian Neural Networks","arxiv_id":"2010.08488","date":"2020-10-16","proceeding":null,"authors":["Takuo Matsubara","Chris J. Oates","François-Xavier Briol"],"abstract":"Bayesian neural networks attempt to combine the strong predictive performance of neural networks with formal quantification of uncertainty associated with the predictive output in the Bayesian framework. However, it remains unclear how to endow the parameters of the network with a prior distribution that is meaningful when lifted into the output space of the network. A possible solution is proposed that enables the user to posit an appropriate Gaussian process covariance function for the task at hand. Our approach constructs a prior distribution for the parameters of the network, called a ridgelet prior, that approximates the posited Gaussian process in the output space of the network. In contrast to existing work on the connection between neural networks and Gaussian processes, our analysis is non-asymptotic, with finite sample-size error bounds provided. This establishes the universality property that a Bayesian neural network can approximate any Gaussian process whose covariance function is sufficiently regular. Our experimental assessment is limited to a proof-of-concept, where we demonstrate that the ridgelet prior can out-perform an unstructured prior on regression problems for which a suitable Gaussian process prior can be provided.","url_abs":"https://arxiv.org/abs/2010.08488v4","url_pdf":"https://arxiv.org/pdf/2010.08488v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-ridgelet-prior-a-covariance-function","repo_url":"https://github.com/takuomatsubara/BNN-RidgeletPrior","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"gaussian-processes","task_name":"Gaussian Processes"}],"methods":[{"method_slug":"gaussian-process","method_name":"Gaussian Process"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2010.08488","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.08488"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/takuomatsubara/BNN-RidgeletPrior","reach":null}],"summary":{"ran_honours":5},"by_repo_kind":{"official":{"samples":5,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"e7163d085c5a3d53","entry":"gp_cov","repo":"takuomatsubara/BNN-RidgeletPrior","repo_kind":"official","path":"Code_Posterior/Experiment_Airline.py","file_url":"https://github.com/takuomatsubara/BNN-RidgeletPrior/blob/HEAD/Code_Posterior/Experiment_Airline.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e7163d085c5a3d53"}},{"code_sha256_prefix":"9e2ddc84b413b52d","entry":"gp_cov","repo":"takuomatsubara/BNN-RidgeletPrior","repo_kind":"official","path":"Code_Prior/Experiment_Prior.py","file_url":"https://github.com/takuomatsubara/BNN-RidgeletPrior/blob/HEAD/Code_Prior/Experiment_Prior.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9e2ddc84b413b52d"}},{"code_sha256_prefix":"8257ec2f3d7467e4","entry":"gp_mean","repo":"takuomatsubara/BNN-RidgeletPrior","repo_kind":"official","path":"Code_Posterior/Experiment_Airline.py","file_url":"https://github.com/takuomatsubara/BNN-RidgeletPrior/blob/HEAD/Code_Posterior/Experiment_Airline.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8257ec2f3d7467e4"}},{"code_sha256_prefix":"9adec130c212d579","entry":"gp_mean","repo":"takuomatsubara/BNN-RidgeletPrior","repo_kind":"official","path":"Code_Prior/Experiment_Prior.py","file_url":"https://github.com/takuomatsubara/BNN-RidgeletPrior/blob/HEAD/Code_Prior/Experiment_Prior.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9adec130c212d579"}},{"code_sha256_prefix":"231455d6b9ae0f36","entry":"q_method","repo":"takuomatsubara/BNN-RidgeletPrior","repo_kind":"official","path":"Code_Prior/Experiment_Prior.py","file_url":"https://github.com/takuomatsubara/BNN-RidgeletPrior/blob/HEAD/Code_Prior/Experiment_Prior.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"231455d6b9ae0f36"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}