{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/on-the-similarity-between-the-laplace-and","title":"On the Similarity between the Laplace and Neural Tangent Kernels","arxiv_id":"2007.01580","date":"2020-07-03","proceeding":"NeurIPS 2020 12","authors":["Amnon Geifman","Abhay Yadav","Yoni Kasten","Meirav Galun","David Jacobs","Ronen Basri"],"abstract":"Recent theoretical work has shown that massively overparameterized neural networks are equivalent to kernel regressors that use Neural Tangent Kernels(NTK). Experiments show that these kernel methods perform similarly to real neural networks. Here we show that NTK for fully connected networks is closely related to the standard Laplace kernel. We show theoretically that for normalized data on the hypersphere both kernels have the same eigenfunctions and their eigenvalues decay polynomially at the same rate, implying that their Reproducing Kernel Hilbert Spaces (RKHS) include the same sets of functions. This means that both kernels give rise to classes of functions with the same smoothness properties. The two kernels differ for data off the hypersphere, but experiments indicate that when data is properly normalized these differences are not significant. Finally, we provide experiments on real data comparing NTK and the Laplace kernel, along with a larger class of{\\gamma}-exponential kernels. We show that these perform almost identically. Our results suggest that much insight about neural networks can be obtained from analysis of the well-known Laplace kernel, which has a simple closed-form.","url_abs":"https://arxiv.org/abs/2007.01580v2","url_pdf":"https://arxiv.org/pdf/2007.01580v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"on-the-similarity-between-the-laplace-and","repo_url":"https://github.com/fwilliams/neural-splines","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[{"method_slug":"ntk","method_name":"NTK"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2007.01580","atlas_url":"https://app.syntology.ai/?focus=2007.01580","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.01580"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fwilliams/neural-splines","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":3},"by_repo_kind":{"listed":{"samples":3,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ef451f454b770763","entry":"affine_transform_bounding_box","repo":"fwilliams/neural-splines","repo_kind":"listed","path":"neural_splines/geometry.py","file_url":"https://github.com/fwilliams/neural-splines/blob/HEAD/neural_splines/geometry.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef451f454b770763"}},{"code_sha256_prefix":"a73993267f3b9c3b","entry":"affine_transform_pointcloud","repo":"fwilliams/neural-splines","repo_kind":"listed","path":"neural_splines/geometry.py","file_url":"https://github.com/fwilliams/neural-splines/blob/HEAD/neural_splines/geometry.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a73993267f3b9c3b"}},{"code_sha256_prefix":"e0cc005330546b74","entry":"normalize_pointcloud_transform","repo":"fwilliams/neural-splines","repo_kind":"listed","path":"neural_splines/geometry.py","file_url":"https://github.com/fwilliams/neural-splines/blob/HEAD/neural_splines/geometry.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e0cc005330546b74"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}