{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/neuralef-deconstructing-kernels-by-deep","title":"NeuralEF: Deconstructing Kernels by Deep Neural Networks","arxiv_id":"2205.00165","date":"2022-04-30","proceeding":null,"authors":["Zhijie Deng","Jiaxin Shi","Jun Zhu"],"abstract":"Learning the principal eigenfunctions of an integral operator defined by a kernel and a data distribution is at the core of many machine learning problems. Traditional nonparametric solutions based on the Nystr{\\\"o}m formula suffer from scalability issues. Recent work has resorted to a parametric approach, i.e., training neural networks to approximate the eigenfunctions. However, the existing method relies on an expensive orthogonalization step and is difficult to implement. We show that these problems can be fixed by using a new series of objective functions that generalizes the EigenGame~\\citep{gemp2020eigengame} to function space. We test our method on a variety of supervised and unsupervised learning problems and show it provides accurate approximations to the eigenfunctions of polynomial, radial basis, neural network Gaussian process, and neural tangent kernels. Finally, we demonstrate our method can scale up linearised Laplace approximation of deep neural networks to modern image classification datasets through approximating the Gauss-Newton matrix. Code is available at \\url{https://github.com/thudzj/neuraleigenfunction}.","url_abs":"https://arxiv.org/abs/2205.00165v4","url_pdf":"https://arxiv.org/pdf/2205.00165v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"neuralef-deconstructing-kernels-by-deep","repo_url":"https://github.com/thudzj/neuraleigenfunction","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"jax","reach":null},{"paper_slug":"neuralef-deconstructing-kernels-by-deep","repo_url":"https://github.com/jongharyu/neural-svd","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2205.00165","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.00165"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/AlexImmer/Laplace","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/thudzj/neuraleigenfunction","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jongharyu/neural-svd","reach":null}],"summary":{"ran":5,"ran_draft_wrong":2,"ran_fixture":2,"unverified":3},"by_repo_kind":{"official":{"samples":8,"ran":7,"repositories":1},"listed":{"samples":4,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"e20b288efb99aff8","entry":"BatchL2NormalizedFunctions","repo":"jongharyu/neural-svd","repo_kind":"listed","path":"methods/neuralef.py","file_url":"https://github.com/jongharyu/neural-svd/blob/HEAD/methods/neuralef.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e20b288efb99aff8"}},{"code_sha256_prefix":"3f19c747deb14edb","entry":"Erf","repo":"thudzj/neuraleigenfunction","repo_kind":"official","path":"neuralef-classic-kernels.py","file_url":"https://github.com/thudzj/neuraleigenfunction/blob/HEAD/neuralef-classic-kernels.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3f19c747deb14edb"}},{"code_sha256_prefix":"e2322ed570ee0f15","entry":"ParallelLinear","repo":"thudzj/neuraleigenfunction","repo_kind":"official","path":"neuralef-classic-kernels.py","file_url":"https://github.com/thudzj/neuraleigenfunction/blob/HEAD/neuralef-classic-kernels.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e2322ed570ee0f15"}},{"code_sha256_prefix":"a3ce9d17389042d9","entry":"ParallelMLP","repo":"thudzj/neuraleigenfunction","repo_kind":"official","path":"neuralef-classic-kernels.py","file_url":"https://github.com/thudzj/neuraleigenfunction/blob/HEAD/neuralef-classic-kernels.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a3ce9d17389042d9"}},{"code_sha256_prefix":"3ab24503a09a9739","entry":"SinAndCos","repo":"thudzj/neuraleigenfunction","repo_kind":"official","path":"neuralef-classic-kernels.py","file_url":"https://github.com/thudzj/neuraleigenfunction/blob/HEAD/neuralef-classic-kernels.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ab24503a09a9739"}},{"code_sha256_prefix":"a5d048a1151af665","entry":"compute_gram","repo":"jongharyu/neural-svd","repo_kind":"listed","path":"methods/neuralef.py","file_url":"https://github.com/jongharyu/neural-svd/blob/HEAD/methods/neuralef.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5d048a1151af665"}},{"code_sha256_prefix":"0328d3e26a42419c","entry":"our","repo":"thudzj/neuraleigenfunction","repo_kind":"official","path":"neuralef-classic-kernels.py","file_url":"https://github.com/thudzj/neuraleigenfunction/blob/HEAD/neuralef-classic-kernels.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0328d3e26a42419c"}},{"code_sha256_prefix":"a1601e74d6719036","entry":"sample_from_ntk","repo":"thudzj/neuraleigenfunction","repo_kind":"official","path":"neuralef-cifar-ntks.py","file_url":"https://github.com/thudzj/neuraleigenfunction/blob/HEAD/neuralef-cifar-ntks.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a1601e74d6719036"}},{"code_sha256_prefix":"0b126adb297549d0","entry":"train_nef","repo":"thudzj/neuraleigenfunction","repo_kind":"official","path":"neuralef-cifar-ntks.py","file_url":"https://github.com/thudzj/neuraleigenfunction/blob/HEAD/neuralef-cifar-ntks.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0b126adb297549d0"}},{"code_sha256_prefix":"7aab477eb39558bb","entry":"NeuralEigenFunctions","repo":"thudzj/neuraleigenfunction","repo_kind":"official","path":"neuralef-classic-kernels.py","file_url":"https://github.com/thudzj/neuraleigenfunction/blob/HEAD/neuralef-classic-kernels.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7aab477eb39558bb"}},{"code_sha256_prefix":"acbadc0f5c1fdbf7","entry":"NeuralEigenfunctions","repo":"jongharyu/neural-svd","repo_kind":"listed","path":"methods/neuralef.py","file_url":"https://github.com/jongharyu/neural-svd/blob/HEAD/methods/neuralef.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"acbadc0f5c1fdbf7"}},{"code_sha256_prefix":"17126ced43f1ee1b","entry":"NeuralEigenfunctionsLossFunction","repo":"jongharyu/neural-svd","repo_kind":"listed","path":"methods/neuralef.py","file_url":"https://github.com/jongharyu/neural-svd/blob/HEAD/methods/neuralef.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"17126ced43f1ee1b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}