{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/nonparametric-score-estimators","title":"Nonparametric Score Estimators","arxiv_id":"2005.10099","date":"2020-05-20","proceeding":"ICML 2020 1","authors":["Yuhao Zhou","Jiaxin Shi","Jun Zhu"],"abstract":"Estimating the score, i.e., the gradient of log density function, from a set of samples generated by an unknown distribution is a fundamental task in inference and learning of probabilistic models that involve flexible yet intractable densities. Kernel estimators based on Stein's methods or score matching have shown promise, however their theoretical properties and relationships have not been fully-understood. We provide a unifying view of these estimators under the framework of regularized nonparametric regression. It allows us to analyse existing estimators and construct new ones with desirable properties by choosing different hypothesis spaces and regularizers. A unified convergence analysis is provided for such estimators. Finally, we propose score estimators based on iterative regularization that enjoy computational benefits from curl-free kernels and fast convergence.","url_abs":"https://arxiv.org/abs/2005.10099v2","url_pdf":"https://arxiv.org/pdf/2005.10099v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"nonparametric-score-estimators","repo_url":"https://github.com/miskcoo/kscore","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"nonparametric-score-estimators","repo_url":"https://github.com/brendanmallery9/entropic-barycenters","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2005.10099","atlas_url":"https://app.syntology.ai/?focus=2005.10099","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2005.10099"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/brendanmallery9/entropic-barycenters","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/miskcoo/kscore","reach":null}],"summary":{"ran":4,"ran_draft_wrong":1,"ran_violates":1,"ran_fixture":1,"unverified":3},"by_repo_kind":{"official":{"samples":7,"ran":5,"repositories":1},"listed":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"00dada8da51d1f87","entry":"Base","repo":"miskcoo/kscore","repo_kind":"official","path":"kscore/estimators/tikhonov.py","file_url":"https://github.com/miskcoo/kscore/blob/HEAD/kscore/estimators/tikhonov.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"00dada8da51d1f87"}},{"code_sha256_prefix":"fb9d4f93a7487915","entry":"CurlFreeIMQ","repo":"miskcoo/kscore","repo_kind":"official","path":"kscore/estimators/tikhonov.py","file_url":"https://github.com/miskcoo/kscore/blob/HEAD/kscore/estimators/tikhonov.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fb9d4f93a7487915"}},{"code_sha256_prefix":"bab1d123d3526fe0","entry":"CurlFreeIMQ","repo":"brendanmallery9/entropic-barycenters","repo_kind":"listed","path":"classification_example/kscore/estimators/landweber.py","file_url":"https://github.com/brendanmallery9/entropic-barycenters/blob/HEAD/classification_example/kscore/estimators/landweber.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bab1d123d3526fe0"}},{"code_sha256_prefix":"35137fdaa4981d2f","entry":"SquareCurlFree","repo":"brendanmallery9/entropic-barycenters","repo_kind":"listed","path":"classification_example/kscore/estimators/landweber.py","file_url":"https://github.com/brendanmallery9/entropic-barycenters/blob/HEAD/classification_example/kscore/estimators/landweber.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"35137fdaa4981d2f"}},{"code_sha256_prefix":"8a283ce3ca6eff56","entry":"conjugate_gradient","repo":"miskcoo/kscore","repo_kind":"official","path":"kscore/estimators/tikhonov.py","file_url":"https://github.com/miskcoo/kscore/blob/HEAD/kscore/estimators/tikhonov.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8a283ce3ca6eff56"}},{"code_sha256_prefix":"0172bbfec8cc6de4","entry":"median_heuristic","repo":"miskcoo/kscore","repo_kind":"official","path":"kscore/estimators/tikhonov.py","file_url":"https://github.com/miskcoo/kscore/blob/HEAD/kscore/estimators/tikhonov.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0172bbfec8cc6de4"}},{"code_sha256_prefix":"699449111969a487","entry":"random_choice","repo":"miskcoo/kscore","repo_kind":"official","path":"kscore/estimators/tikhonov.py","file_url":"https://github.com/miskcoo/kscore/blob/HEAD/kscore/estimators/tikhonov.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"699449111969a487"}},{"code_sha256_prefix":"8a3a8181a923765c","entry":"Landweber","repo":"brendanmallery9/entropic-barycenters","repo_kind":"listed","path":"classification_example/kscore/estimators/landweber.py","file_url":"https://github.com/brendanmallery9/entropic-barycenters/blob/HEAD/classification_example/kscore/estimators/landweber.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8a3a8181a923765c"}},{"code_sha256_prefix":"7f7043b286d83fe0","entry":"SquareCurlFree","repo":"miskcoo/kscore","repo_kind":"official","path":"kscore/estimators/tikhonov.py","file_url":"https://github.com/miskcoo/kscore/blob/HEAD/kscore/estimators/tikhonov.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7f7043b286d83fe0"}},{"code_sha256_prefix":"91c7c7ebc3f9af0a","entry":"Tikhonov","repo":"miskcoo/kscore","repo_kind":"official","path":"kscore/estimators/tikhonov.py","file_url":"https://github.com/miskcoo/kscore/blob/HEAD/kscore/estimators/tikhonov.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"91c7c7ebc3f9af0a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}