{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/nonparametric-teaching-of-implicit-neural","title":"Nonparametric Teaching of Implicit Neural Representations","arxiv_id":"2405.10531","date":"2024-05-17","proceeding":null,"authors":["Chen Zhang","Steven Tin Sui Luo","Jason Chun Lok Li","Yik-Chung Wu","Ngai Wong"],"abstract":"We investigate the learning of implicit neural representation (INR) using an overparameterized multilayer perceptron (MLP) via a novel nonparametric teaching perspective. The latter offers an efficient example selection framework for teaching nonparametrically defined (viz. non-closed-form) target functions, such as image functions defined by 2D grids of pixels. To address the costly training of INRs, we propose a paradigm called Implicit Neural Teaching (INT) that treats INR learning as a nonparametric teaching problem, where the given signal being fitted serves as the target function. The teacher then selects signal fragments for iterative training of the MLP to achieve fast convergence. By establishing a connection between MLP evolution through parameter-based gradient descent and that of function evolution through functional gradient descent in nonparametric teaching, we show for the first time that teaching an overparameterized MLP is consistent with teaching a nonparametric learner. This new discovery readily permits a convenient drop-in of nonparametric teaching algorithms to broadly enhance INR training efficiency, demonstrating 30%+ training time savings across various input modalities.","url_abs":"https://arxiv.org/abs/2405.10531v1","url_pdf":"https://arxiv.org/pdf/2405.10531v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"nonparametric-teaching-of-implicit-neural","repo_url":"https://github.com/chen2hang/INT_NonparametricTeaching","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"nonparametric-teaching-of-implicit-neural","repo_url":"https://github.com/chen2hang/GraNT_NonparametricTeaching","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2405.10531","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.10531"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chen2hang/INT_NonparametricTeaching","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chen2hang/GraNT_NonparametricTeaching","reach":null}],"summary":{"ran":3,"ran_honours":1,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"36ecff07553664f4","entry":"dense","repo":"chen2hang/INT_NonparametricTeaching","repo_kind":"official","path":"src/strategy.py","file_url":"https://github.com/chen2hang/INT_NonparametricTeaching/blob/HEAD/src/strategy.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"36ecff07553664f4"}},{"code_sha256_prefix":"b8663a50912276c9","entry":"dense2","repo":"chen2hang/INT_NonparametricTeaching","repo_kind":"official","path":"src/strategy.py","file_url":"https://github.com/chen2hang/INT_NonparametricTeaching/blob/HEAD/src/strategy.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b8663a50912276c9"}},{"code_sha256_prefix":"d4bf475f0a761cbe","entry":"revIncremental","repo":"chen2hang/INT_NonparametricTeaching","repo_kind":"official","path":"src/strategy.py","file_url":"https://github.com/chen2hang/INT_NonparametricTeaching/blob/HEAD/src/strategy.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d4bf475f0a761cbe"}},{"code_sha256_prefix":"d62b3572d56661ba","entry":"strategy_factory","repo":"chen2hang/INT_NonparametricTeaching","repo_kind":"official","path":"src/strategy.py","file_url":"https://github.com/chen2hang/INT_NonparametricTeaching/blob/HEAD/src/strategy.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d62b3572d56661ba"}},{"code_sha256_prefix":"b57dc0e099c92e9b","entry":"void","repo":"chen2hang/INT_NonparametricTeaching","repo_kind":"official","path":"src/strategy.py","file_url":"https://github.com/chen2hang/INT_NonparametricTeaching/blob/HEAD/src/strategy.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b57dc0e099c92e9b"}},{"code_sha256_prefix":"436075400676878e","entry":"exponential","repo":"chen2hang/INT_NonparametricTeaching","repo_kind":"official","path":"src/strategy.py","file_url":"https://github.com/chen2hang/INT_NonparametricTeaching/blob/HEAD/src/strategy.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"436075400676878e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}