{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/random-features-and-polynomial-rules","title":"Random features and polynomial rules","arxiv_id":"2402.10164","date":"2024-02-15","proceeding":null,"authors":["Fabián Aguirre-López","Silvio Franz","Mauro Pastore"],"abstract":"Random features models play a distinguished role in the theory of deep learning, describing the behavior of neural networks close to their infinite-width limit. In this work, we present a thorough analysis of the generalization performance of random features models for generic supervised learning problems with Gaussian data. Our approach, built with tools from the statistical mechanics of disordered systems, maps the random features model to an equivalent polynomial model, and allows us to plot average generalization curves as functions of the two main control parameters of the problem: the number of random features $N$ and the size $P$ of the training set, both assumed to scale as powers in the input dimension $D$. Our results extend the case of proportional scaling between $N$, $P$ and $D$. They are in accordance with rigorous bounds known for certain particular learning tasks and are in quantitative agreement with numerical experiments performed over many order of magnitudes of $N$ and $P$. We find good agreement also far from the asymptotic limits where $D\\to \\infty$ and at least one between $P/D^K$, $N/D^L$ remains finite.","url_abs":"https://arxiv.org/abs/2402.10164v2","url_pdf":"https://arxiv.org/pdf/2402.10164v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"random-features-and-polynomial-rules","repo_url":"https://github.com/mauropastore/randomfeatures","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"jax","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.10164","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.10164"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mauropastore/randomfeatures","reach":null}],"summary":{"ran_fixture":1,"ran_violates":2},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"ed56f621a2d32ded","entry":"higher_perceptron","repo":"mauropastore/randomfeatures","repo_kind":"official","path":"regenerate_data/RandomFeatures.py","file_url":"https://github.com/mauropastore/randomfeatures/blob/HEAD/regenerate_data/RandomFeatures.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"ed56f621a2d32ded"}},{"code_sha256_prefix":"131a1024fe355c4a","entry":"perceptron_fun","repo":"mauropastore/randomfeatures","repo_kind":"official","path":"regenerate_data/RandomFeatures.py","file_url":"https://github.com/mauropastore/randomfeatures/blob/HEAD/regenerate_data/RandomFeatures.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"131a1024fe355c4a"}},{"code_sha256_prefix":"7dbb0443fc6d2095","entry":"twoLayer","repo":"mauropastore/randomfeatures","repo_kind":"official","path":"regenerate_data/RandomFeatures.py","file_url":"https://github.com/mauropastore/randomfeatures/blob/HEAD/regenerate_data/RandomFeatures.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"7dbb0443fc6d2095"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}