{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ab-initio-nonparametric-variable-selection","title":"Ab Initio Nonparametric Variable Selection for Scalable Symbolic Regression with Large $p$","arxiv_id":"2410.13681","date":"2024-10-17","proceeding":null,"authors":["Shengbin Ye","Meng Li"],"abstract":"Symbolic regression (SR) is a powerful technique for discovering symbolic expressions that characterize nonlinear relationships in data, gaining increasing attention for its interpretability, compactness, and robustness. However, existing SR methods do not scale to datasets with a large number of input variables (referred to as extreme-scale SR), which is common in modern scientific applications. This ``large $p$'' setting, often accompanied by measurement error, leads to slow performance of SR methods and overly complex expressions that are difficult to interpret. To address this scalability challenge, we propose a method called PAN+SR, which combines a key idea of ab initio nonparametric variable selection with SR to efficiently pre-screen large input spaces and reduce search complexity while maintaining accuracy. The use of nonparametric methods eliminates model misspecification, supporting a strategy called parametric-assisted nonparametric (PAN). We also extend SRBench, an open-source benchmarking platform, by incorporating high-dimensional regression problems with various signal-to-noise ratios. Our results demonstrate that PAN+SR consistently enhances the performance of 19 contemporary SR methods, enabling several to achieve state-of-the-art performance on these challenging datasets.","url_abs":"https://arxiv.org/abs/2410.13681v2","url_pdf":"https://arxiv.org/pdf/2410.13681v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ab-initio-nonparametric-variable-selection","repo_url":"https://github.com/mattsheng/PAN_SR","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"GPL-3.0"}}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"symbolic-regression","task_name":"Symbolic Regression"},{"task_slug":"variable-selection","task_name":"Variable Selection"},{"task_slug":"regression-1","task_name":"regression"}],"methods":[{"method_slug":"attention","method_name":"Attention"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.13681","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.13681"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/mattsheng/PAN","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mattsheng/PAN_SR","reach":{"status":"ok","spdx":"GPL-3.0"}}],"summary":{"ran":2,"ran_honours":1},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"5778069a13196214","entry":"complexity","repo":"mattsheng/PAN_SR","repo_kind":"official","path":"experiment/assess_symbolic_model.py","file_url":"https://github.com/mattsheng/PAN_SR/blob/HEAD/experiment/assess_symbolic_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"5778069a13196214"}},{"code_sha256_prefix":"78fbb3b513d540ed","entry":"f1","repo":"mattsheng/PAN_SR","repo_kind":"official","path":"experiment/evaluate_model.py","file_url":"https://github.com/mattsheng/PAN_SR/blob/HEAD/experiment/evaluate_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"78fbb3b513d540ed"}},{"code_sha256_prefix":"2d5cb465f05c3580","entry":"generate_dataset","repo":"mattsheng/pan_sr","repo_kind":"official","path":"feynman_dataset_code/generate_feynman_dataset.py","file_url":"https://github.com/mattsheng/pan_sr/blob/HEAD/feynman_dataset_code/generate_feynman_dataset.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"2d5cb465f05c3580"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}