{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/tackling-the-curse-of-dimensionality-with","title":"Tackling the Curse of Dimensionality with Physics-Informed Neural Networks","arxiv_id":"2307.12306","date":"2023-07-23","proceeding":null,"authors":["Zheyuan Hu","Khemraj Shukla","George Em Karniadakis","Kenji Kawaguchi"],"abstract":"The curse-of-dimensionality taxes computational resources heavily with exponentially increasing computational cost as the dimension increases. This poses great challenges in solving high-dimensional PDEs, as Richard E. Bellman first pointed out over 60 years ago. While there has been some recent success in solving numerically partial differential equations (PDEs) in high dimensions, such computations are prohibitively expensive, and true scaling of general nonlinear PDEs to high dimensions has never been achieved. We develop a new method of scaling up physics-informed neural networks (PINNs) to solve arbitrary high-dimensional PDEs. The new method, called Stochastic Dimension Gradient Descent (SDGD), decomposes a gradient of PDEs into pieces corresponding to different dimensions and randomly samples a subset of these dimensional pieces in each iteration of training PINNs. We prove theoretically the convergence and other desired properties of the proposed method. We demonstrate in various diverse tests that the proposed method can solve many notoriously hard high-dimensional PDEs, including the Hamilton-Jacobi-Bellman (HJB) and the Schr\\\"{o}dinger equations in tens of thousands of dimensions very fast on a single GPU using the PINNs mesh-free approach. Notably, we solve nonlinear PDEs with nontrivial, anisotropic, and inseparable solutions in 100,000 effective dimensions in 12 hours on a single GPU using SDGD with PINNs. Since SDGD is a general training methodology of PINNs, it can be applied to any current and future variants of PINNs to scale them up for arbitrary high-dimensional PDEs.","url_abs":"https://arxiv.org/abs/2307.12306v6","url_pdf":"https://arxiv.org/pdf/2307.12306v6.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"tackling-the-curse-of-dimensionality-with","repo_url":"https://github.com/zheyuanhu01/SDGD_PINN","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":null,"task_name":"GPU"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2307.12306","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.12306"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zheyuanhu01/SDGD_PINN","reach":{"status":"ok"}}],"summary":{"ran":5,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"2dbe76551e40d0fe","entry":"Int1TNN","repo":"zheyuanhu01/SDGD_PINN","repo_kind":"official","path":"Section_5.4/integration.py","file_url":"https://github.com/zheyuanhu01/SDGD_PINN/blob/HEAD/Section_5.4/integration.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2dbe76551e40d0fe"}},{"code_sha256_prefix":"d41c1f0639a11bf0","entry":"Int2TNN","repo":"zheyuanhu01/SDGD_PINN","repo_kind":"official","path":"Section_5.4/integration.py","file_url":"https://github.com/zheyuanhu01/SDGD_PINN/blob/HEAD/Section_5.4/integration.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d41c1f0639a11bf0"}},{"code_sha256_prefix":"2080b09cebd53b41","entry":"bd","repo":"zheyuanhu01/SDGD_PINN","repo_kind":"official","path":"Section_5.4/QHO_ACC.py","file_url":"https://github.com/zheyuanhu01/SDGD_PINN/blob/HEAD/Section_5.4/QHO_ACC.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2080b09cebd53b41"}},{"code_sha256_prefix":"405a8738c00c056b","entry":"grad_bd","repo":"zheyuanhu01/SDGD_PINN","repo_kind":"official","path":"Section_5.4/QHO_ACC.py","file_url":"https://github.com/zheyuanhu01/SDGD_PINN/blob/HEAD/Section_5.4/QHO_ACC.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"405a8738c00c056b"}},{"code_sha256_prefix":"0fb5012364d8f883","entry":"normalization","repo":"zheyuanhu01/SDGD_PINN","repo_kind":"official","path":"Section_5.4/integration.py","file_url":"https://github.com/zheyuanhu01/SDGD_PINN/blob/HEAD/Section_5.4/integration.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0fb5012364d8f883"}},{"code_sha256_prefix":"2ad98b0b44c75890","entry":"load_data_HJB_Rosenbrock","repo":"zheyuanhu01/SDGD_PINN","repo_kind":"official","path":"Section_5.3/HJB_Rosenbrock.py","file_url":"https://github.com/zheyuanhu01/SDGD_PINN/blob/HEAD/Section_5.3/HJB_Rosenbrock.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2ad98b0b44c75890"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}