{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/taylor-lagrange-neural-ordinary-differential","title":"Taylor-Lagrange Neural Ordinary Differential Equations: Toward Fast Training and Evaluation of Neural ODEs","arxiv_id":"2201.05715","date":"2022-01-14","proceeding":null,"authors":["Franck Djeumou","Cyrus Neary","Eric Goubault","Sylvie Putot","Ufuk Topcu"],"abstract":"Neural ordinary differential equations (NODEs) -- parametrizations of differential equations using neural networks -- have shown tremendous promise in learning models of unknown continuous-time dynamical systems from data. However, every forward evaluation of a NODE requires numerical integration of the neural network used to capture the system dynamics, making their training prohibitively expensive. Existing works rely on off-the-shelf adaptive step-size numerical integration schemes, which often require an excessive number of evaluations of the underlying dynamics network to obtain sufficient accuracy for training. By contrast, we accelerate the evaluation and the training of NODEs by proposing a data-driven approach to their numerical integration. The proposed Taylor-Lagrange NODEs (TL-NODEs) use a fixed-order Taylor expansion for numerical integration, while also learning to estimate the expansion's approximation error. As a result, the proposed approach achieves the same accuracy as adaptive step-size schemes while employing only low-order Taylor expansions, thus greatly reducing the computational cost necessary to integrate the NODE. A suite of numerical experiments, including modeling dynamical systems, image classification, and density estimation, demonstrate that TL-NODEs can be trained more than an order of magnitude faster than state-of-the-art approaches, without any loss in performance.","url_abs":"https://arxiv.org/abs/2201.05715v2","url_pdf":"https://arxiv.org/pdf/2201.05715v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"taylor-lagrange-neural-ordinary-differential","repo_url":"https://github.com/wuwushrek/taylanets","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"jax","reach":null}],"tasks":[{"task_slug":"density-estimation","task_name":"Density Estimation"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"numerical-integration","task_name":"Numerical Integration"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[{"method_slug":"node","method_name":"NODE"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2201.05715","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2201.05715"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/wuwushrek/taylanets","reach":null}],"summary":{"ran_draft_wrong":4},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"8c0bd65c12ac49f2","entry":"midpoint_eval","repo":"wuwushrek/taylanets","repo_kind":"official","path":"taylanets/tayla.py","file_url":"https://github.com/wuwushrek/taylanets/blob/HEAD/taylanets/tayla.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"8c0bd65c12ac49f2"}},{"code_sha256_prefix":"54afb5c0e481f9b9","entry":"ode_truncated_taylor","repo":"wuwushrek/taylanets","repo_kind":"official","path":"taylanets/tayla.py","file_url":"https://github.com/wuwushrek/taylanets/blob/HEAD/taylanets/tayla.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"54afb5c0e481f9b9"}},{"code_sha256_prefix":"723f9b58680f8b30","entry":"tayla","repo":"wuwushrek/taylanets","repo_kind":"official","path":"taylanets/tayla.py","file_url":"https://github.com/wuwushrek/taylanets/blob/HEAD/taylanets/tayla.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"723f9b58680f8b30"}},{"code_sha256_prefix":"4a4d0ed534d47018","entry":"taylor_order_n","repo":"wuwushrek/taylanets","repo_kind":"official","path":"taylanets/tayla.py","file_url":"https://github.com/wuwushrek/taylanets/blob/HEAD/taylanets/tayla.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"4a4d0ed534d47018"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}