{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/which-priors-matter-benchmarking-models-for","title":"Which priors matter? Benchmarking models for learning latent dynamics","arxiv_id":"2111.05458","date":"2021-11-09","proceeding":null,"authors":["Aleksandar Botev","Andrew Jaegle","Peter Wirnsberger","Daniel Hennes","Irina Higgins"],"abstract":"Learning dynamics is at the heart of many important applications of machine learning (ML), such as robotics and autonomous driving. In these settings, ML algorithms typically need to reason about a physical system using high dimensional observations, such as images, without access to the underlying state. Recently, several methods have proposed to integrate priors from classical mechanics into ML models to address the challenge of physical reasoning from images. In this work, we take a sober look at the current capabilities of these models. To this end, we introduce a suite consisting of 17 datasets with visual observations based on physical systems exhibiting a wide range of dynamics. We conduct a thorough and detailed comparison of the major classes of physically inspired methods alongside several strong baselines. While models that incorporate physical priors can often learn latent spaces with desirable properties, our results demonstrate that these methods fail to significantly improve upon standard techniques. Nonetheless, we find that the use of continuous and time-reversible dynamics benefits models of all classes.","url_abs":"https://arxiv.org/abs/2111.05458v1","url_pdf":"https://arxiv.org/pdf/2111.05458v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"which-priors-matter-benchmarking-models-for","repo_url":"https://github.com/deepmind/dm_hamiltonian_dynamics_suite","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"jax","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"which-priors-matter-benchmarking-models-for","repo_url":"https://github.com/westny/neural-stability","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"benchmarking","task_name":"Benchmarking"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2111.05458","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2111.05458"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/westny/neural-stability","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/deepmind/dm_hamiltonian_dynamics_suite","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":11},"by_repo_kind":{"listed":{"samples":11,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"eb6680dca1c08000","entry":"collate_fn_img","repo":"westny/neural-stability","repo_kind":"listed","path":"latent_dynamics/data_utils.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/latent_dynamics/data_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"eb6680dca1c08000"}},{"code_sha256_prefix":"f2bc3a70a36b7d38","entry":"collate_fn_state","repo":"westny/neural-stability","repo_kind":"listed","path":"latent_dynamics/data_utils.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/latent_dynamics/data_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f2bc3a70a36b7d38"}},{"code_sha256_prefix":"4a9ef9984aad0d97","entry":"create_hdf5_dataset","repo":"westny/neural-stability","repo_kind":"listed","path":"latent_dynamics/tf_converter_hdf5.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/latent_dynamics/tf_converter_hdf5.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4a9ef9984aad0d97"}},{"code_sha256_prefix":"c7ed721f4fc7e643","entry":"import_from_module","repo":"westny/neural-stability","repo_kind":"listed","path":"preamble.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/preamble.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c7ed721f4fc7e643"}},{"code_sha256_prefix":"cc34274b1d241296","entry":"import_module","repo":"westny/neural-stability","repo_kind":"listed","path":"preamble.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/preamble.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cc34274b1d241296"}},{"code_sha256_prefix":"92c60eff70817c99","entry":"load_config","repo":"westny/neural-stability","repo_kind":"listed","path":"preamble.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/preamble.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"92c60eff70817c99"}},{"code_sha256_prefix":"2ab8be501247153a","entry":"ortho_matrix","repo":"westny/neural-stability","repo_kind":"listed","path":"stb_init.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/stb_init.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2ab8be501247153a"}},{"code_sha256_prefix":"7cdf1377f0fc42ca","entry":"sample_exclusive_poles","repo":"westny/neural-stability","repo_kind":"listed","path":"stb_init.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/stb_init.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7cdf1377f0fc42ca"}},{"code_sha256_prefix":"98bac5814c1eef56","entry":"sample_poles","repo":"westny/neural-stability","repo_kind":"listed","path":"stb_init.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/stb_init.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"98bac5814c1eef56"}},{"code_sha256_prefix":"71d07db29119f009","entry":"str_to_bool","repo":"westny/neural-stability","repo_kind":"listed","path":"arguments.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/arguments.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"71d07db29119f009"}},{"code_sha256_prefix":"023376a296c28fe0","entry":"switch","repo":"westny/neural-stability","repo_kind":"listed","path":"latent_dynamics/data_utils.py","file_url":"https://github.com/westny/neural-stability/blob/HEAD/latent_dynamics/data_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"023376a296c28fe0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}