{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-16692","title":"EfficientTDMPC: Improved MPC Objectives for Sample-Efficient Continuous Control","arxiv_id":"2605.16692","date":"2026-05-15","proceeding":null,"authors":["Thomas Evers","Cristian Meo","Wendelin Bohmer","Justin Dauwels","Yaniv Oren"],"abstract":"We introduce EfficientTDMPC, a sample-efficient model-based reinforcement learning method for continuous control built on the TD-MPC family of algorithms. Central to this family is a planner that aims to find an action sequence that maximizes the estimated return. The return is estimated using a learned model and value networks, each of which can introduce error. EfficientTDMPC proposes to reduce this error in two ways. First, it introduces an ensemble of dynamics models and averages the return estimates across those models and across different rollout depths. Second, it adds the option to apply an uncertainty penalty to the planner objective, yielding a planner that avoids actions with uncertain return estimates. It then adds practical improvements which increase buffer data freshness and reduce compute. Lastly, we find that our contributions enable EfficientTDMPC to benefit more from a higher update-to-data (UTD) ratio, further improving sample efficiency. To the best of our knowledge, in the low data regime of each benchmark, EfficientTDMPC achieves state-of-the-art (SOTA) in terms of sample efficiency on HumanoidBench-Hard and DMC hard, while matching SOTA on DMC easy.","url_abs":"https://arxiv.org/abs/2605.16692","url_pdf":"https://arxiv.org/pdf/2605.16692","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.16692","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.16692"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/wertyuilife2/bmpc","reach":{"status":"ok","spdx":"MIT"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/molumitu/BOOM_MBRL","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/carlosferrazza/humanoid-bench","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/facebookresearch/MRSQ","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/naumix/BiggerRegularizedCategorical","reach":null}],"summary":{"ran":10,"unverified":10},"by_repo_kind":{"found_in_text":{"samples":20,"ran":10,"repositories":4}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"e748877bbe0d32c9","entry":"RunningScale","repo":"carlosferrazza/humanoid-bench","repo_kind":"found_in_text","path":"tdmpc2/tdmpc2/tdmpc2.py","file_url":"https://github.com/carlosferrazza/humanoid-bench/blob/HEAD/tdmpc2/tdmpc2/tdmpc2.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"e748877bbe0d32c9"}},{"code_sha256_prefix":"9c8db9734f336095","entry":"cfg_to_dataclass","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/parser.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/parser.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9c8db9734f336095"}},{"code_sha256_prefix":"92606899d7569240","entry":"cfg_to_group","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/logger.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/logger.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"92606899d7569240"}},{"code_sha256_prefix":"09a1b332222b32f5","entry":"conv","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/layers.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/layers.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09a1b332222b32f5"}},{"code_sha256_prefix":"102864ce41266282","entry":"enc","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/layers.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/layers.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"102864ce41266282"}},{"code_sha256_prefix":"3ffae94f45894637","entry":"gaussian_logprob","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/math.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/math.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3ffae94f45894637"}},{"code_sha256_prefix":"2bf6e2d95f0a3b0c","entry":"log_std","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/math.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/math.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2bf6e2d95f0a3b0c"}},{"code_sha256_prefix":"436a7981ede1cf9d","entry":"make_dir","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/logger.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/logger.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"436a7981ede1cf9d"}},{"code_sha256_prefix":"596a1441bb20a1c6","entry":"mlp","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/layers.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/layers.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"596a1441bb20a1c6"}},{"code_sha256_prefix":"be09547faeeb18b1","entry":"soft_ce","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/math.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/math.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"be09547faeeb18b1"}},{"code_sha256_prefix":"ae3d86c4229441f5","entry":"BOOM","repo":"molumitu/BOOM_MBRL","repo_kind":"found_in_text","path":"boom/boom_alg.py","file_url":"https://github.com/molumitu/BOOM_MBRL/blob/HEAD/boom/boom_alg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ae3d86c4229441f5"}},{"code_sha256_prefix":"db30583ebf188c17","entry":"BroNet","repo":"naumix/BiggerRegularizedCategorical","repo_kind":"found_in_text","path":"jaxrl/networks.py","file_url":"https://github.com/naumix/BiggerRegularizedCategorical/blob/HEAD/jaxrl/networks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"db30583ebf188c17"}},{"code_sha256_prefix":"540276a61b9389a0","entry":"BronetBlock","repo":"naumix/BiggerRegularizedCategorical","repo_kind":"found_in_text","path":"jaxrl/networks.py","file_url":"https://github.com/naumix/BiggerRegularizedCategorical/blob/HEAD/jaxrl/networks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"540276a61b9389a0"}},{"code_sha256_prefix":"8db705a2d4f2ef18","entry":"Critic","repo":"naumix/BiggerRegularizedCategorical","repo_kind":"found_in_text","path":"jaxrl/networks.py","file_url":"https://github.com/naumix/BiggerRegularizedCategorical/blob/HEAD/jaxrl/networks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8db705a2d4f2ef18"}},{"code_sha256_prefix":"262c6f631e75ea9d","entry":"QValue","repo":"naumix/BiggerRegularizedCategorical","repo_kind":"found_in_text","path":"jaxrl/networks.py","file_url":"https://github.com/naumix/BiggerRegularizedCategorical/blob/HEAD/jaxrl/networks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"262c6f631e75ea9d"}},{"code_sha256_prefix":"9005ee8b23cd714b","entry":"QValueEnsemble","repo":"naumix/BiggerRegularizedCategorical","repo_kind":"found_in_text","path":"jaxrl/networks.py","file_url":"https://github.com/naumix/BiggerRegularizedCategorical/blob/HEAD/jaxrl/networks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9005ee8b23cd714b"}},{"code_sha256_prefix":"fd8c905943871851","entry":"TDMPC2","repo":"carlosferrazza/humanoid-bench","repo_kind":"found_in_text","path":"tdmpc2/tdmpc2/tdmpc2.py","file_url":"https://github.com/carlosferrazza/humanoid-bench/blob/HEAD/tdmpc2/tdmpc2/tdmpc2.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"fd8c905943871851"}},{"code_sha256_prefix":"671c9319d1eb04fc","entry":"WorldModel","repo":"carlosferrazza/humanoid-bench","repo_kind":"found_in_text","path":"tdmpc2/tdmpc2/tdmpc2.py","file_url":"https://github.com/carlosferrazza/humanoid-bench/blob/HEAD/tdmpc2/tdmpc2/tdmpc2.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"671c9319d1eb04fc"}},{"code_sha256_prefix":"22cac6d774940011","entry":"WorldModel","repo":"molumitu/BOOM_MBRL","repo_kind":"found_in_text","path":"boom/boom_alg.py","file_url":"https://github.com/molumitu/BOOM_MBRL/blob/HEAD/boom/boom_alg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"22cac6d774940011"}},{"code_sha256_prefix":"c4f49dcf5899af90","entry":"print_run","repo":"wertyuilife2/bmpc","repo_kind":"found_in_text","path":"bmpc/common/logger.py","file_url":"https://github.com/wertyuilife2/bmpc/blob/HEAD/bmpc/common/logger.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4f49dcf5899af90"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}