{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-04639","title":"RoboMME: Benchmarking and Understanding Memory for Robotic Generalist Policies","arxiv_id":"2603.04639","date":"2026-03-04","proceeding":"ICML","authors":["Yinpei Dai","Hongze Fu","Jayjun Lee","Yuejiang Liu","Haoran Zhang","Jianing Yang","Chelsea Finn","Nima Fazeli","Joyce Chai"],"abstract":"Memory is critical for long-horizon and history-dependent robotic manipulation. Such tasks often involve counting repeated actions or manipulating objects that become temporarily occluded. Recent vision-language-action (VLA) models have begun to incorporate memory mechanisms; however, their evaluations remain confined to narrow, non-standardized settings. This limits systematic understanding, comparison, and progress measurement. To address these challenges, we introduce RoboMME: a large-scale standardized benchmark for evaluating and advancing VLA models in long-horizon, history-dependent scenarios. Our benchmark comprises 16 manipulation tasks constructed under a carefully designed taxonomy that evaluates temporal, spatial, object, and procedural memory. We further develop a suite of 14 memory-augmented VLA variants built on the π0.5 backbone to systematically explore different memory representations across multiple integration strategies. Experimental results show that the effectiveness of memory representations is highly task-dependent, with each design offering distinct advantages and limitations across different tasks. Videos and code can be found at our website https://robomme.github.io.","url_abs":"https://arxiv.org/abs/2603.04639","url_pdf":"https://arxiv.org/pdf/2603.04639","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.04639","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.04639"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/RoboMME/robomme_policy_learning","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/RoboMME/SAM2Act","reach":{"status":"ok"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/RoboMME/OpenVLA-OFT","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/RoboMME/MemoryVLA","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/RoboMME/DP","reach":null}],"summary":{"ran_draft_wrong":5,"ran_honours":4,"unverified":21},"by_repo_kind":{"found_in_text":{"samples":30,"ran":9,"repositories":4}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":16,"samples":[{"code_sha256_prefix":"d6a68e210556f857","entry":"approx_standard_normal_cdf","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"action_model/diffusion_utils.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/action_model/diffusion_utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d6a68e210556f857"}},{"code_sha256_prefix":"ab1c9568b4e13899","entry":"continuous_gaussian_log_likelihood","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"action_model/diffusion_utils.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/action_model/diffusion_utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ab1c9568b4e13899"}},{"code_sha256_prefix":"3e0fa4efc22272d4","entry":"get_beta_schedule","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"action_model/gaussian_diffusion.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/action_model/gaussian_diffusion.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3e0fa4efc22272d4"}},{"code_sha256_prefix":"36e30c7fb679ec78","entry":"get_named_beta_schedule","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"action_model/gaussian_diffusion.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/action_model/gaussian_diffusion.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"36e30c7fb679ec78"}},{"code_sha256_prefix":"8c56534935f5a294","entry":"load_checkpoint","repo":"RoboMME/OpenVLA-OFT","repo_kind":"found_in_text","path":"vla-scripts/finetune.py","file_url":"https://github.com/RoboMME/OpenVLA-OFT/blob/HEAD/vla-scripts/finetune.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c56534935f5a294"}},{"code_sha256_prefix":"f6d7c009a8efb8b7","entry":"mean_flat","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"action_model/gaussian_diffusion.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/action_model/gaussian_diffusion.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f6d7c009a8efb8b7"}},{"code_sha256_prefix":"62fcb3912a967a50","entry":"modulate","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"action_model/models.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/action_model/models.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"62fcb3912a967a50"}},{"code_sha256_prefix":"8afbfc42c6ea0448","entry":"normal_kl","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"action_model/diffusion_utils.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/action_model/diffusion_utils.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8afbfc42c6ea0448"}},{"code_sha256_prefix":"c61f2447224a1296","entry":"remove_ddp_in_checkpoint","repo":"RoboMME/OpenVLA-OFT","repo_kind":"found_in_text","path":"vla-scripts/finetune.py","file_url":"https://github.com/RoboMME/OpenVLA-OFT/blob/HEAD/vla-scripts/finetune.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c61f2447224a1296"}},{"code_sha256_prefix":"834c6a1b85b73658","entry":"check_identical_files","repo":"RoboMME/OpenVLA-OFT","repo_kind":"found_in_text","path":"experiments/robot/openvla_utils.py","file_url":"https://github.com/RoboMME/OpenVLA-OFT/blob/HEAD/experiments/robot/openvla_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"834c6a1b85b73658"}},{"code_sha256_prefix":"89239e43afbc445b","entry":"deep_update","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"deploy.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/deploy.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"89239e43afbc445b"}},{"code_sha256_prefix":"574d2627a59a3f52","entry":"find_checkpoint_file","repo":"RoboMME/OpenVLA-OFT","repo_kind":"found_in_text","path":"experiments/robot/openvla_utils.py","file_url":"https://github.com/RoboMME/OpenVLA-OFT/blob/HEAD/experiments/robot/openvla_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"574d2627a59a3f52"}},{"code_sha256_prefix":"b1f449e9ed82a3a1","entry":"first_execution_step","repo":"RoboMME/robomme_policy_learning","repo_kind":"found_in_text","path":"src/mme_vla_suite/dataset_builder/robomme_h5_utils.py","file_url":"https://github.com/RoboMME/robomme_policy_learning/blob/HEAD/src/mme_vla_suite/dataset_builder/robomme_h5_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b1f449e9ed82a3a1"}},{"code_sha256_prefix":"8de3e0644f9876fc","entry":"get_action_chunk","repo":"RoboMME/robomme_policy_learning","repo_kind":"found_in_text","path":"src/mme_vla_suite/dataset_builder/build_robomme_dataset.py","file_url":"https://github.com/RoboMME/robomme_policy_learning/blob/HEAD/src/mme_vla_suite/dataset_builder/build_robomme_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8de3e0644f9876fc"}},{"code_sha256_prefix":"800b0b7c258da059","entry":"get_episode_indices","repo":"RoboMME/robomme_policy_learning","repo_kind":"found_in_text","path":"src/mme_vla_suite/dataset_builder/robomme_h5_utils.py","file_url":"https://github.com/RoboMME/robomme_policy_learning/blob/HEAD/src/mme_vla_suite/dataset_builder/robomme_h5_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"800b0b7c258da059"}},{"code_sha256_prefix":"86342d0c78169e15","entry":"get_exp_id","repo":"RoboMME/DP","repo_kind":"found_in_text","path":"eval_envs/trainer/trainer.py","file_url":"https://github.com/RoboMME/DP/blob/HEAD/eval_envs/trainer/trainer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"86342d0c78169e15"}},{"code_sha256_prefix":"883da746d4398ec2","entry":"get_openvla_prompt","repo":"RoboMME/OpenVLA-OFT","repo_kind":"found_in_text","path":"vla-scripts/extern/verify_openvla.py","file_url":"https://github.com/RoboMME/OpenVLA-OFT/blob/HEAD/vla-scripts/extern/verify_openvla.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"883da746d4398ec2"}},{"code_sha256_prefix":"4f5ee0f67427e461","entry":"get_run_id","repo":"RoboMME/OpenVLA-OFT","repo_kind":"found_in_text","path":"vla-scripts/finetune.py","file_url":"https://github.com/RoboMME/OpenVLA-OFT/blob/HEAD/vla-scripts/finetune.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4f5ee0f67427e461"}},{"code_sha256_prefix":"195d44c1b586ddb1","entry":"get_timestep_indices","repo":"RoboMME/robomme_policy_learning","repo_kind":"found_in_text","path":"src/mme_vla_suite/dataset_builder/robomme_h5_utils.py","file_url":"https://github.com/RoboMME/robomme_policy_learning/blob/HEAD/src/mme_vla_suite/dataset_builder/robomme_h5_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"195d44c1b586ddb1"}},{"code_sha256_prefix":"57e5781005061fd6","entry":"make_env_runner_from_cfg","repo":"RoboMME/DP","repo_kind":"found_in_text","path":"eval_envs/trainer/trainer.py","file_url":"https://github.com/RoboMME/DP/blob/HEAD/eval_envs/trainer/trainer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"57e5781005061fd6"}},{"code_sha256_prefix":"2495b7375e1e0d26","entry":"model_is_on_hf_hub","repo":"RoboMME/OpenVLA-OFT","repo_kind":"found_in_text","path":"experiments/robot/openvla_utils.py","file_url":"https://github.com/RoboMME/OpenVLA-OFT/blob/HEAD/experiments/robot/openvla_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2495b7375e1e0d26"}},{"code_sha256_prefix":"0a05e909554e3740","entry":"pack_state","repo":"RoboMME/robomme_policy_learning","repo_kind":"found_in_text","path":"challenge_interface/policy.py","file_url":"https://github.com/RoboMME/robomme_policy_learning/blob/HEAD/challenge_interface/policy.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0a05e909554e3740"}},{"code_sha256_prefix":"7af07bf1a8a753fe","entry":"remap_state_dicts_for_hf","repo":"RoboMME/OpenVLA-OFT","repo_kind":"found_in_text","path":"vla-scripts/extern/convert_openvla_weights_to_hf.py","file_url":"https://github.com/RoboMME/OpenVLA-OFT/blob/HEAD/vla-scripts/extern/convert_openvla_weights_to_hf.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7af07bf1a8a753fe"}},{"code_sha256_prefix":"4b416a2caa2f1336","entry":"remove_prefix","repo":"RoboMME/DP","repo_kind":"found_in_text","path":"eval_envs/utils/distributed_util.py","file_url":"https://github.com/RoboMME/DP/blob/HEAD/eval_envs/utils/distributed_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4b416a2caa2f1336"}},{"code_sha256_prefix":"316204e046806d9e","entry":"replace_bn_with_gn","repo":"RoboMME/DP","repo_kind":"found_in_text","path":"eval_envs/utils/module_replace.py","file_url":"https://github.com/RoboMME/DP/blob/HEAD/eval_envs/utils/module_replace.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"316204e046806d9e"}},{"code_sha256_prefix":"4f852e8d3c834965","entry":"replace_submodules","repo":"RoboMME/DP","repo_kind":"found_in_text","path":"eval_envs/utils/module_replace.py","file_url":"https://github.com/RoboMME/DP/blob/HEAD/eval_envs/utils/module_replace.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4f852e8d3c834965"}},{"code_sha256_prefix":"ed5a57b34c0d97f3","entry":"resize_image","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"deploy.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/deploy.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ed5a57b34c0d97f3"}},{"code_sha256_prefix":"0244e67995bc1e86","entry":"scale_and_resize","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"deploy.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/deploy.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0244e67995bc1e86"}},{"code_sha256_prefix":"5b6eb99c4b199f27","entry":"space_timesteps","repo":"RoboMME/MemoryVLA","repo_kind":"found_in_text","path":"action_model/respace.py","file_url":"https://github.com/RoboMME/MemoryVLA/blob/HEAD/action_model/respace.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5b6eb99c4b199f27"}},{"code_sha256_prefix":"d3a4b8eedff60e37","entry":"unpack_tuple","repo":"RoboMME/OpenVLA-OFT","repo_kind":"found_in_text","path":"prismatic/models/film_vit_wrapper.py","file_url":"https://github.com/RoboMME/OpenVLA-OFT/blob/HEAD/prismatic/models/film_vit_wrapper.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3a4b8eedff60e37"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.AI","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}