{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-20832","title":"ReLaTS: a Reinforcement Learning-based method for dynamically determining the coupling Time Step in multi-scale simulations of self-gravitating systems","arxiv_id":"2606.20832","date":"2026-06-18","proceeding":null,"authors":["Veronica Saz Ulibarrena","Simon Portegies Zwart"],"abstract":"Astrophysical simulations frequently address multi-scale, multi-physics problems through subsystem decomposition, problem-tailored integration schemes, and coupling on fixed manually set timescales. Here we introduce ReLaTS, a reinforcement learning framework that dynamically selects the coupling time step to optimize the trade-off between accuracy and computational cost. We validate ReLaTS on star clusters containing a planetary system, and test the method by varying the number of stars $N_\\star$ in the cluster and the number of planets ($N_{\\rm planet}$) orbiting one of them. The method finds the optimal coupling time step that balances speed and accuracy without requiring expert knowledge. In addition, the trained network operates independently of the coupled \\textit{N}-body algorithms, displaying stable performance across a range of setups. We observe that the method is less reliable for cases with infinitesimal masses, as their contribution to the total energy is negligible compared to that of the massive bodies, and the network is not capable of recognizing potential errors generated while integrating them. For long-time integration of large $N$ systems, the error accumulates. The reinforcement learning algorithm, however, manages to keep the energy error below a pre-set threshold. This approach substantially reduces energy errors relative to fixed-time step baselines without substantial additional computational overhead. Once trained, ReLaTS requires no expert tuning and generalizes across diverse astrophysical domains, enabling adaptive multi-scale simulations.","url_abs":"https://arxiv.org/abs/2606.20832","url_pdf":"https://arxiv.org/pdf/2606.20832","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.20832","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.20832"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/veronicasaz/RL_bridgedCluster","reach":null}],"summary":{"ran":4,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":6,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"a2ba14c94d554b58","entry":"DQN","repo":"veronicasaz/RL_bridgedCluster","repo_kind":"found_in_text","path":"TrainRL.py","file_url":"https://github.com/veronicasaz/RL_bridgedCluster/blob/HEAD/TrainRL.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a2ba14c94d554b58"}},{"code_sha256_prefix":"3d307ddf22fb0859","entry":"optimize_model","repo":"veronicasaz/RL_bridgedCluster","repo_kind":"found_in_text","path":"TrainRL.py","file_url":"https://github.com/veronicasaz/RL_bridgedCluster/blob/HEAD/TrainRL.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3d307ddf22fb0859"}},{"code_sha256_prefix":"0d01e6f28ed555ed","entry":"select_action","repo":"veronicasaz/RL_bridgedCluster","repo_kind":"found_in_text","path":"TrainRL.py","file_url":"https://github.com/veronicasaz/RL_bridgedCluster/blob/HEAD/TrainRL.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0d01e6f28ed555ed"}},{"code_sha256_prefix":"d3d2e4ac83f573a6","entry":"test_network","repo":"veronicasaz/RL_bridgedCluster","repo_kind":"found_in_text","path":"TrainRL.py","file_url":"https://github.com/veronicasaz/RL_bridgedCluster/blob/HEAD/TrainRL.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d3d2e4ac83f573a6"}},{"code_sha256_prefix":"fa3dff8c2ace4d3a","entry":"ReplayMemory","repo":"veronicasaz/RL_bridgedCluster","repo_kind":"found_in_text","path":"TrainRL.py","file_url":"https://github.com/veronicasaz/RL_bridgedCluster/blob/HEAD/TrainRL.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fa3dff8c2ace4d3a"}},{"code_sha256_prefix":"1a8b954d9dc9dccf","entry":"train_net","repo":"veronicasaz/RL_bridgedCluster","repo_kind":"found_in_text","path":"TrainRL.py","file_url":"https://github.com/veronicasaz/RL_bridgedCluster/blob/HEAD/TrainRL.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1a8b954d9dc9dccf"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}