{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/fast-and-data-efficient-training-of-rainbow","title":"Fast and Data-Efficient Training of Rainbow: an Experimental Study on Atari","arxiv_id":"2111.10247","date":"2021-11-19","proceeding":null,"authors":["Dominik Schmidt","Thomas Schmied"],"abstract":"Across the Arcade Learning Environment, Rainbow achieves a level of performance competitive with humans and modern RL algorithms. However, attaining this level of performance requires large amounts of data and hardware resources, making research in this area computationally expensive and use in practical applications often infeasible. This paper's contribution is threefold: We (1) propose an improved version of Rainbow, seeking to drastically reduce Rainbow's data, training time, and compute requirements while maintaining its competitive performance; (2) we empirically demonstrate the effectiveness of our approach through experiments on the Arcade Learning Environment, and (3) we conduct a number of ablation studies to investigate the effect of the individual proposed modifications. Our improved version of Rainbow reaches a median human normalized score close to classic Rainbow's, while using 20 times less data and requiring only 7.5 hours of training time on a single GPU. We also provide our full implementation including pre-trained models.","url_abs":"https://arxiv.org/abs/2111.10247v1","url_pdf":"https://arxiv.org/pdf/2111.10247v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"fast-and-data-efficient-training-of-rainbow","repo_url":"https://github.com/schmidtdominik/rainbow","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"atari-games","task_name":"Atari Games"},{"task_slug":null,"task_name":"GPU"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2111.10247","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2111.10247"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/schmidtdominik/Rainbow","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/schmidtdominik/rainbow","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":4},"by_repo_kind":{"official":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"64d6a5f54c227fe0","entry":"env_seeding","repo":"schmidtdominik/Rainbow","repo_kind":"official","path":"common/utils.py","file_url":"https://github.com/schmidtdominik/Rainbow/blob/HEAD/common/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"64d6a5f54c227fe0"}},{"code_sha256_prefix":"da7e41f01c7bfeab","entry":"get_init_states_subdir","repo":"schmidtdominik/Rainbow","repo_kind":"official","path":"common/retro_utils.py","file_url":"https://github.com/schmidtdominik/Rainbow/blob/HEAD/common/retro_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da7e41f01c7bfeab"}},{"code_sha256_prefix":"944c986921f10ba6","entry":"get_model","repo":"schmidtdominik/Rainbow","repo_kind":"official","path":"common/networks.py","file_url":"https://github.com/schmidtdominik/Rainbow/blob/HEAD/common/networks.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"944c986921f10ba6"}},{"code_sha256_prefix":"12d9e5bd7a20a6bd","entry":"prep_observation_for_qnet","repo":"schmidtdominik/Rainbow","repo_kind":"official","path":"common/utils.py","file_url":"https://github.com/schmidtdominik/Rainbow/blob/HEAD/common/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"12d9e5bd7a20a6bd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}