{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/s2p-state-conditioned-image-synthesis-for","title":"S2P: State-conditioned Image Synthesis for Data Augmentation in Offline Reinforcement Learning","arxiv_id":"2209.15256","date":"2022-09-30","proceeding":null,"authors":["Daesol Cho","Dongseok Shim","H. Jin Kim"],"abstract":"Offline reinforcement learning (Offline RL) suffers from the innate distributional shift as it cannot interact with the physical environment during training. To alleviate such limitation, state-based offline RL leverages a learned dynamics model from the logged experience and augments the predicted state transition to extend the data distribution. For exploiting such benefit also on the image-based RL, we firstly propose a generative model, S2P (State2Pixel), which synthesizes the raw pixel of the agent from its corresponding state. It enables bridging the gap between the state and the image domain in RL algorithms, and virtually exploring unseen image distribution via model-based transition in the state space. Through experiments, we confirm that our S2P-based image synthesis not only improves the image-based offline RL performance but also shows powerful generalization capability on unseen tasks.","url_abs":"https://arxiv.org/abs/2209.15256v1","url_pdf":"https://arxiv.org/pdf/2209.15256v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"s2p-state-conditioned-image-synthesis-for","repo_url":"https://github.com/dsshim0125/s2p","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"offline-rl","task_name":"Offline RL"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2209.15256","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2209.15256"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dsshim0125/s2p","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"unverified":5},"by_repo_kind":{"official":{"samples":7,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"fadf5f762ff04cd6","entry":"create_stats_ordered_dict","repo":"dsshim0125/s2p","repo_kind":"official","path":"rlkit/core/eval_util.py","file_url":"https://github.com/dsshim0125/s2p/blob/HEAD/rlkit/core/eval_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fadf5f762ff04cd6"}},{"code_sha256_prefix":"a5d10a0b704c8db7","entry":"get_average_returns","repo":"dsshim0125/s2p","repo_kind":"official","path":"rlkit/core/eval_util.py","file_url":"https://github.com/dsshim0125/s2p/blob/HEAD/rlkit/core/eval_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5d10a0b704c8db7"}},{"code_sha256_prefix":"6dc14f1205c31904","entry":"add_prefix","repo":"dsshim0125/s2p","repo_kind":"official","path":"rlkit/core/logging.py","file_url":"https://github.com/dsshim0125/s2p/blob/HEAD/rlkit/core/logging.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6dc14f1205c31904"}},{"code_sha256_prefix":"46e6d80fdfab6884","entry":"append_log","repo":"dsshim0125/s2p","repo_kind":"official","path":"rlkit/core/logging.py","file_url":"https://github.com/dsshim0125/s2p/blob/HEAD/rlkit/core/logging.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"46e6d80fdfab6884"}},{"code_sha256_prefix":"f725932e0f8878f4","entry":"normalize_image","repo":"dsshim0125/s2p","repo_kind":"official","path":"multiworld_custom/core/image_env.py","file_url":"https://github.com/dsshim0125/s2p/blob/HEAD/multiworld_custom/core/image_env.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f725932e0f8878f4"}},{"code_sha256_prefix":"3b4df5488a40f1ca","entry":"soft_clamp","repo":"dsshim0125/s2p","repo_kind":"official","path":"gaussian_ensemble.py","file_url":"https://github.com/dsshim0125/s2p/blob/HEAD/gaussian_ensemble.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b4df5488a40f1ca"}},{"code_sha256_prefix":"57b9f4dd9833bb0b","entry":"unormalize_image","repo":"dsshim0125/s2p","repo_kind":"official","path":"multiworld_custom/core/image_env.py","file_url":"https://github.com/dsshim0125/s2p/blob/HEAD/multiworld_custom/core/image_env.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"57b9f4dd9833bb0b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}