{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/decision-transformer-reinforcement-learning","title":"Decision Transformer: Reinforcement Learning via Sequence Modeling","arxiv_id":"2106.01345","date":"2021-06-02","proceeding":"NeurIPS 2021 12","authors":["Lili Chen","Kevin Lu","Aravind Rajeswaran","Kimin Lee","Aditya Grover","Michael Laskin","Pieter Abbeel","Aravind Srinivas","Igor Mordatch"],"abstract":"We introduce a framework that abstracts Reinforcement Learning (RL) as a sequence modeling problem. This allows us to draw upon the simplicity and scalability of the Transformer architecture, and associated advances in language modeling such as GPT-x and BERT. In particular, we present Decision Transformer, an architecture that casts the problem of RL as conditional sequence modeling. Unlike prior approaches to RL that fit value functions or compute policy gradients, Decision Transformer simply outputs the optimal actions by leveraging a causally masked Transformer. By conditioning an autoregressive model on the desired return (reward), past states, and actions, our Decision Transformer model can generate future actions that achieve the desired return. Despite its simplicity, Decision Transformer matches or exceeds the performance of state-of-the-art model-free offline RL baselines on Atari, OpenAI Gym, and Key-to-Door tasks.","url_abs":"https://arxiv.org/abs/2106.01345v2","url_pdf":"https://arxiv.org/pdf/2106.01345v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/kzl/decision-transformer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/Amadeus979/decision-transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/Delavari-Alireza/Decision_Transformer_Sequence-Modeling_Deep_Reinforcement_Learning","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/LAS1520/Gato-A-Generalist-Agent","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/RamiSketcher/decision-transformer-ammi","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/cannylab/casual_overhypotheses","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/corl-team/CORL","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/facebookresearch/salina","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/ml-jku/l2m","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/nikhilbarhate99/min-decision-transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/opendilab/DI-engine","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/takuseno/d3rlpy","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/typoverflow/OfflineRL-Lib","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/yun-kwak/decision-transformer-jax","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/zzmtsvv/rl_task","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/2024-MindSpore-1/Code2/tree/main/model-1/decision_transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/HzcIrving/DecisionTransformer_StepbyStep","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/MindCode-4/code-3/tree/main/decision_transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/pwc-1/Paper-8/tree/main/decision_transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"decision-transformer-reinforcement-learning","repo_url":"https://github.com/pytorch/rl/tree/main/examples/decision_transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"jax","reach":null}],"tasks":[{"task_slug":"atari-games","task_name":"Atari Games"},{"task_slug":"d4rl","task_name":"D4RL"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"offline-rl","task_name":"Offline RL"},{"task_slug":"openai-gym","task_name":"OpenAI Gym"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/atari-games-on-atari-2600-breakout","task":"Atari Games","dataset":"Atari 2600 Breakout","model":"DT","rank_in_archive_order":44,"of":58,"metrics":{"Score":"267.5"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-pong","task":"Atari Games","dataset":"Atari 2600 Pong","model":"DT","rank_in_archive_order":43,"of":52,"metrics":{"Score":"17.1"},"uses_additional_data":true},{"leaderboard":"/sota/atari-games-on-atari-2600-qbert","task":"Atari Games","dataset":"Atari 2600 Q*Bert","model":"DT","rank_in_archive_order":56,"of":57,"metrics":{"Score":"25.1"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-seaquest","task":"Atari Games","dataset":"Atari 2600 Seaquest","model":"DT","rank_in_archive_order":56,"of":57,"metrics":{"Score":"2.4"},"uses_additional_data":false},{"leaderboard":"/sota/d4rl-on-d4rl","task":"D4RL","dataset":"D4RL","model":"Decision Transformer (DT)","rank_in_archive_order":5,"of":9,"metrics":{"Average Reward":"72.2"},"uses_additional_data":false},{"leaderboard":"/sota/offline-rl-on-d4rl","task":"Offline RL","dataset":"D4RL","model":"Decision Transformer (DT)","rank_in_archive_order":3,"of":3,"metrics":{"Average Reward":"73.5"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2106.01345","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.01345"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/takuseno/d3rlpy","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kzl/decision-transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Amadeus979/decision-transformer","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pytorch/rl/tree/main/examples/decision_transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindCode-4/code-3/tree/main/decision_transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/corl-team/CORL","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pwc-1/Paper-8/tree/main/decision_transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nikhilbarhate99/min-decision-transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/2024-MindSpore-1/Code2/tree/main/model-1/decision_transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zzmtsvv/rl_task","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/LAS1520/Gato-A-Generalist-Agent","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Delavari-Alireza/Decision_Transformer_Sequence-Modeling_Deep_Reinforcement_Learning","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/RamiSketcher/decision-transformer-ammi","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/opendilab/DI-engine","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/HzcIrving/DecisionTransformer_StepbyStep","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cannylab/casual_overhypotheses","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yun-kwak/decision-transformer-jax","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ml-jku/l2m","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/typoverflow/OfflineRL-Lib","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/facebookresearch/salina","reach":null}],"summary":{"ran_fixture":1,"ran":13,"ran_draft_wrong":3,"unverified":9},"by_repo_kind":{"listed":{"samples":26,"ran":17,"repositories":11}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"0161b27cbe3cc58d","entry":"discount_cumsum","repo":"HzcIrving/DecisionTransformer_StepbyStep","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/HzcIrving/DecisionTransformer_StepbyStep/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":2,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0161b27cbe3cc58d"}},{"code_sha256_prefix":"89113bc52fb73297","entry":"Agent","repo":"facebookresearch/salina","repo_kind":"listed","path":"salina_examples/offline_rl/decision_transformer/agents.py","file_url":"https://github.com/facebookresearch/salina/blob/HEAD/salina_examples/offline_rl/decision_transformer/agents.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"89113bc52fb73297"}},{"code_sha256_prefix":"e3c3fcca273a8e47","entry":"Block","repo":"LAS1520/Gato-A-Generalist-Agent","repo_kind":"listed","path":"Gato_models/model.py","file_url":"https://github.com/LAS1520/Gato-A-Generalist-Agent/blob/HEAD/Gato_models/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e3c3fcca273a8e47"}},{"code_sha256_prefix":"25243005f892c666","entry":"Block","repo":"opendilab/DI-engine","repo_kind":"listed","path":"ding/model/template/decision_transformer.py","file_url":"https://github.com/opendilab/DI-engine/blob/HEAD/ding/model/template/decision_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"25243005f892c666"}},{"code_sha256_prefix":"6daf6f8401bed739","entry":"DecisionTransformer","repo":"LAS1520/Gato-A-Generalist-Agent","repo_kind":"listed","path":"Gato_models/model.py","file_url":"https://github.com/LAS1520/Gato-A-Generalist-Agent/blob/HEAD/Gato_models/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6daf6f8401bed739"}},{"code_sha256_prefix":"a437b4b107300a41","entry":"DecisionTransformer","repo":"corl-team/CORL","repo_kind":"listed","path":"algorithms/offline/dt.py","file_url":"https://github.com/corl-team/CORL/blob/HEAD/algorithms/offline/dt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a437b4b107300a41"}},{"code_sha256_prefix":"dfabbac8bf8010df","entry":"DecisionTransformer","repo":"zzmtsvv/rl_task","repo_kind":"listed","path":"decision_transformer/model.py","file_url":"https://github.com/zzmtsvv/rl_task/blob/HEAD/decision_transformer/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dfabbac8bf8010df"}},{"code_sha256_prefix":"815b0c86f32c99cc","entry":"DecisionTransformer","repo":"nikhilbarhate99/min-decision-transformer","repo_kind":"listed","path":"decision_transformer/model.py","file_url":"https://github.com/nikhilbarhate99/min-decision-transformer/blob/HEAD/decision_transformer/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"815b0c86f32c99cc"}},{"code_sha256_prefix":"621a87d0ebc957c4","entry":"MaskedCausalAttention","repo":"LAS1520/Gato-A-Generalist-Agent","repo_kind":"listed","path":"Gato_models/model.py","file_url":"https://github.com/LAS1520/Gato-A-Generalist-Agent/blob/HEAD/Gato_models/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"621a87d0ebc957c4"}},{"code_sha256_prefix":"23842a66d5113ef0","entry":"MaskedCausalAttention","repo":"opendilab/DI-engine","repo_kind":"listed","path":"ding/model/template/decision_transformer.py","file_url":"https://github.com/opendilab/DI-engine/blob/HEAD/ding/model/template/decision_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"23842a66d5113ef0"}},{"code_sha256_prefix":"d879368facd3289e","entry":"TransformerBlock","repo":"corl-team/CORL","repo_kind":"listed","path":"algorithms/offline/dt.py","file_url":"https://github.com/corl-team/CORL/blob/HEAD/algorithms/offline/dt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d879368facd3289e"}},{"code_sha256_prefix":"12cc4b7038955563","entry":"TransformerBlock","repo":"zzmtsvv/rl_task","repo_kind":"listed","path":"decision_transformer/model.py","file_url":"https://github.com/zzmtsvv/rl_task/blob/HEAD/decision_transformer/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"12cc4b7038955563"}},{"code_sha256_prefix":"30bf51af033aeb98","entry":"dt_config","repo":"zzmtsvv/rl_task","repo_kind":"listed","path":"decision_transformer/model.py","file_url":"https://github.com/zzmtsvv/rl_task/blob/HEAD/decision_transformer/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"30bf51af033aeb98"}},{"code_sha256_prefix":"1ed718456cb9f7a0","entry":"evaluate_episode","repo":"Amadeus979/decision-transformer","repo_kind":"listed","path":"gym/decision_transformer/evaluation/evaluate_episodes.py","file_url":"https://github.com/Amadeus979/decision-transformer/blob/HEAD/gym/decision_transformer/evaluation/evaluate_episodes.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ed718456cb9f7a0"}},{"code_sha256_prefix":"9c904f0602da78d7","entry":"evaluate_episode_rtg","repo":"Amadeus979/decision-transformer","repo_kind":"listed","path":"gym/decision_transformer/evaluation/evaluate_episodes.py","file_url":"https://github.com/Amadeus979/decision-transformer/blob/HEAD/gym/decision_transformer/evaluation/evaluate_episodes.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9c904f0602da78d7"}},{"code_sha256_prefix":"77a7fd5bc546c3a1","entry":"instantiate_class","repo":"facebookresearch/salina","repo_kind":"listed","path":"salina_examples/offline_rl/decision_transformer/agents.py","file_url":"https://github.com/facebookresearch/salina/blob/HEAD/salina_examples/offline_rl/decision_transformer/agents.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"77a7fd5bc546c3a1"}},{"code_sha256_prefix":"4e4aebc21d42fb20","entry":"mlp","repo":"facebookresearch/salina","repo_kind":"listed","path":"salina_examples/offline_rl/decision_transformer/agents.py","file_url":"https://github.com/facebookresearch/salina/blob/HEAD/salina_examples/offline_rl/decision_transformer/agents.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e4aebc21d42fb20"}},{"code_sha256_prefix":"81de786f2fb6de0b","entry":"ActionMLPAgentFromTransformer","repo":"facebookresearch/salina","repo_kind":"listed","path":"salina_examples/offline_rl/decision_transformer/agents.py","file_url":"https://github.com/facebookresearch/salina/blob/HEAD/salina_examples/offline_rl/decision_transformer/agents.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"81de786f2fb6de0b"}},{"code_sha256_prefix":"143914639aea2cb9","entry":"CausalSelfAttention","repo":"yun-kwak/decision-transformer-jax","repo_kind":"listed","path":"dt_jax/gpt.py","file_url":"https://github.com/yun-kwak/decision-transformer-jax/blob/HEAD/dt_jax/gpt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"143914639aea2cb9"}},{"code_sha256_prefix":"e8829585a4a05826","entry":"DecisionTransformer","repo":"Delavari-Alireza/Decision_Transformer_Sequence-Modeling_Deep_Reinforcement_Learning","repo_kind":"listed","path":"HalfCheetah/model.py","file_url":"https://github.com/Delavari-Alireza/Decision_Transformer_Sequence-Modeling_Deep_Reinforcement_Learning/blob/HEAD/HalfCheetah/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e8829585a4a05826"}},{"code_sha256_prefix":"5cbb6e8c7b3ba6c7","entry":"DecisionTransformer","repo":"pytorch/rl","repo_kind":"listed","path":"torchrl/modules/models/decision_transformer.py","file_url":"https://github.com/pytorch/rl/blob/HEAD/torchrl/modules/models/decision_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5cbb6e8c7b3ba6c7"}},{"code_sha256_prefix":"d6dc19545c453079","entry":"DecisionTransformer","repo":"opendilab/DI-engine","repo_kind":"listed","path":"ding/model/template/decision_transformer.py","file_url":"https://github.com/opendilab/DI-engine/blob/HEAD/ding/model/template/decision_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d6dc19545c453079"}},{"code_sha256_prefix":"2a9e66156b160093","entry":"Dropout","repo":"yun-kwak/decision-transformer-jax","repo_kind":"listed","path":"dt_jax/gpt.py","file_url":"https://github.com/yun-kwak/decision-transformer-jax/blob/HEAD/dt_jax/gpt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a9e66156b160093"}},{"code_sha256_prefix":"b1501ba16b463b22","entry":"GPT","repo":"yun-kwak/decision-transformer-jax","repo_kind":"listed","path":"dt_jax/gpt.py","file_url":"https://github.com/yun-kwak/decision-transformer-jax/blob/HEAD/dt_jax/gpt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b1501ba16b463b22"}},{"code_sha256_prefix":"9b48d1222dabdd2c","entry":"TransformerBlock","repo":"yun-kwak/decision-transformer-jax","repo_kind":"listed","path":"dt_jax/gpt.py","file_url":"https://github.com/yun-kwak/decision-transformer-jax/blob/HEAD/dt_jax/gpt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b48d1222dabdd2c"}},{"code_sha256_prefix":"00a33466c69c5705","entry":"load_tf_weights_in_gpt2","repo":"Amadeus979/decision-transformer","repo_kind":"listed","path":"gym/decision_transformer/models/trajectory_gpt2.py","file_url":"https://github.com/Amadeus979/decision-transformer/blob/HEAD/gym/decision_transformer/models/trajectory_gpt2.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"00a33466c69c5705"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}