Papers › Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a...

Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor

4 Jan 2018ICML 2018 7arXiv:1801.01290archive 2025-07-28

Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, Sergey Levine

A platform for Applied Reinforcement Learning (Applied RL)

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1801.01290")

Code

Syntology Ran 91 of 148 code samples harvested from 27 repositories linked to this paper; 57 have no recorded run. Of those that ran: 3 ran · honoured contract; 1 ran · violated contract; 17 ran · our draft was wrong; 1 ran · fixture could not drive it; 69 ran with no contract checked.

By repository: community (archive-listed): 148 samples from 27 repositories, 91 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

86 repositories listed; official and paper-mentioned ones first.

haarnoja/sac officialmentioned in papermentioned on GitHubtfNOASSERTION report
AmmarFayad/Behavioral-Actor-Critic mentioned on GitHubpytorch report
FOCAL-ICLR/FOCAL-ICLR mentioned on GitHubpytorchMIT report
Kaixhin/imitation-learning mentioned on GitHubpytorch report
MarsEleven/car_racer_RL mentioned on GitHubpytorch report
MrSyee/pg-is-all-you-need mentioned on GitHubMIT report
RLAgent/state-marginal-matching mentioned on GitHubpytorch report
SaminYeasar/off_policy_ac mentioned on GitHubpytorch report
ShawK91/erl_paper_nips18 mentioned on GitHubpytorch report
Steinheilig/Imbiss mentioned on GitHub report
X3N4/car_racer mentioned on GitHubpytorch report
ac-93/soft-actor-critic mentioned on GitHubtf report
ajaysub110/rl-pytorch mentioned on GitHubpytorch report
andrejorsula/drl_grasping mentioned on GitHubpytorchBSD-3-Clause report
araffin/sbx mentioned on GitHubjax report
baturaysaglam/la3p mentioned on GitHubpytorch report
ccolas/rl_stats mentioned on GitHub report
cindycia/Atari-SAC-Discrete mentioned on GitHubpytorchMIT report
core-robotics-lab/icct mentioned on GitHubpytorchMIT report
dasgringuen/assetto_corsa_gym mentioned on GitHubpytorchMIT report
donamin/llc mentioned on GitHubtf report
facebookresearch/ReAgent mentioned on GitHubpytorch report
fdcl-gwu/gym-rotor mentioned on GitHubpytorchMIT report
flowersteam/rl_stats mentioned on GitHub report
garyzyr001/rethinking-airl mentioned on GitHubpytorch report
gijskoning/ReproducingCURL mentioned on GitHubpytorch report
h-aboutalebi/SparceReward mentioned on GitHubpytorch report
hyunin-lee/ForecasterSAC mentioned on GitHubpytorch report
ikostrikov/jax-rl mentioned on GitHubjax report
kairproject/kair_algorithms_draft mentioned on GitHubpytorch report
ku2482/discor.pytorch mentioned on GitHubpytorch report
ku2482/gail-airl-ppo.pytorch mentioned on GitHubpytorch report
ku2482/rljax mentioned on GitHubjaxMIT report
ku2482/rltorch mentioned on GitHubpytorchMIT report
ku2482/soft-actor-critic.pytorch mentioned on GitHubpytorchMIT report
kushagra06/SAC mentioned on GitHubpytorch report
lanqingli1993/focal-iclr mentioned on GitHubpytorch report
learn-to-race/l2r mentioned on GitHubGPL-2.0 report
lollcat/Soft-Actor-Critic mentioned on GitHubtf report
lucadellalib/sac-beta mentioned on GitHubpytorchApache-2.0 report
marload/DeepRL-TensorFlow2 mentioned on GitHubtf report
moreanp/csro mentioned on GitHubpytorch report
mxblr/DeepRLHockey mentioned on GitHubtf report
nagisazj/idaq_public mentioned on GitHubMIT report
polixir/NeoRL mentioned on GitHub report
pranz24/pytorch-soft-actor-critic mentioned on GitHubpytorch report
quantumiracle/Popular-RL-Algorithms mentioned on GitHubpytorch report
rk1998/robot-sac mentioned on GitHubtf report
roythuly/obac mentioned on GitHubpytorch report
sunfex/weighted-sac mentioned on GitHubpytorch report
susan-amin/SparseBaseline1 mentioned on GitHubpytorch report
tarod13/SAC mentioned on GitHubpytorch report
thomashirtz/pytorch-soft-actor-critic mentioned on GitHubpytorchMIT report
thomashirtz/soft-actor-critic mentioned on GitHubpytorch report
tilkb/thermoai mentioned on GitHubtf report
timoklein/car_racer mentioned on GitHubpytorch report
tliu1997/rnac mentioned on GitHubpytorch report
tmjeong1103/RL_with_RAY mentioned on GitHubpytorch report
toshikwa/discor.pytorch mentioned on GitHubpytorchMIT report
toshikwa/soft-actor-critic.pytorch mentioned on GitHubpytorch report
trackmania-rl/tmrl mentioned on GitHubpytorch report
yhisaki/average-reward-drl mentioned on GitHubpytorch report
yimingpeng/sac-master mentioned on GitHubtf report
yining043/SAC-discrete mentioned on GitHubtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

148 samples harvested; 91 ran; 3 honoured the contract we drafted; 57 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

3ran · honoured contract
1ran · violated contract
17ran · our draft was wrong
1ran · fixture could not drive it
69ran
57unverified

Licence: 66 of the 148 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 27 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

AbstractAgent h-aboutalebi/SparceReward/engine/algorithms/SAC/sac.py community (archive-listed) ran no licence file found · pointer only · 424bf06f8d8eb998 · report
Actor MatthieuSarkis/Portfolio-Optimization-and-Goal-Based-Investment-with-Reinforcement-Learning/src/agents.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive) · de5e64dc2bfc6a33 · report
Actor BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · 5d8f81c210a0aacb · report
Actor SaminYeasar/off_policy_ac/SAC/SAC.py community (archive-listed) ran fingerprinted no licence file found · pointer only · dc01224a73ea8148 · report
Agent_ManualTemperature MatthieuSarkis/Portfolio-Optimization-and-Goal-Based-Investment-with-Reinforcement-Learning/src/agents.py community (archive-listed) ran Apache-2.0 (permissive) · 0918147b61a18074 · report
BaseQNet sunfex/weighted-sac/sac.py community (archive-listed) ran MIT (permissive) · d6b54769dcaa3ec5 · report
Batch yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran no licence file found · pointer only · 6bb425a4771dc88f · report
BatchQNet sunfex/weighted-sac/sac.py community (archive-listed) ran MIT (permissive) · e6f3bef6186ec524 · report
Buffer garyzyr001/rethinking-airl/airl/algo/sac.py community (archive-listed) ran no licence file found · pointer only · 94573a894a42ebff · report
ConcatStateAction yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran no licence file found · pointer only · c10734f04f231cb4 · report
Critic MatthieuSarkis/Portfolio-Optimization-and-Goal-Based-Investment-with-Reinforcement-Learning/src/agents.py community (archive-listed) ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 7c4433b21cf61a2c · report
Critic baturaysaglam/la3p/Code/SAC/SAC.py community (archive-listed) ran · metamorphic tier: deterministic MIT (permissive) · f8ead4c2c205ecd8 · report
Critic BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) ran · metamorphic tier: deterministic MIT (permissive) · 8f0377d2cad944f3 · report
Critic SaminYeasar/off_policy_ac/SAC/SAC.py community (archive-listed) ran no licence file found · pointer only · a0a4c6c892e497cd · report
DeepActor BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · 9ee95d5b4fc2dd44 · report
DeepCritic BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) ran · metamorphic tier: deterministic MIT (permissive) · a57bb45ab6a0bc51 · report
DeepIQN BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) ran · metamorphic tier: deterministic MIT (permissive) · 693c33a1aa6474c6 · report
DeterministicPolicy baturaysaglam/la3p/Code/SAC/SAC.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · 7553f61c31debefb · report
DeterministicPolicy h-aboutalebi/SparceReward/engine/algorithms/SAC/sac.py community (archive-listed) ran fingerprinted no licence file found · pointer only · 3faeea6e22edd34d · report
DeterministicPolicy MarsEleven/car_racer_RL/sac/sac.py community (archive-listed) ran fingerprinted no licence file found · pointer only · d4dfbbf39952f704 · report
GaussianPolicy Rafael1s/Deep-Reinforcement-Learning-Udacity/Ant-PyBulletEnv-Soft-Actor-Critic/sac_agent.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · bf0d89394b22e1b6 · report
GaussianPolicy baturaysaglam/la3p/Code/SAC/SAC.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · 152bc1e449547d23 · report
GaussianPolicy ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · 8761dc745b44dc04 · report
GaussianPolicy h-aboutalebi/SparceReward/engine/algorithms/SAC/sac.py community (archive-listed) ran fingerprinted no licence file found · pointer only · 8ee15fddb3528e86 · report
GaussianPolicy roythuly/obac/model/algo.py community (archive-listed) ran fingerprinted no licence file found · pointer only · da8ebd6e9ea11fca · report
GaussianPolicy sunfex/weighted-sac/sac.py community (archive-listed) ran fingerprinted MIT (permissive) · 5722a85a4a153169 · report
GaussianPolicy MarsEleven/car_racer_RL/sac/sac.py community (archive-listed) ran fingerprinted no licence file found · pointer only · 57c7562fda9bbab3 · report
IQN BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) ran · metamorphic tier: deterministic MIT (permissive) · 94a135edcb95baf2 · report
Logger yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran no licence file found · pointer only · 4aec8353051fa16d · report
MLPActorCritic tmjeong1103/RL_with_RAY/SAC_RAY/model.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · a830c8ece63f9c57 · report
MLPGaussianPolicy tmjeong1103/RL_with_RAY/SAC_RAY/model.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · c02fc6e11c3ba5cf · report
MLPQFunction tmjeong1103/RL_with_RAY/SAC_RAY/model.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · 14211bf5685457cf · report
MultiLinear yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · 5d3a98fbf8446e0c · report
Network MatthieuSarkis/Portfolio-Optimization-and-Goal-Based-Investment-with-Reinforcement-Learning/src/agents.py community (archive-listed) ran · metamorphic tier: deterministic Apache-2.0 (permissive) · de764e9177884a12 · report
PolicyNetwork quantumiracle/Popular-RL-Algorithms/sac_v2.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive) · 540316788d2c30c7 · report
PolicyNetwork ajaysub110/rl-pytorch/sac/models/soft_actor_critic.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · ec7050db6c32a43a · report
PrioritizedReplay BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) ran MIT (permissive) · 91bcdaabd64f8eee · report
QNetwork Rafael1s/Deep-Reinforcement-Learning-Udacity/Ant-PyBulletEnv-Soft-Actor-Critic/sac_agent.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · f37748964b0cd7da · report
QNetwork thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) ran MIT (permissive) · b7030d8d56cd639a · report
QNetwork roythuly/obac/model/algo.py community (archive-listed) ran no licence file found · pointer only · 0d80189fd77d3aa6 · report
QNetwork MarsEleven/car_racer_RL/sac/sac.py community (archive-listed) ran no licence file found · pointer only · e3aca820c0049604 · report
QNetwork ajaysub110/rl-pytorch/sac/models/soft_actor_critic.py community (archive-listed) ran · metamorphic tier: invariant no licence file found · pointer only · e182a5c8f1d1e16f · report
ReplayBuffer MatthieuSarkis/Portfolio-Optimization-and-Goal-Based-Investment-with-Reinforcement-Learning/src/agents.py community (archive-listed) ran Apache-2.0 (permissive) · ac5ecca5b7705f8a · report
ReplayBuffer kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) ran MIT (permissive) · 8119b0afbe2d940e · report
ReplayBuffer BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) ran MIT (permissive) · a6c39d1200737d3f · report
ReplayBuffer yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran no licence file found · pointer only · e9664791458e5ade · report
ReplayBuffer quantumiracle/Popular-RL-Algorithms/sac_v2.py community (archive-listed) ran Apache-2.0 (permissive) · 70249df825c62d7e · report
ReplayBuffer thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) ran MIT (permissive) · 0020d85f4dbfb10b · report
SAC ShawK91/Evolutionary-Reinforcement-Learning/algos/sac.py community (archive-listed) ran no licence file found · pointer only · 217cd7f6f86864da · report
SAC SaminYeasar/off_policy_ac/SAC/SAC.py community (archive-listed) ran no licence file found · pointer only · 43d63d9b3b6240a1 · report
SACActor kushagra06/SAC/model.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · e5d43066162708ff · report
ScalarHolder yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · 33ec92b652664841 · report
SerializedBuffer garyzyr001/rethinking-airl/airl/algo/sac.py community (archive-listed) ran no licence file found · pointer only · c74fba5d30037b69 · report
SerializedBuffer ku2482/gail-airl-ppo.pytorch/gail_airl_ppo/algo/sac.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · eb9bc09b3ca641cb · report
SoftActor Kaixhin/imitation-learning/models.py community (archive-listed) ran · metamorphic tier: deterministic MIT (permissive) · b473c449b3da39cc · report
SoftQNetwork quantumiracle/Popular-RL-Algorithms/sac_v2.py community (archive-listed) ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 0688d4da92feee38 · report
SquashedDiagonalGaussianHead yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · 02a45597a277afab · report
StateActionFunction ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) ran · metamorphic tier: deterministic MIT (permissive) · b1e066bc1ff4b61b · report
StateDependentPolicy garyzyr001/rethinking-airl/airl/algo/sac.py community (archive-listed) ran fingerprinted no licence file found · pointer only · f0f9d0b00b3e9632 · report
StateDependentPolicy ku2482/gail-airl-ppo.pytorch/gail_airl_ppo/algo/sac.py community (archive-listed) ran fingerprinted MIT (permissive) · 77baa7a1a168fc24 · report
StochasticPolicy thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) ran fingerprinted MIT (permissive) · 7e61ac4f70c90628 · report
TanhGaussianPolicySACAdapt autumnwu/aggressive-q-learning-with-ensembles/spinup/algos/aqe/core_aqe.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · f552f5cc13186908 · report
TwinnedQNetworks thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) ran MIT (permissive) · 5b2e9a4c85bbab7d · report
TwinnedStateActionFunction ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) ran · metamorphic tier: deterministic MIT (permissive) · 5d13132d2e3c5ef0 · report
TwinnedStateActionFunction garyzyr001/rethinking-airl/airl/algo/sac.py community (archive-listed) ran no licence file found · pointer only · e42d91ba746c3a14 · report
Value MatthieuSarkis/Portfolio-Optimization-and-Goal-Based-Investment-with-Reinforcement-Learning/src/agents.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive) · f8845c35735f20bc · report
ValueNetwork roythuly/obac/model/algo.py community (archive-listed) ran fingerprinted no licence file found · pointer only · 18ecb1311366b8cb · report
_create_fcnn Kaixhin/imitation-learning/models.py community (archive-listed) ran · our draft was wrong MIT (permissive) · b7fc01f37cbb0eb1 · report
apply_squashing_func SaminYeasar/off_policy_ac/SAC/SAC.py community (archive-listed) ran · our draft was wrong fingerprinted no licence file found · pointer only · 52028903a218ba91 · report
bytes_to_params kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) ran · our draft was wrong MIT (permissive) · fa8517ef05057c7f · report
calculate_huber_loss BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) ran · our draft was wrong MIT (permissive) · d9d455622c2dcd61 · report
clip_but_pass_gradient watchernyu/spinningup-drl-prototyping/spinup/algos/sac/core.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · 4731ca1d377b8284 · report
compute_weight_X hyunin-lee/ForecasterSAC/sac.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · a2697a9ea209c680 · report
convert_to_tensor yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · cdf94e91c8746537 · report
create_linear_network ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) ran · fixture could not drive it MIT (permissive) · 248f63c9cf4d972e · report
data_to_json kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 36b66092679a3132 · report
eval_mode thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 298e84cf1d9ed36c · report
gaussian_likelihood watchernyu/spinningup-drl-prototyping/spinup/algos/sac/core.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · 5c26c93931dce503 · report
gaussian_likelihood SaminYeasar/off_policy_ac/SAC/SAC.py community (archive-listed) ran · our draft was wrong fingerprinted no licence file found · pointer only · 958cab9f3ba6af81 · report
get_device thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) ran · our draft was wrong MIT (permissive) · d4978950888874f4 · report
get_multilayer_perceptron thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 1afbe631504fbaf7 · report
group_by_keys yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 1dd9b9ae9fa9426f · report
is_json_serializable kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) ran · violated contract MIT (permissive) · c70b5621a0ca8047 · report
json_to_data kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) ran · our draft was wrong MIT (permissive) · ad86f46cc9af956b · report
mlp tmjeong1103/RL_with_RAY/SAC_RAY/model.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · a1e9dc4773ffeba5 · report
ortho_init yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 5c5bce3523ed4d69 · report
params_to_bytes kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 1d75daad61f15424 · report
policyNet tarod13/SAC/nets.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · 642892e9419a125d · report
scale_action kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 4a486e5048778576 · report
soft_actor_critic_agent Rafael1s/Deep-Reinforcement-Learning-Udacity/Ant-PyBulletEnv-Soft-Actor-Critic/sac_agent.py community (archive-listed) ran no licence file found · pointer only · 3a0835e6ce008741 · report
unscale_action kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 5a4d3fd6b28ecaf4 · report
Agent MatthieuSarkis/Portfolio-Optimization-and-Goal-Based-Investment-with-Reinforcement-Learning/src/agents.py community (archive-listed) unverified Apache-2.0 (permissive) · b0e759b2d521e146 · report
Agent BY571/Soft-Actor-Critic-and-Extensions/files/Agent.py community (archive-listed) unverified MIT (permissive) · 2ae117303c9ac594 · report
Agent thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) unverified MIT (permissive) · 05437b66f08eb4d6 · report
Algorithm ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) unverified MIT (permissive) · eaf547baf5f33e43 · report
Algorithm garyzyr001/rethinking-airl/airl/algo/sac.py community (archive-listed) unverified no licence file found · pointer only · 803d90cd603ff8c0 · report
Algorithm ku2482/gail-airl-ppo.pytorch/gail_airl_ppo/algo/sac.py community (archive-listed) unverified MIT (permissive) · ff7a80131e64a08d · report
AlgorithmBase yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) unverified no licence file found · pointer only · 110041979f3c0cb8 · report
BaseNetwork ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) unverified MIT (permissive) · d6d4b5a5d84ba8ad · report
Buffer ku2482/gail-airl-ppo.pytorch/gail_airl_ppo/algo/sac.py community (archive-listed) unverified MIT (permissive) · b6b1a23b07a627dd · report
Model ikostrikov/jax-rl/jaxrl/agents/sac/sac_learner.py community (archive-listed) unverified MIT (permissive) · 3ef56075bad93ec9 · report
OBAC roythuly/obac/model/algo.py community (archive-listed) unverified no licence file found · pointer only · 7524ef9f7598dd6f · report
RLNetwork kushagra06/SAC/model.py community (archive-listed) unverified no licence file found · pointer only · b36d35fd411b0150 · report
ReplayMemory ajaysub110/rl-pytorch/sac/models/soft_actor_critic.py community (archive-listed) unverified no licence file found · pointer only · 995a5d6382ee476d · report
SAC kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) unverified MIT (permissive) · 569d921eb9b51536 · report
SAC baturaysaglam/la3p/Code/SAC/SAC.py community (archive-listed) unverified MIT (permissive) · 0edd4b0f90be8f84 · report
SAC yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) unverified no licence file found · pointer only · 4849ba61ae47dd70 · report
SAC ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) unverified MIT (permissive) · 348b1924f106de50 · report
SAC h-aboutalebi/SparceReward/engine/algorithms/SAC/sac.py community (archive-listed) unverified no licence file found · pointer only · 9e2e2c85eabbd88f · report
SAC sunfex/weighted-sac/sac.py community (archive-listed) unverified MIT (permissive) · 1cb5a8aa4ee6cb43 · report
SAC hyunin-lee/ForecasterSAC/sac.py community (archive-listed) unverified MIT (permissive) · 9efbd1e63c6644e5 · report
SAC garyzyr001/rethinking-airl/airl/algo/sac.py community (archive-listed) unverified no licence file found · pointer only · 6af70c8a2239d7c5 · report
SAC MarsEleven/car_racer_RL/sac/sac.py community (archive-listed) unverified no licence file found · pointer only · fa07dbb92f6c222b · report
SAC ku2482/gail-airl-ppo.pytorch/gail_airl_ppo/algo/sac.py community (archive-listed) unverified MIT (permissive) · 104ef2d3e37baa21 · report
SAC pranz24/pytorch-soft-actor-critic/sac.py community (archive-listed) unverified MIT (permissive) · d77f61cb28da8383 · report
SACLearner ikostrikov/jax-rl/jaxrl/agents/sac/sac_learner.py community (archive-listed) unverified MIT (permissive) · 6bc96035de025e83 · report
SAC_Trainer quantumiracle/Popular-RL-Algorithms/sac_v2.py community (archive-listed) unverified Apache-2.0 (permissive) · 3e1e70dd1d5f3958 · report
SoftActorCritic ajaysub110/rl-pytorch/sac/models/soft_actor_critic.py community (archive-listed) unverified no licence file found · pointer only · ecf34b65e8d9d3bb · report
_soft_update ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) unverified MIT (permissive) · 231f633be51bd617 · report
_update_jit ikostrikov/jax-rl/jaxrl/agents/sac/sac_learner.py community (archive-listed) unverified MIT (permissive) · f07528bc5e071757 · report
apply_squashing_func watchernyu/spinningup-drl-prototyping/spinup/algos/sac/core.py community (archive-listed) unverified MIT (permissive) · 198be549ce9696ef · report
assert_action ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) unverified MIT (permissive) · ded76544fe9d6607 · report
copy_params ajaysub110/rl-pytorch/sac/models/soft_actor_critic.py community (archive-listed) unverified no licence file found · pointer only · d1076220e33b55ba · report
disable_gradient garyzyr001/rethinking-airl/airl/algo/sac.py community (archive-listed) unverified no licence file found · pointer only · ed542fae5c7f2c04 · report
hard_update Rafael1s/Deep-Reinforcement-Learning-Udacity/Ant-PyBulletEnv-Soft-Actor-Critic/sac_agent.py community (archive-listed) unverified no licence file found · pointer only · 799c08d64f58d9ef · report
hard_update ShawK91/Evolutionary-Reinforcement-Learning/algos/sac.py community (archive-listed) unverified no licence file found · pointer only · 7abe222eb3afeb6f · report
hard_update MarsEleven/car_racer_RL/sac/sac.py community (archive-listed) unverified no licence file found · pointer only · 1adf91cc413cf6c2 · report
init_weights ajaysub110/rl-pytorch/sac/models/soft_actor_critic.py community (archive-listed) unverified no licence file found · pointer only · 8576d4b41e6ed12f · report
initialize_weights_xavier ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) unverified MIT (permissive) · 544fe1f08a36cc62 · report
load_model thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) unverified MIT (permissive) · 706459e26fbb0b4c · report
mlp watchernyu/spinningup-drl-prototyping/spinup/algos/sac/core.py community (archive-listed) unverified MIT (permissive) · e68b07bcdded00fa · report
mlp_actor_critic watchernyu/spinningup-drl-prototyping/spinup/algos/sac/core.py community (archive-listed) unverified MIT (permissive) · 8498689f07030ac8 · report
mlp_gaussian_policy watchernyu/spinningup-drl-prototyping/spinup/algos/sac/core.py community (archive-listed) unverified MIT (permissive) · a860fee8188a0218 · report
polyak_update yhisaki/average-reward-drl/average_reward_drl/algorithms/sac.py community (archive-listed) unverified no licence file found · pointer only · f299a2900b4034fa · report
save_model thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) unverified MIT (permissive) · 7d297778525c40d1 · report
set_global_seeds kdally/fault-tolerant-flight-control-drl/fault_tolerant_flight_control_drl/agent/sac.py community (archive-listed) unverified MIT (permissive) · 0dfad75cd2d202d6 · report
soft_update Rafael1s/Deep-Reinforcement-Learning-Udacity/Ant-PyBulletEnv-Soft-Actor-Critic/sac_agent.py community (archive-listed) unverified no licence file found · pointer only · f735812881238a1f · report
soft_update ku2482/discor.pytorch/discor/algorithm/sac.py community (archive-listed) unverified MIT (permissive) · e8abbe917721f0c8 · report
soft_update ShawK91/Evolutionary-Reinforcement-Learning/algos/sac.py community (archive-listed) unverified no licence file found · pointer only · fcdeb82694a504e1 · report
soft_update garyzyr001/rethinking-airl/airl/algo/sac.py community (archive-listed) unverified no licence file found · pointer only · 8dc0540b8dfe9b97 · report
soft_update MarsEleven/car_racer_RL/sac/sac.py community (archive-listed) unverified no licence file found · pointer only · ace24484ab1d6b7f · report
soft_update ajaysub110/rl-pytorch/sac/models/soft_actor_critic.py community (archive-listed) unverified no licence file found · pointer only · 54ab8d446018b958 · report
target_update ikostrikov/jax-rl/jaxrl/agents/sac/sac_learner.py community (archive-listed) unverified MIT (permissive) · f62b5d3c6983e5aa · report
update_network_parameters thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) unverified MIT (permissive) · 85fff8ae028fc1dd · report
weight_init SaminYeasar/off_policy_ac/SAC/SAC.py community (archive-listed) unverified no licence file found · pointer only · 68c08ef9d5d473a7 · report
weight_initialization thomashirtz/soft-actor-critic/soft_actor_critic/agent.py community (archive-listed) unverified MIT (permissive) · 6ae1b395aeb4e7d3 · report
weights_init_ Rafael1s/Deep-Reinforcement-Learning-Udacity/Ant-PyBulletEnv-Soft-Actor-Critic/sac_agent.py community (archive-listed) unverified no licence file found · pointer only · 0537c4bc8300d410 · report
weights_init_ MarsEleven/car_racer_RL/sac/sac.py community (archive-listed) unverified no licence file found · pointer only · abe2b5a0b5e817fd · report

Tasks

Continuous ControlDecision MakingDeep Reinforcement LearningOmniverse Isaac GymOpenAI GymQ-LearningReinforcement LearningReinforcement Learning (RL)reinforcement-learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Continuous Control Lunar Lander (OpenAI Gym) SAC Score 284.59±0.97 #1 of 5 Archive leaderboard report
OpenAI Gym Ant-v4 SAC Average Return 5208.09 #3 of 5 Archive leaderboard report
OpenAI Gym HalfCheetah-v4 SAC Average Return 15836.04 #1 of 5 Archive leaderboard report
OpenAI Gym Hopper-v4 SAC Average Return 2882.56 #3 of 5 Archive leaderboard report
OpenAI Gym Humanoid-v4 SAC Average Return 6211.50 #2 of 5 Archive leaderboard report
OpenAI Gym Walker2d-v4 SAC Average Return 5745.27 #1 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: Soft Actor Critic

AdamDense ConnectionsExperience ReplayReLUSoft Actor Critic

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections