Papers › Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a...
Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, Sergey Levine
A platform for Applied Reinforcement Learning (Applied RL)
In Syntology View this paper on Syntology, its page in Syntology's graph. That page adds which of its functions are also present in other papers' code Syntology holds, with dates, and its dated run record as JSON and a README badge. It also lists the repositories linked to the paper, the abstract and the calls for agents.
Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
For agents, on Syntology's MCP service (how to connect):
get_harvested_code_for_paper(arxiv_id="1801.01290")get_code(code_sha256="…")with a sample'scode_sha256from the list belowget_citation_path(paper_1="1801.01290", paper_2="…")with another paper's arXiv id or titleget_concepts_for_paper(arxiv_id="1801.01290")
Code
The archive's official repository (haarnoja/sac) was not harvested; the 148 samples below come from 27 community repositories.
Syntology 148 code samples harvested from 27 repositories linked to this paper: 91 ran (of which 61 constructed an object rather than computing a result; 73 with no instrument failure: 3 honoured, 1 violated, 69 with no contract checked; 18 where Syntology's instrument failed) · 57 unverified. Where Syntology's instrument failed: 17 where our contract draft was wrong; 1 where the contract check could not run; failures of Syntology's instrument, not of the code.
By repository: community (archive-listed): 148 samples from 27 repositories, 91 ran (73 with no instrument failure; 18 where Syntology's instrument failed). The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.
No sample is linked to this paper from 28 of its repositories that Syntology harvested for other papers:
- FOCAL-ICLR/FOCAL-ICLR, community (archive-listed): harvested for another paper, listed under the repository
- RLAgent/state-marginal-matching, community (archive-listed): harvested for another paper, listed under the repository
- ac-93/soft-actor-critic, community (archive-listed): harvested for another paper, listed under the repository
- andrejorsula/drl_grasping, community (archive-listed): harvested for another paper, listed under the repository
- araffin/sbx, community (archive-listed): harvested for another paper, listed under the repository
- ccolas/rl_stats, community (archive-listed): harvested for another paper, listed under the repository
- cindycia/Atari-SAC-Discrete, community (archive-listed): harvested for another paper, listed under the repository
- dasgringuen/assetto_corsa_gym, community (archive-listed): harvested for another paper, listed under the repository
- dfki-ric-underactuated-lab/torque_limited_simple_pendulum, community (archive-listed): harvested for another paper, listed under the repository
- fdcl-gwu/gym-rotor, community (archive-listed): harvested for another paper, listed under the repository
- ku2482/rltorch, community (archive-listed): harvested for another paper, listed under the repository
- ku2482/soft-actor-critic.pytorch, community (archive-listed): harvested for another paper, listed under the repository
- marload/DeepRL-TensorFlow2, community (archive-listed): harvested for 5 other papers, listed under the repository
- moreanp/csro, community (archive-listed): harvested for another paper, listed under the repository
- nagisazj/idaq_public, community (archive-listed): harvested for another paper, listed under the repository
- susan-amin/SparseBaseline1, community (archive-listed): harvested for another paper, listed under the repository
- thomashirtz/pytorch-soft-actor-critic, community (archive-listed): harvested for another paper, listed under the repository
- tilkb/thermoai, community (archive-listed): harvested for 2 other papers, listed under the repository
- tliu1997/rnac, community (archive-listed): harvested for another paper, listed under the repository
- toshikwa/discor.pytorch, community (archive-listed): harvested for another paper, listed under the repository
- toshikwa/soft-actor-critic.pytorch, community (archive-listed): harvested for another paper, listed under the repository
- DLR-RM/stable-baselines3, community (archive-listed): harvested for another paper, listed under the repository
- facebookresearch/rl, community (archive-listed): harvested for another paper, listed under the repository
- hill-a/stable-baselines, community (archive-listed): harvested for 2 other papers, listed under the repository
- jakegrigsby/deep_control, community (archive-listed): harvested for another paper, listed under the repository
- opendilab/DI-engine, community (archive-listed): harvested for 4 other papers, listed under the repository
- pytorch/rl, community (archive-listed): harvested for another paper, listed under the repository
- tensorlayer/RLzoo, community (archive-listed): harvested for 6 other papers, listed under the repository
Levels written between 2026-09-22 and 2026-09-24 (UTC): the dates Syntology's graph wrote each sample's verification level, not when the code executed.
86 repositories listed; official and paper-mentioned ones first.
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.
Code Syntology ran Syntology
148 samples harvested: 91 ran (of which 61 constructed an object rather than computing a result; 73 with no instrument failure: 3 honoured, 1 violated, 69 with no contract checked; 18 where Syntology's instrument failed) · 57 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Syntology's record for this page has not changed since , the first build that kept a record date for it; when this build read Syntology's graph is in the build record. That date is not when the samples ran.
Licence: 66 of the 148 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.
Harvested from 27 repositories linked to this paper, official or community; the list below is grouped by repository, each group headed by its name and what it is to the paper. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. A line beginning “fixture:” under a sample that ran gives the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right. “Level recorded” gives the UTC date when Syntology's graph wrote the sample's verification level, not when the code executed; where the level was written before Syntology's graph kept that date, the row says “level recorded, date not recorded”. For 20 samples that ran, the graph records a signature this page does not show: for a class the fixture built without calling, the harness called the object with inputs it made up itself, so the recorded signature is the harness's probe, not the fixture's arguments. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself. “Our draft was wrong” and “the contract check could not run” are failures of Syntology's instrument, not of the code: the sample ran on Syntology's synthesized input, and then the drafted contract did not describe it, or the check itself raised an error (RAISES), lacked a dependency (DEP_MISSING) or ran out of time (TIMEOUT); hover the label for which. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.
Each sample ends with its code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.
Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples are grouped by repository: a repository marked official first, then by how directly the repository is tied to the paper, then in the archive's order; never by how many ran. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is cleared, but the stored copy of the same code that Syntology serves is not. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.
A function or class name links to its page when the name occurs in the harvested code of at least 5 papers; the name is a string, not an identity.
b473c449b3da39cc · report
fixture: returned SoftActor · level recorded 2026-09-22 b7fc01f37cbb0eb1 · report
fixture: signature input_size:int/0/int, hidden_size:int/0/int, depth:int/0/int, output_size:int/0/int, activation_function:str/0/str, input_dropout:float/0/float, dropout:float/0/float, final_gain:float/0/float, spectral_norm:bool/0/bool · returned Sequential · level recorded 2026-09-22 d4dfbbf39952f704 · report
fixture: returned DeterministicPolicy · level recorded 2026-09-22 57c7562fda9bbab3 · report
fixture: returned GaussianPolicy · level recorded 2026-09-22 e3aca820c0049604 · report
fixture: returned QNetwork · level recorded 2026-09-22 fa07dbb92f6c222b · report
ace24484ab1d6b7f · report
abe2b5a0b5e817fd · report
de5e64dc2bfc6a33 · report
fixture: returned Actor · level recorded 2026-09-22 0918147b61a18074 · report
fixture: returned Agent_ManualTemperature · level recorded 2026-09-22 7c4433b21cf61a2c · report
fixture: returned Critic · level recorded 2026-09-22 de764e9177884a12 · report
fixture: returned Network · level recorded 2026-09-22 ac5ecca5b7705f8a · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 f8845c35735f20bc · report
fixture: returned Value · level recorded 2026-09-22 bf0d89394b22e1b6 · report
fixture: returned GaussianPolicy · level recorded 2026-09-22 f37748964b0cd7da · report
fixture: returned QNetwork · level recorded 2026-09-22 3a0835e6ce008741 · report
fixture: returned soft_actor_critic_agent · level recorded 2026-09-22 799c08d64f58d9ef · report
f735812881238a1f · report
0537c4bc8300d410 · report
dc01224a73ea8148 · report
fixture: returned Actor · level recorded 2026-09-22 a0a4c6c892e497cd · report
fixture: returned Critic · level recorded 2026-09-22 43d63d9b3b6240a1 · report
fixture: returned SAC · level recorded 2026-09-22 52028903a218ba91 · report
fixture: signature mu:Tensor/2/float, pi:Tensor/2/float, log_pi:Tensor/2/float · returned tuple · level recorded 2026-09-22 958cab9f3ba6af81 · report
fixture: signature noise:Tensor/2/float, log_std:Tensor/2/float · returned Tensor · level recorded 2026-09-22 68c08ef9d5d473a7 · report
217cd7f6f86864da · report
fixture: returned SAC · level recorded 2026-09-22 7abe222eb3afeb6f · report
fcdeb82694a504e1 · report
ec7050db6c32a43a · report
fixture: signature s:Tensor/2/float · returned tuple · level recorded 2026-09-22 e182a5c8f1d1e16f · report
fixture: signature s:Tensor/2/float, a:Tensor/2/float · returned Tensor · level recorded 2026-09-22 995a5d6382ee476d · report
ecf34b65e8d9d3bb · report
d1076220e33b55ba · report
8576d4b41e6ed12f · report
54ab8d446018b958 · report
f552f5cc13186908 · report
fixture: signature obs:Tensor/2/float, deterministic:bool/0/bool, return_log_prob:bool/0/bool · returned tuple · level recorded 2026-09-22 f8ead4c2c205ecd8 · report
fixture: returned Critic · level recorded 2026-09-22 7553f61c31debefb · report
fixture: returned DeterministicPolicy · level recorded 2026-09-22 152bc1e449547d23 · report
fixture: returned GaussianPolicy · level recorded 2026-09-22 94573a894a42ebff · report
fixture: returned Buffer · level recorded 2026-09-22 c74fba5d30037b69 · report
fixture: returned SerializedBuffer · level recorded 2026-09-22 f0f9d0b00b3e9632 · report
fixture: returned StateDependentPolicy · level recorded 2026-09-22 e42d91ba746c3a14 · report
fixture: returned TwinnedStateActionFunction · level recorded 2026-09-22 803d90cd603ff8c0 · report
6af70c8a2239d7c5 · report
ed542fae5c7f2c04 · report
8dc0540b8dfe9b97 · report
424bf06f8d8eb998 · report
fixture: returned AbstractAgent · level recorded 2026-09-22 3faeea6e22edd34d · report
fixture: returned DeterministicPolicy · level recorded 2026-09-22 8ee15fddb3528e86 · report
fixture: returned GaussianPolicy · level recorded 2026-09-22 9e2e2c85eabbd88f · report
a2697a9ea209c680 · report
fixture: signature past_length:int/0/int · returned Tensor · level recorded 2026-09-22 3ef56075bad93ec9 · report
f62b5d3c6983e5aa · report
8119b0afbe2d940e · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 fa8517ef05057c7f · report
fixture: signature serialized_params:bytes/0/?, param_list:list/1/str · returned OrderedDict · level recorded 2026-09-22 36b66092679a3132 · report
fixture: signature data:dict/0/? · returned str · level recorded 2026-09-22 c70b5621a0ca8047 · report
fixture: signature item:dict/0/? · returned bool · level recorded 2026-09-22 ad86f46cc9af956b · report
fixture: signature json_string:str/0/str, custom_objects:dict/0/? · returned dict · level recorded 2026-09-22 1d75daad61f15424 · report
fixture: signature params:dict/0/? · returned bytes · level recorded 2026-09-22 4a486e5048778576 · report
fixture: signature action_space:Box/1/float, action:ndarray/1/float · returned ndarray · level recorded 2026-09-22 5a4d3fd6b28ecaf4 · report
fixture: signature action_space:Box/1/float, scaled_action:ndarray/1/float · returned ndarray · level recorded 2026-09-22 569d921eb9b51536 · report
0dfad75cd2d202d6 · report
8761dc745b44dc04 · report
fixture: returned GaussianPolicy · level recorded 2026-09-22 b1e066bc1ff4b61b · report
fixture: returned StateActionFunction · level recorded 2026-09-22 5d13132d2e3c5ef0 · report
fixture: returned TwinnedStateActionFunction · level recorded 2026-09-22 248f63c9cf4d972e · report
fixture: signature input_dim:int/0/int, output_dim:int/0/int, hidden_units:list/1/int, hidden_activation:callable/0/?, output_activation:callable/0/?, initializer:callable/0/? · returned Sequential · level recorded 2026-09-22 eaf547baf5f33e43 · report
d6d4b5a5d84ba8ad · report
544fe1f08a36cc62 · report
e8abbe917721f0c8 · report
eb9bc09b3ca641cb · report
fixture: signature batch_size:int/0/int · returned tuple · level recorded 2026-09-22 77baa7a1a168fc24 · report
fixture: signature states:Tensor/2/float · returned Tensor · level recorded 2026-09-24 ff7a80131e64a08d · report
b6b1a23b07a627dd · report
e5d43066162708ff · report
fixture: returned SACActor · level recorded 2026-09-22 540316788d2c30c7 · report
fixture: returned PolicyNetwork · level recorded 2026-09-22 70249df825c62d7e · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 0688d4da92feee38 · report
fixture: returned SoftQNetwork · level recorded 2026-09-22 da8ebd6e9ea11fca · report
fixture: returned GaussianPolicy · level recorded 2026-09-22 0d80189fd77d3aa6 · report
fixture: returned QNetwork · level recorded 2026-09-22 18ecb1311366b8cb · report
fixture: signature state:Tensor/2/float · returned Tensor · level recorded 2026-09-24 d6b54769dcaa3ec5 · report
fixture: returned BaseQNet · level recorded 2026-09-22 e6f3bef6186ec524 · report
fixture: returned BatchQNet · level recorded 2026-09-22 5722a85a4a153169 · report
fixture: returned GaussianPolicy · level recorded 2026-09-22 642892e9419a125d · report
fixture: signature s:Tensor/2/float · returned tuple · level recorded 2026-09-22 b7030d8d56cd639a · report
fixture: returned QNetwork · level recorded 2026-09-22 0020d85f4dbfb10b · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 7e61ac4f70c90628 · report
fixture: returned StochasticPolicy · level recorded 2026-09-22 5b2e9a4c85bbab7d · report
fixture: returned TwinnedQNetworks · level recorded 2026-09-22 298e84cf1d9ed36c · report
fixture: signature net:callable/0/? · returned _GeneratorContextManager · level recorded 2026-09-22 d4978950888874f4 · report
fixture: signature overwrite:NoneType/0/?, device:str/0/str, fallback_device:str/0/str · returned device · level recorded 2026-09-22 1afbe631504fbaf7 · report
fixture: signature unit_list:list/1/int, keep_last_relu:bool/0/bool · returned Sequential · level recorded 2026-09-22 05437b66f08eb4d6 · report
706459e26fbb0b4c · report
7d297778525c40d1 · report
85fff8ae028fc1dd · report
6ae1b395aeb4e7d3 · report
a830c8ece63f9c57 · report
fixture: returned MLPActorCritic · level recorded 2026-09-22 c02fc6e11c3ba5cf · report
fixture: returned MLPGaussianPolicy · level recorded 2026-09-22 14211bf5685457cf · report
fixture: returned MLPQFunction · level recorded 2026-09-22 a1e9dc4773ffeba5 · report
fixture: signature odim:int/0/int, hdims:list/1/int, actv:callable/0/?, output_actv:NoneType/0/? · returned Sequential · level recorded 2026-09-22 4731ca1d377b8284 · report
fixture: signature x:EagerTensor/2/float, l:float/0/float, u:float/0/float · returned EagerTensor · level recorded 2026-09-22 5c26c93931dce503 · report
fixture: signature x:EagerTensor/2/float, mu:EagerTensor/2/float, log_std:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22 198be549ce9696ef · report
a860fee8188a0218 · report
6bb425a4771dc88f · report
fixture: returned Batch · level recorded 2026-09-22 c10734f04f231cb4 · report
fixture: signature state_action:tuple/1/Tensor · returned Tensor · level recorded 2026-09-24 4aec8353051fa16d · report
fixture: returned Logger · level recorded 2026-09-22 5d3a98fbf8446e0c · report
fixture: returned MultiLinear · level recorded 2026-09-22 e9664791458e5ade · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 33ec92b652664841 · report
fixture: returned ScalarHolder · level recorded 2026-09-22 02a45597a277afab · report
fixture: returned SquashedDiagonalGaussianHead · level recorded 2026-09-22 cdf94e91c8746537 · report
fixture: signature arr:ndarray/2/float, device:str/0/str, dtype:dtype/0/? · returned Tensor · level recorded 2026-09-22 1dd9b9ae9fa9426f · report
fixture: signature lst:list/1/dict, use_all_keys:bool/0/bool · returned dict · level recorded 2026-09-22 5c5bce3523ed4d69 · report
fixture: signature layer:callable/0/?, gain:float/0/float · returned Linear · level recorded 2026-09-22 110041979f3c0cb8 · report
4849ba61ae47dd70 · report
f299a2900b4034fa · report
5d8f81c210a0aacb · report
fixture: returned Actor · level recorded 2026-09-22 8f0377d2cad944f3 · report
fixture: returned Critic · level recorded 2026-09-22 9ee95d5b4fc2dd44 · report
fixture: returned DeepActor · level recorded 2026-09-22 a57bb45ab6a0bc51 · report
fixture: returned DeepCritic · level recorded 2026-09-22 693c33a1aa6474c6 · report
fixture: returned DeepIQN · level recorded 2026-09-22 94a135edcb95baf2 · report
fixture: returned IQN · level recorded 2026-09-22 91bcdaabd64f8eee · report
fixture: returned PrioritizedReplay · level recorded 2026-09-22 a6c39d1200737d3f · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 d9d455622c2dcd61 · report
fixture: signature td_errors:Tensor/3/float, k:float/0/float · returned Tensor · level recorded 2026-09-22 Method as code Syntology
What Syntology's graph records as this paper's claimed method, lifted into code: each assembly names its bricks (functions and classes), each with its own role and its own verification level. An assembly is not a check that the code implements the method correctly or reproduces the paper's results. Levels are each brick's own verification level in Syntology's graph (level 0: no recorded run), listed brick by brick and never combined into one level; “ran” means the brick executed on a synthesized input, not that its output is correct, and the instrument figure counts failures of Syntology's instrument, not of the code. Where a model read the code against the paper's claim, each assembly's label verdict is one model's judgement, kept in this page's JSON twin; it is not calibrated, so no card prints it. Siblings are assemblies lifted from this paper in the same batch for the same method: alternative readings kept side by side; none replaces or supersedes another.
27 assemblies on this paper: 27 harvested, 0 generated, listed in 1 groups (siblings lifted in one batch form one group).
27 sibling assemblies for soft actor-critic (harvested), lifted in the same batch on 2026-09-09: alternative readings kept side by side; none replaces or supersedes another. Bricks printed for 12 of 27 sibling assemblies; the other 15 are listed with their counts; every brick is in this page's JSON twin.
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 7 bricks; individually on a fixture: 6 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 6 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 27 siblings
- Agent_ManualTemperature entry · level 1 · ran ·
0918147b61a18074 - Agent helper · level 0 · unverified ·
b0e759b2d521e146 - Critic model · level 1 · ran ·
7c4433b21cf61a2c - Value helper · level 1 · ran ·
f8845c35735f20bc - Actor model · level 1 · ran ·
de5e64dc2bfc6a33 - ReplayBuffer sampler · level 1 · ran ·
ac5ecca5b7705f8a - Network helper · level 1 · ran ·
de764e9177884a12
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 6 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 3 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 27 siblings
- soft_actor_critic_agent entry · level 1 · ran ·
3a0835e6ce008741 - GaussianPolicy model · level 1 · ran ·
bf0d89394b22e1b6 - QNetwork model · level 1 · ran ·
f37748964b0cd7da - hard_update update_rule · level 0 · unverified ·
799c08d64f58d9ef - soft_update update_rule · level 0 · unverified ·
f735812881238a1f - weights_init_ helper · level 0 · unverified ·
0537c4bc8300d410
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 10 bricks; individually on a fixture: 8 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified. The assembly has not been run end-to-end.
one of 27 siblings
- SAC entry · level 0 · unverified ·
569d921eb9b51536 - ReplayBuffer sampler · level 1 · ran ·
8119b0afbe2d940e - bytes_to_params helper · level 1 · ran · our draft was wrong ·
fa8517ef05057c7f - data_to_json helper · level 1 · ran · our draft was wrong ·
36b66092679a3132 - json_to_data helper · level 1 · ran · our draft was wrong ·
ad86f46cc9af956b - params_to_bytes helper · level 1 · ran · our draft was wrong ·
1d75daad61f15424 - scale_action helper · level 1 · ran · our draft was wrong ·
4a486e5048778576 - set_global_seeds helper · level 0 · unverified ·
0dfad75cd2d202d6 - unscale_action helper · level 1 · ran · our draft was wrong ·
5a4d3fd6b28ecaf4 - is_json_serializable helper · level 1 · ran · violated contract ·
c70b5621a0ca8047
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 7 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 3 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 27 siblings
- SAC entry · level 0 · unverified ·
0edd4b0f90be8f84 - Critic model · level 1 · ran ·
f8ead4c2c205ecd8 - DeterministicPolicy model · level 1 · ran ·
7553f61c31debefb - GaussianPolicy model · level 1 · ran ·
152bc1e449547d23 - hard_update update_rule · level 0 · unverified ·
799c08d64f58d9ef - soft_update update_rule · level 0 · unverified ·
f735812881238a1f - weights_init_ helper · level 0 · unverified ·
0537c4bc8300d410
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 11 bricks; individually on a fixture: 10 ran (of which 8 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified. The assembly has not been run end-to-end.
one of 27 siblings
- Agent entry · level 0 · unverified ·
2ae117303c9ac594 - Actor model · level 1 · ran ·
5d8f81c210a0aacb - Critic model · level 1 · ran ·
8f0377d2cad944f3 - DeepActor helper · level 1 · ran ·
9ee95d5b4fc2dd44 - DeepCritic helper · level 1 · ran ·
a57bb45ab6a0bc51 - DeepIQN helper · level 1 · ran ·
693c33a1aa6474c6 - IQN helper · level 1 · ran ·
94a135edcb95baf2 - PrioritizedReplay helper · level 1 · ran ·
91bcdaabd64f8eee - ReplayBuffer helper · level 1 · ran ·
a6c39d1200737d3f - calculate_huber_loss loss · level 1 · ran · our draft was wrong ·
d9d455622c2dcd61 - hidden_init helper · level 1 · ran · honoured contract ·
24ee38e114b38bce
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 13 bricks; individually on a fixture: 10 ran (of which 6 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified. The assembly has not been run end-to-end.
one of 27 siblings
- SAC entry · level 0 · unverified ·
4849ba61ae47dd70 - AlgorithmBase helper · level 0 · unverified ·
110041979f3c0cb8 - Batch helper · level 1 · ran ·
6bb425a4771dc88f - ConcatStateAction helper · level 1 · ran ·
c10734f04f231cb4 - Logger helper · level 1 · ran ·
4aec8353051fa16d - MultiLinear helper · level 1 · ran ·
5d3a98fbf8446e0c - ReplayBuffer helper · level 1 · ran ·
e9664791458e5ade - ScalarHolder helper · level 1 · ran ·
33ec92b652664841 - SquashedDiagonalGaussianHead helper · level 1 · ran ·
02a45597a277afab - ortho_init helper · level 1 · ran · our draft was wrong ·
5c5bce3523ed4d69 - polyak_update helper · level 0 · unverified ·
f299a2900b4034fa - convert_to_tensor helper · level 1 · ran · our draft was wrong ·
cdf94e91c8746537 - group_by_keys helper · level 1 · ran · our draft was wrong ·
1dd9b9ae9fa9426f
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 4 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 27 siblings
- SAC_Trainer entry · level 0 · unverified ·
3e1e70dd1d5f3958 - PolicyNetwork model · level 1 · ran ·
540316788d2c30c7 - SoftQNetwork model · level 1 · ran ·
0688d4da92feee38 - ReplayBuffer sampler · level 1 · ran ·
70249df825c62d7e
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 6 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified. The assembly has not been run end-to-end.
one of 27 siblings
- mlp_actor_critic entry · level 0 · unverified ·
8498689f07030ac8 - apply_squashing_func helper · level 0 · unverified ·
198be549ce9696ef - mlp helper · level 0 · unverified ·
e68b07bcdded00fa - mlp_gaussian_policy model · level 0 · unverified ·
a860fee8188a0218 - clip_but_pass_gradient helper · level 1 · ran · honoured contract ·
4731ca1d377b8284 - gaussian_likelihood helper · level 1 · ran · honoured contract ·
5c26c93931dce503
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 27 siblings
- SACActor entry · level 1 · ran ·
e5d43066162708ff - RLNetwork helper · level 0 · unverified ·
b36d35fd411b0150
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 4 bricks; individually on a fixture: 4 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified. The assembly has not been run end-to-end.
one of 27 siblings
- MLPActorCritic entry · level 1 · ran ·
a830c8ece63f9c57 - MLPGaussianPolicy model · level 1 · ran ·
c02fc6e11c3ba5cf - MLPQFunction model · level 1 · ran ·
14211bf5685457cf - mlp helper · level 1 · ran · our draft was wrong ·
a1e9dc4773ffeba5
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 2 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified. The assembly has not been run end-to-end.
one of 27 siblings
- SoftActor entry · level 1 · ran ·
b473c449b3da39cc - _create_fcnn model · level 1 · ran · our draft was wrong ·
b7fc01f37cbb0eb1
harvested Assembly for soft actor-critic (graph method: soft actor-critic). 13 bricks; individually on a fixture: 4 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified. The assembly has not been run end-to-end.
one of 27 siblings
- SAC entry · level 0 · unverified ·
348b1924f106de50 - Algorithm helper · level 0 · unverified ·
eaf547baf5f33e43 - GaussianPolicy model · level 1 · ran ·
8761dc745b44dc04 - TwinnedStateActionFunction model · level 1 · ran ·
5d13132d2e3c5ef0 - assert_action helper · level 0 · unverified ·
ded76544fe9d6607 - disable_gradients helper · level 0 · unverified ·
56dd8863f4522252 - soft_update helper · level 0 · unverified ·
e8abbe917721f0c8 - update_params helper · level 0 · unverified ·
33523284389291bf - BaseNetwork helper · level 0 · unverified ·
d6d4b5a5d84ba8ad - create_linear_network helper · level 1 · ran; the contract check could not run (RAISES) ·
248f63c9cf4d972e - StateActionFunction model · level 1 · ran ·
b1e066bc1ff4b61b - _soft_update helper · level 0 · unverified ·
231f633be51bd617 - initialize_weights_xavier helper · level 0 · unverified ·
544fe1f08a36cc62
- SAC · 6d1ab8e8bdfceece · 3 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[12] in the JSON twin
- SAC · 71e70b31947abb15 · 8 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[13] in the JSON twin
- Agent · 7afa0732a741d65f · 12 bricks; individually on a fixture: 7 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified · The assembly has not been run end-to-end · assemblies[14] in the JSON twin
- SAC · 8aeea19ed7035e4d · 6 bricks; individually on a fixture: 5 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[15] in the JSON twin
- SACLearner · 8ef2b775d0263949 · 4 bricks; individually on a fixture: 0 ran · 4 unverified · The assembly has not been run end-to-end · assemblies[16] in the JSON twin
- SAC · 8f0e5a2033e2561b · 8 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[17] in the JSON twin
- SAC · 9adf4f562cd31d82 · 8 bricks; individually on a fixture: 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[18] in the JSON twin
- SAC · ab52e9144e49f38b · 13 bricks; individually on a fixture: 9 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[19] in the JSON twin
- SAC · b9bb35d3946b1c03 · 7 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[20] in the JSON twin
- TanhGaussianPolicySACAdapt · bdd0e01576c7006a · 3 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[21] in the JSON twin
- SoftActorCritic · d403ed8fc6e6a467 · 7 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified · The assembly has not been run end-to-end · assemblies[22] in the JSON twin
- SAC · d8d052895ed6eaaa · 11 bricks; individually on a fixture: 6 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified · The assembly has not been run end-to-end · assemblies[23] in the JSON twin
- SAC · ea1ea881ec00edf6 · 7 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[24] in the JSON twin
- ReplayBuffer · f9d74563daee1fbd · 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[25] in the JSON twin
- policyNet · fe2e45dc0661c714 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[26] in the JSON twin
Each brick ends with its code_sha256, Syntology's identity for that exact code; click one to copy the get_code call that returns it. For agents, on Syntology's MCP service: assembly(arxiv_id="1801.01290") returns these assemblies with each brick's role and wiring (how to connect).
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Continuous Control | Lunar Lander (OpenAI Gym) | SAC | Score | 284.59±0.97 | #1 of 5 | Archive leaderboard | report |
| OpenAI Gym | Ant-v4 | SAC | Average Return | 5208.09 | #3 of 5 | Archive leaderboard | report |
| OpenAI Gym | HalfCheetah-v4 | SAC | Average Return | 15836.04 | #1 of 5 | Archive leaderboard | report |
| OpenAI Gym | Hopper-v4 | SAC | Average Return | 2882.56 | #3 of 5 | Archive leaderboard | report |
| OpenAI Gym | Humanoid-v4 | SAC | Average Return | 6211.50 | #2 of 5 | Archive leaderboard | report |
| OpenAI Gym | Walker2d-v4 | SAC | Average Return | 5745.27 | #1 of 5 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Introduced by this paper: Soft Actor Critic
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections