Papers › Continuous control with deep reinforcement learning
Continuous control with deep reinforcement learning
Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, Daan Wierstra
We adapt the ideas underlying the success of Deep Q-Learning to the continuous action domain. We present an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces. Using the same learning algorithm, network architecture and hyper-parameters, our algorithm robustly solves more than 20 simulated physics tasks, including classic problems such as cartpole swing-up, dexterous manipulation, legged locomotion and car driving. Our algorithm is able to find policies whose performance is competitive with those found by a planning algorithm with full access to the dynamics of the domain and its derivatives. We further demonstrate that for many of the tasks the algorithm can learn policies end-to-end: directly from raw pixel inputs.
In Syntology View this paper on Syntology, its page in Syntology's graph. That page adds which of its functions are also present in other papers' code Syntology holds, with dates, and its dated run record as JSON and a README badge. It also lists the repositories linked to the paper, the abstract and the calls for agents.
Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
For agents, on Syntology's MCP service (how to connect):
get_harvested_code_for_paper(arxiv_id="1509.02971")get_code(code_sha256="…")with a sample'scode_sha256from the list belowget_citation_path(paper_1="1509.02971", paper_2="…")with another paper's arXiv id or titleget_concepts_for_paper(arxiv_id="1509.02971")
Code
Syntology 306 code samples: 305 from 87 repositories linked to this paper, 1 identical to code harvested from another paper's repository. Across all 306: 163 ran (of which 126 constructed an object rather than computing a result; 152 with no instrument failure: 3 honoured, 0 violated, 149 with no contract checked; 11 where Syntology's instrument failed) · 143 unverified. Where Syntology's instrument failed: 5 where our contract draft was wrong; 6 where the contract check could not run; failures of Syntology's instrument, not of the code.
By repository: community (archive-listed): 305 samples from 87 repositories, 162 ran (152 with no instrument failure; 10 where Syntology's instrument failed); 1 identical to code first harvested elsewhere. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.
No sample is linked to this paper from 17 of its repositories that Syntology harvested for other papers:
- KAIST-AILab/deeprl_practice_colab, community (archive-listed): harvested for 2 other papers, listed under the repository
- NOHYC/autonomous_driving_car_project, community (archive-listed): harvested for another paper, listed under the repository
- Remtasya/DDPG-Actor-Critic-Reinforcement-Learning-Reacher-Environment, community (archive-listed): harvested for another paper, listed under the repository
- YangRui2015/Modular_HER, community (archive-listed): harvested for another paper, listed under the repository
- alhabk/SGEE--pytorch, community (archive-listed): harvested for another paper, listed under the repository
- bacdavid/HER, community (archive-listed): harvested for another paper, listed under the repository
- chainer/chainerrl, community (archive-listed): harvested for another paper, listed under the repository
- fdcl-gwu/gym-rotor, community (archive-listed): harvested for another paper, listed under the repository
- flowersteam/curious, community (archive-listed): harvested for another paper, listed under the repository
- h-aboutalebi/SparceReward, community (archive-listed): harvested for another paper, listed under the repository
- liuyuezhang/pyrl, community (archive-listed): harvested for 2 other papers, listed under the repository
- shakedzy/warehouse, community (archive-listed): harvested for another paper, listed under the repository
- tegg89/magnet, community (archive-listed): harvested for another paper, listed under the repository
- DLR-RM/stable-baselines3, community (archive-listed): harvested for another paper, listed under the repository
- facebookresearch/rl, community (archive-listed): harvested for another paper, listed under the repository
- hill-a/stable-baselines, community (archive-listed): harvested for 2 other papers, listed under the repository
- jakegrigsby/deep_control, community (archive-listed): harvested for another paper, listed under the repository
Levels written between 2026-09-22 and 2026-09-26 (UTC): the dates Syntology's graph wrote each sample's verification level, not when the code executed.
161 repositories listed; official and paper-mentioned ones first.
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.
Code Syntology ran Syntology
306 samples harvested: 163 ran (of which 126 constructed an object rather than computing a result; 152 with no instrument failure: 3 honoured, 0 violated, 149 with no contract checked; 11 where Syntology's instrument failed) · 143 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Syntology's record for this page has not changed since , the first build that kept a record date for it; when this build read Syntology's graph is in the build record. That date is not when the samples ran.
Licence: 163 of the 306 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.
Harvested from 87 repositories linked to this paper, official or community; the list below is grouped by repository, each group headed by its name and what it is to the paper. 1 sample is listed last, in a group without a repository. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. A line beginning “fixture:” under a sample that ran gives the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right. “Level recorded” gives the UTC date when Syntology's graph wrote the sample's verification level, not when the code executed; where the level was written before Syntology's graph kept that date, the row says “level recorded, date not recorded”. For 22 samples that ran, the graph records a signature this page does not show: for a class the fixture built without calling, the harness called the object with inputs it made up itself, so the recorded signature is the harness's probe, not the fixture's arguments. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself. “Our draft was wrong” and “the contract check could not run” are failures of Syntology's instrument, not of the code: the sample ran on Syntology's synthesized input, and then the drafted contract did not describe it, or the check itself raised an error (RAISES), lacked a dependency (DEP_MISSING) or ran out of time (TIMEOUT); hover the label for which. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.
Each sample ends with its code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.
Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples are grouped by repository: a repository marked official first, then by how directly the repository is tied to the paper, then in the archive's order; never by how many ran. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is cleared, but the stored copy of the same code that Syntology serves is not. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.
A function or class name links to its page when the name occurs in the harvested code of at least 5 papers; the name is a string, not an identity. A census tag appears when Syntology's census ran implementations with that name on one shared input per bucket: it gives how many were compared, from how many papers, and how many distinct outputs they produced, and names this sample's bucket when this sample was one of them.
40c191818d46c0c5 · report
b07dfe06f4498bba · report
fixture: returned Prioritized_experience_replay · level recorded 2026-09-22 66d85c7900951847 · report
fixture: returned Replay_Buffer · level recorded 2026-09-22 ca95bd1bfa26d31f · report
fixture: returned _actor_network · level recorded 2026-09-22 fe8293ee7abbf8aa · report
fixture: returned _critic_network · level recorded 2026-09-22 ae6be9eb7b4764c8 · report
dc719785d5a0b9f7 · report
fixture: returned DDPG · level recorded 2026-09-22 0562ed655f21cba8 · report
fixture: returned OUNoise · level recorded 2026-09-22 4abb7a0681b9f8e3 · report
4ea2dabac66df07c · report
fixture: returned Actor · level recorded 2026-09-22 59f7f71edc829572 · report
fixture: returned CircularBuffer · level recorded 2026-09-22 a51e802f97dc5850 · report
fixture: returned Critic · level recorded 2026-09-22 b51369036ab5a352 · report
fixture: returned DDPGAgent · level recorded 2026-09-22 a15460ad3a6b391e · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 cf7f0fe0d3ac16d9 · report
fixture: signature env:MockEnv/0/? · returned tuple · level recorded 2026-09-22 a6b3153326abaddd · report
14b6d9e3982a117c · report
e58c3a477f895e6c · report
24c0dee0fb0fec39 · report
e76268df8017c794 · report
fixture: returned OU_noise · level recorded 2026-09-22 8afc63f093262b83 · report
a36fc940a0f3eb1b · report
4b11a27451c374cd · report
2233e3bf2203e01d · report
fixture: returned Actor · level recorded 2026-09-22 7a433b7591cb1ad7 · report
fixture: returned Critic · level recorded 2026-09-22 d7af24edd798e11c · report
fixture: returned OUNoise · level recorded 2026-09-22 8950c65039fc4fe3 · report
6d718c5a05a53b10 · report
fixture: returned Actor · level recorded 2026-09-22 5029b7b1380f0988 · report
fixture: returned Critic · level recorded 2026-09-22 ef85fd5d912b3855 · report
fixture: returned OrnsteinUhlenbeckProcess · level recorded 2026-09-22 79dfb108cab48c77 · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 d96fe6b321763c14 · report
e60542a6e12b3525 · report
fixture: returned ExperienceReplay · level recorded 2026-09-22 375a3ee63ca7c68d · report
fixture: returned ActorNetwork · level recorded 2026-09-22 6429748a5267bb8a · report
fixture: returned CriticNetwork · level recorded 2026-09-22 c0e725d5bf9fb153 · report
d8fadcf1cbc892d5 · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 b34e1d14d05b3345 · report
c9b4479f17459322 · report
fixture: returned ActorCriticDeterministic · level recorded 2026-09-22 census: 8 implementations from 8 papers, 3 distinct outputs across 3 buckets, one shared input per bucket this sample: bucket 1 of 3, arg 1: rank 2, kind float, dtype float32 network/Networks.py ran · honoured contract fingerprinted no licence file found · pointer only ·
f0945ef1933b173a · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 269f19cc9358c590 · report
684ee98628f58937 · report
8f5c14d98d39f3b9 · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 4c5d9db3e7d648c9 · report
fixture: signature x:Tensor/2/float, u:Tensor/2/float · returned tuple · level recorded 2026-09-22 1229a5d8dea62487 · report
200b44ea7ead9ab6 · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 daeec7442740e76e · report
fixture: signature x:Tensor/2/float, u:Tensor/2/float · returned Tensor · level recorded 2026-09-22 da2a0693988d4238 · report
fixture: returned Actor · level recorded 2026-09-22 40513685bd8b8200 · report
fixture: returned Critic · level recorded 2026-09-22 8f17f70a798c9257 · report
fixture: returned DoubleCritic · level recorded 2026-09-22 a75c153872d7f256 · report
fixture: returned FactorizedNoisyLinear · level recorded 2026-09-22 5b62ad877a674563 · report
fixture: signature x:Tensor/2/float, raw_action:NoneType/0/?, deterministic:bool/0/bool · returned tuple · level recorded 2026-09-24 98596830b8e76bd9 · report
fixture: returned IndependentNoisyLinear · level recorded 2026-09-22 416bd507555ea4fa · report
fixture: returned Logger · level recorded 2026-09-22 0d87c7101b2953f2 · report
fixture: returned ReplayMemory · level recorded 2026-09-22 4618f3f110556784 · report
fixture: returned Rollout · level recorded 2026-09-22 1d6614860f0f4b57 · report
fixture: returned ValueHead · level recorded 2026-09-22 34bfe74d89d0491d · report
fixture: signature layer_type:str/0/str, input_dim:int/0/int, output_dim:int/0/int, sigma_init:float/0/float · returned FactorizedNoisyLinear · level recorded 2026-09-22 census: 8 implementations from 12 papers, 6 distinct outputs across 4 buckets, one shared input per bucket this sample: bucket 1 of 4, arg 1: rank 2, kind float, dtype float32 · arg 2: rank 2, kind float, dtype float32 mobile_robot_rl/agents/sac.py ran · our draft was wrong MIT (permissive) ·
d08ac0b87604485e · report
fixture: signature prediction:Tensor/2/float, target:Tensor/2/float, reduction:Reduction/0/? · returned Tensor · level recorded 2026-09-22 d702970461989ce2 · report
1be47476efdc31c1 · report
39110b4bbc0661d2 · report
fixture: returned ActorNetwork · level recorded 2026-09-22 c64a46f5ad45b01a · report
fixture: returned CriticNetwork · level recorded 2026-09-22 ef632145448c9d94 · report
fixture: returned OUActionNoise · level recorded 2026-09-22 7ebcb237f3ac8b6b · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 513584b85fd46561 · report
976480803a792876 · report
fixture: returned Actor · level recorded 2026-09-22 db5f4c6c0d3a50b4 · report
fixture: returned Critic · level recorded 2026-09-22 8fadcc5f80d1e9b5 · report
fixture: returned DDPG · level recorded 2026-09-22 6d50e581fbec00bb · report
fixture: returned OUNoise · level recorded 2026-09-22 85896c6b57d5891f · report
fixture: returned OUNoise · level recorded 2026-09-22 cbd6d4cba3c8f7b0 · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 8062e958090e2e1f · report
fixture: returned Actor · level recorded 2026-09-22 2cee98e5475e680a · report
fixture: returned Critic · level recorded 2026-09-22 21303179927140a0 · report
fixture: returned OUNoise · level recorded 2026-09-22 caf348a3362776fb · report
1f1a916ff3cde3a5 · report
fixture: returned Actor · level recorded 2026-09-22 111a712bc883469d · report
fixture: returned Critic · level recorded 2026-09-22 4343e52712fa663d · report
fixture: returned DDPG · level recorded 2026-09-22 017ef34f0499756e · report
4080c577fc710255 · report
ae000ab63f993f26 · report
5c21d19fa9ff6b4b · report
e8ec892b92d9062e · report
b2fbe2ad70b688a2 · report
a1866c0223c9dca1 · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 f6231123b603e20f · report
cf0cfca323e5c3c4 · report
44abfcb21806cc13 · report
fixture: returned FCBody · level recorded 2026-09-22 6b17610b667cbc34 · report
fixture: returned MLPActor · level recorded 2026-09-22 d4f94d4568e6a3f3 · report
fixture: returned ndarray · level recorded 2026-09-22 132cdd71f41a5c43 · report
fixture: returned ndarray · level recorded 2026-09-22 dceb05d9d5cc7ee5 · report
fixture: signature state_shape:tuple/1/int, action_dim:int/0/int, action_bound:float/0/float, action_shift:ndarray/1/float, units:tuple/1/int · returned Functional · level recorded 2026-09-22 edb5292361905292 · report
fixture: signature state_shape:tuple/1/int, action_dim:int/0/int, units:tuple/1/int · returned Functional · level recorded 2026-09-22 ac16f6e8f09e31bc · report
222a72ff1d084586 · report
9c10e0c8cad8f8a1 · report
c3809b45fe3af363 · report
709bf3140064269c · report
7b82c41b5ad0e056 · report
338005115fd3efac · report
8a1d8ca5ca9e0472 · report
ac81a4e465c9a89b · report
2d6179a73f14ca5e · report
28af75dd1e756e4d · report
b7b4ba4db14ceff3 · report
fixture: returned Actor · level recorded 2026-09-22 b5564eaf87a00dd7 · report
fixture: returned Agent · level recorded 2026-09-22 ba54cbfa6390641d · report
fixture: returned Critic · level recorded 2026-09-22 9c01f30e9f1052e8 · report
6eca632bf823e7db · report
fixture: returned Actor · level recorded 2026-09-22 65567268c56c2f46 · report
fixture: returned Critic · level recorded 2026-09-22 84cb9968a76ef8e6 · report
fixture: returned DDPG · level recorded 2026-09-22 f13dfb890ccc97a8 · report
fixture: returned AC_Off_POC_DDPG · level recorded 2026-09-22 024ce7deaed96813 · report
fixture: returned Actor · level recorded 2026-09-22 f2987dfa659c5d53 · report
fixture: returned Critic · level recorded 2026-09-22 59b451ca369c1de8 · report
fixture: returned Actor · level recorded 2026-09-22 b78a712913941f90 · report
fixture: returned Critic · level recorded 2026-09-22 06e140e447cd7fb3 · report
fixture: returned OUNoise · level recorded 2026-09-22 364b3433ab267478 · report
8496458fca8ba950 · report
fixture: signature t:int/0/int · returned NoneType · level recorded 2026-09-24 cada5e0bd569171d · report
fixture: signature t:int/0/int · returned NoneType · level recorded 2026-09-22 88607f875726a410 · report
fixture: signature batch_size:int/0/int · returned tuple · level recorded 2026-09-22 0132cf6a5e04f2ad · report
fixture: signature filename:str/0/str · returned Logger · level recorded 2026-09-22 fbe0975fffcc8005 · report
4644458fd0a4374e · report
42c7eae4db28a7cb · report
dfd2f69c5bd6bd73 · report
328c50f6e3095851 · report
fixture: returned Actor · level recorded 2026-09-22 584aca50891286f5 · report
fixture: returned Agent · level recorded 2026-09-22 6e0920a743c03903 · report
fixture: returned Critic · level recorded 2026-09-22 affd388fecde62eb · report
fixture: returned OUNoise · level recorded 2026-09-22 046c7d82e0f35a06 · report
fixture: returned OUNoise · level recorded 2026-09-22 48908dfdd43f1c2f · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 8bd7d62053fbfae5 · report
42b59cfab688e3f5 · report
5b513793c76f96d8 · report
cd47b224d263fba6 · report
49ac8c4b2338f149 · report
d7979806fed71eee · report
fixture: returned Agent · level recorded 2026-09-22 ed77765a89c3c5ba · report
fixture: returned OUActionNoise · level recorded 2026-09-22 eb1ba8dec1905c59 · report
fixture: returned PendulumPlant · level recorded 2026-09-22 3869ba95ec3a2e1a · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 837dcd3ff834a51f · report
fixture: returned SimplePendulumEnv · level recorded 2026-09-22 1d2fffeddc2ad914 · report
fixture: returned Simulator · level recorded 2026-09-22 5f358d33ffd43ed3 · report
fixture: signature state_shape:tuple/1/int, upper_bound:float/0/float, verbose:bool/0/bool · returned Functional · level recorded 2026-09-22 57f92caea351b30b · report
fixture: signature radius:float/0/float, centX:float/0/float, centY:float/0/float, angle_:float/0/float, theta2_:float/0/float, color_:str/0/str · returned tuple · level recorded 2026-09-22 a143a950a76e3523 · report
fixture: signature state_shape:tuple/1/int, n_actions:int/0/int, verbose:bool/0/bool · returned Functional · level recorded 2026-09-22 fa624e896014aa19 · report
c6840dd2ce1ed774 · report
4210d97aa24222d8 · report
fixture: returned Critic · level recorded 2026-09-22 037ce510df007080 · report
fixture: returned DDPGAgent · level recorded 2026-09-22 e47034c4a39da307 · report
fixture: returned OUNoise · level recorded 2026-09-22 1a3c5297309ff7b3 · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 f6a31a3f71f0c87a · report
fixture: returned PRNGKeys · level recorded 2026-09-22 c5cbbbbfdd3a367c · report
6040d49d762613d7 · report
0d51c1e5212918ec · report
f39751e02169b745 · report
fixture: signature env:SimpleEnv/0/? · returned FilteredEnv · level recorded 2026-09-26 3ad5029d3ca03531 · report
fixture: returned AnnealedGaussianProcess · level recorded 2026-09-22 060c46e5cc508cc5 · report
fixture: returned Critic · level recorded 2026-09-22 07b241d4ab8ac0cb · report
fixture: returned EpisodicMemory · level recorded 2026-09-22 ff0baff75d5cb615 · report
fixture: returned Evaluator · level recorded 2026-09-22 a5e014313403ae12 · report
fixture: returned Memory · level recorded 2026-09-22 37ebaf510f179bf4 · report
fixture: returned OrnsteinUhlenbeckProcess · level recorded 2026-09-22 ab1c58fa8208bfec · report
fixture: returned RandomProcess · level recorded 2026-09-22 3f3476b061f68f18 · report
fixture: returned RingBuffer · level recorded 2026-09-22 0d0842514b1844a1 · report
fixture: signature size:tuple/1/int, fanin:NoneType/0/? · returned Tensor · level recorded 2026-09-22 b5cc72675b688b00 · report
fixture: signature observation:ndarray/2/float · returned ndarray · level recorded 2026-09-22 958765de0feeec56 · report
f21df3758ed39418 · report
fb986aef8cb19dcb · report
fixture: returned Actor · level recorded 2026-09-22 f93619eb32cfaf3d · report
fixture: returned Critic · level recorded 2026-09-22 a3c118a9e035f7e4 · report
fixture: returned RingBuffer · level recorded 2026-09-22 980051699184bfdd · report
fixture: returned SequentialMemory · level recorded 2026-09-22 6298e4cee53206cd · report
fixture: signature low:int/0/int, high:int/0/int, size:int/0/int · returned list · level recorded 2026-09-22 259742c65c2d6559 · report
fixture: returned AgentMemory · level recorded 2026-09-22 e48c1f362301c6a8 · report
fixture: returned Critic · level recorded 2026-09-22 4e16ab1aa52fc01f · report
fixture: returned Policy · level recorded 2026-09-22 078c84de4438f91b · report
75b2da574221eee2 · report
c5b393b179d8d497 · report
8190363f4546bfd1 · report
cf91990d28ccf56a · report
fixture: signature batch_size:int/0/int · returned NoneType · level recorded 2026-09-24 00d63e51f73faefb · report
fixture: returned Actor · level recorded 2026-09-22 55f075a92d493d35 · report
fixture: returned Critic · level recorded 2026-09-22 642df90cf8f1851a · report
fixture: returned OrnsteinUhlenbeckActionNoise · level recorded 2026-09-22 76a41f814d76f5c0 · report
64db7b42a6e83850 · report
fixture: returned Actor · level recorded 2026-09-22 b6d3efae859b7b5b · report
fixture: returned Critic · level recorded 2026-09-22 f0163af304a40792 · report
fixture: returned OUNoise · level recorded 2026-09-22 6258582b31c25005 · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 d96d6110c00ab9d4 · report
fixture: signature state:Tensor/2/float · returned Tensor · level recorded 2026-09-22 b0866a4da4a62415 · report
fixture: returned Actor · level recorded 2026-09-22 dc8d86e2dc6fd389 · report
fixture: returned Actor · level recorded 2026-09-22 532a74ad7f880104 · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 7f073c276baecc11 · report
c3081f2569beb64e · report
fixture: returned Actor · level recorded 2026-09-22 6e1fded857f54d7a · report
fixture: returned Critic · level recorded 2026-09-22 7e2a8290108cb3ea · report
fixture: returned OUNoise · level recorded 2026-09-22 87674610395558bb · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 661322009d0d9169 · report
b9b27fa7acc7c73f · report
d5cb870eb8408c73 · report
a5d631b897e1acb6 · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 7869f0d6349f369b · report
fixture: signature x:Tensor/2/float, actions:Tensor/2/float · returned Tensor · level recorded 2026-09-22 83a88d1e71ef2df5 · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 ddcc51cfeb97e2a4 · report
af08b37858b1dd07 · report
031efd28ccd13e08 · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 8f5f60d9f1d5e30f · report
f3ea6018cdcc0b04 · report
7f050e7ce4583465 · report
28eeee629d33c0ad · report
fixture: returned DDPG · level recorded 2026-09-22 ccb0aa1ef035eb8e · report
fixture: returned Memory · level recorded 2026-09-22 749aa0dd2a4c1d09 · report
dff03781c5d0b378 · report
fixture: signature num_states:int/0/int, num_actions:int/0/int, action_high:int/0/int · returned Functional · level recorded 2026-09-22 35d7e5f360ca6981 · report
fixture: returned ndarray · level recorded 2026-09-22 eb9e7e016a76b1f8 · report
ef0c12a6692597db · report
0872133cc6e7eee2 · report
2216995588e06169 · report
5869ee9ef41338a4 · report
fixture: returned ActorNetwork · level recorded 2026-09-22 b796e48c52beebc5 · report
fixture: returned CriticNetwork · level recorded 2026-09-22 ed80a9cbb590756d · report
fb2a2e6b4cc0d551 · report
752f0cadbbfe89a3 · report
d108d1b5ff426750 · report
fixture: signature board:ndarray/2/int · returned tuple · level recorded 2026-09-25 930b524d6b021ed1 · report
c04864a6841339e7 · report
e95e6dd3a35646ba · report
8e9ed77aca673ea4 · report
13e0cdee9d418dbc · report
093c23bdbb785c8a · report
abffeadabe12af6b · report
a8bd327c1c912a9d · report
fixture: signature dataset:_TensorSliceDataset/0/?, epoch:int/0/int, objective:str/0/str · returned NoneType · level recorded 2026-09-24 9d5ea952455199bc · report
b2a68c19e99020f6 · report
fixture: signature X:list/1/float · returned float · level recorded 2026-09-26 5a5eafa2c20fcefe · report
fixture: signature state:dict/0/? · returned ndarray · level recorded 2026-09-26 census: 53 implementations from 63 papers, 16 distinct outputs across 8 buckets, one shared input per bucket rl_portfolio_management/util.py unverified MIT (permissive) ·
84d603f2102cf1ed · report
462527aca7c44cd5 · report
fixture: returned Actor · level recorded 2026-09-22 1e7906d3e94a41ce · report
fixture: returned ActorNet · level recorded 2026-09-22 7167793e1651d552 · report
fixture: returned Agent · level recorded 2026-09-22 fa4e45cc6c3c6500 · report
fixture: signature s:Tensor/2/float, a:Tensor/2/float · returned Tensor · level recorded 2026-09-24 dc27eb092679d1d2 · report
fixture: returned Memory · level recorded 2026-09-22 3c7178cf937ba425 · report
fixture: returned ReplayBuffer · level recorded 2026-09-22 ff673a112b0d8acd · report
61958a4594b078dd · report
fixture: returned DDPG_Agent · level recorded 2026-09-22 417fff584ab90a11 · report
fixture: returned actor_netw · level recorded 2026-09-22 90cab8ba8631c2f8 · report
fixture: returned critic_netw · level recorded 2026-09-22 491a0ea3930828b7 · report
fixture: returned ActorCriticNetwork · level recorded 2026-09-22 5223341b731ed4cb · report
fixture: returned ActorCriticNetworkContinuous · level recorded 2026-09-22 4fcd027380e5ca56 · report
fixture: returned NormalDistrLayer · level recorded 2026-09-22 1 sample is identical to code Syntology harvested from another paper's repository; this paper's own copy was not located, so no repository is named and no licence is recorded.
825ecb6732e9fc31 · report
fixture: signature size:tuple/1/int, fanin:int/0/int · returned Tensor · level recorded 2026-09-22 Method as code Syntology
What Syntology's graph records as this paper's claimed method, lifted into code: each assembly names its bricks (functions and classes), each with its own role and its own verification level. An assembly is not a check that the code implements the method correctly or reproduces the paper's results. Levels are each brick's own verification level in Syntology's graph (level 0: no recorded run), listed brick by brick and never combined into one level; “ran” means the brick executed on a synthesized input, not that its output is correct, and the instrument figure counts failures of Syntology's instrument, not of the code. Where a model read the code against the paper's claim, each assembly's label verdict is one model's judgement, kept in this page's JSON twin; it is not calibrated, so no card prints it. Siblings are assemblies lifted from this paper in the same batch for the same method: alternative readings kept side by side; none replaces or supersedes another.
84 assemblies on this paper: 84 harvested, 0 generated, listed in 1 groups (siblings lifted in one batch form one group).
84 sibling assemblies for actor-critic, model-free algorithm based on the deterministic policy gradient (harvested), lifted in the same batch on 2026-09-09: alternative readings kept side by side; none replaces or supersedes another. Bricks printed for 12 of 84 sibling assemblies; the other 72 are listed with their counts; every brick is in this page's JSON twin.
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 1 brick; individually on a fixture: 0 ran · 1 unverified. The assembly has not been run end-to-end.
one of 84 siblings
- BaseSolution entry · level 0 · unverified ·
746b1c49c2b69b79
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 7 bricks; individually on a fixture: 0 ran · 7 unverified. The assembly has not been run end-to-end.
one of 84 siblings
- DDPG entry · level 0 · unverified ·
9f83c78d8022ed75 - ActorNet model · level 0 · unverified ·
36fb14c831b75e4f - ActorNet_bn model · level 0 · unverified ·
883fbd58c181e487 - CriticNet model · level 0 · unverified ·
42be45cafdda9bc6 - CriticNet_bn helper · level 0 · unverified ·
2961cc94350daaae - grad_inverter helper · level 0 · unverified ·
ff560a45eef0d026 - batch_norm helper · level 0 · unverified ·
7484fd6def5722c7
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 2 bricks; individually on a fixture: 0 ran · 2 unverified. The assembly has not been run end-to-end.
one of 84 siblings
- ContinuousActorCritic entry · level 0 · unverified ·
53c5f2f2df73a0e0 - ActorCritic model · level 0 · unverified ·
26052e22d5d45a91
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 84 siblings
- DeepDeterministicPolicyGradient entry · level 0 · unverified ·
ff673a112b0d8acd - ReplayBuffer helper · level 1 · ran ·
3c7178cf937ba425
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 13 bricks; individually on a fixture: 10 ran (of which 8 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified. The assembly has not been run end-to-end.
one of 84 siblings
- RDPG entry · level 0 · unverified ·
66f422ab00f28663 - Agent helper · level 0 · unverified ·
f21df3758ed39418 - EpisodicMemory helper · level 1 · ran ·
07b241d4ab8ac0cb - Evaluator helper · level 1 · ran ·
ff0baff75d5cb615 - Actor model · level 0 · unverified ·
958765de0feeec56 - Critic model · level 1 · ran ·
060c46e5cc508cc5 - OrnsteinUhlenbeckProcess helper · level 1 · ran ·
37ebaf510f179bf4 - Memory helper · level 1 · ran ·
a5e014313403ae12 - RingBuffer helper · level 1 · ran ·
3f3476b061f68f18 - fanin_init helper · level 1 · ran; the contract check could not run (RAISES) ·
0d0842514b1844a1 - AnnealedGaussianProcess helper · level 1 · ran ·
3ad5029d3ca03531 - zeroed_observation helper · level 1 · ran · honoured contract ·
b5cc72675b688b00 - RandomProcess helper · level 1 · ran ·
ab1c58fa8208bfec
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 4 bricks; individually on a fixture: 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified. The assembly has not been run end-to-end.
one of 84 siblings
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 4 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 4 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 84 siblings
- DDPGAgent entry · level 1 · ran ·
037ce510df007080 - Critic model · level 1 · ran ·
4210d97aa24222d8 - OUNoise helper · level 1 · ran ·
e47034c4a39da307 - ReplayBuffer helper · level 1 · ran ·
1a3c5297309ff7b3
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 84 siblings
- DDPG entry · level 0 · unverified ·
ced83557bfb5a383 - ActorNetwork model · level 0 · unverified ·
18c75ab6a06581a4 - CriticNetwork model · level 0 · unverified ·
ebdd58004bdf82fd - OUNoise helper · level 1 · ran ·
85896c6b57d5891f - ReplayBuffer helper · level 1 · ran ·
cbd6d4cba3c8f7b0
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 12 bricks; individually on a fixture: 11 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified. The assembly has not been run end-to-end.
one of 84 siblings
- DDPG entry · level 0 · unverified ·
5145b262fcd6a876 - Actor model · level 1 · ran ·
fb986aef8cb19dcb - Critic model · level 1 · ran ·
f93619eb32cfaf3d - OrnsteinUhlenbeckProcess helper · level 1 · ran ·
37ebaf510f179bf4 - SequentialMemory helper · level 1 · ran ·
980051699184bfdd - fanin_init helper · level 1 · ran; the contract check could not run (RAISES) ·
0d0842514b1844a1 - AnnealedGaussianProcess helper · level 1 · ran ·
3ad5029d3ca03531 - Memory helper · level 1 · ran ·
a5e014313403ae12 - RingBuffer helper · level 1 · ran ·
a3c118a9e035f7e4 - sample_batch_indexes helper · level 1 · ran · honoured contract ·
6298e4cee53206cd - zeroed_observation helper · level 1 · ran · honoured contract ·
b5cc72675b688b00 - RandomProcess helper · level 1 · ran ·
ab1c58fa8208bfec
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 7 bricks; individually on a fixture: 0 ran · 7 unverified. The assembly has not been run end-to-end.
one of 84 siblings
- DDPG entry · level 0 · unverified ·
a6abf3bfff439ec4 - ActorNet model · level 0 · unverified ·
0d7cb0b9cab3eb74 - ActorNet_bn model · level 0 · unverified ·
883fbd58c181e487 - CriticNet model · level 0 · unverified ·
b616451b9c41d0be - CriticNet_bn helper · level 0 · unverified ·
2961cc94350daaae - grad_inverter helper · level 0 · unverified ·
88db7be53206704c - batch_norm helper · level 0 · unverified ·
7484fd6def5722c7
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 84 siblings
- train entry · level 0 · unverified ·
7f073c276baecc11 - ReplayBuffer sampler · level 1 · ran ·
532a74ad7f880104
harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 2 bricks; individually on a fixture: 0 ran · 2 unverified. The assembly has not been run end-to-end.
one of 84 siblings
- Agent entry · level 0 · unverified ·
40c191818d46c0c5 - normal_dist sampler · level 0 · unverified ·
54074d019aff0495
- DDPG · 2c8427e0e63a41d1 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[12] in the JSON twin
- Ddpg · 2f139426e32a47a5 · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[13] in the JSON twin
- MADDPG_Agent · 3744f25c31de7afe · 3 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[14] in the JSON twin
- Agent · 3dee32cadc45408f · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[15] in the JSON twin
- DDPG · 3e06a8c7ab5e471e · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[16] in the JSON twin
- DDPG · 3f652ce5d4326917 · 7 bricks; individually on a fixture: 0 ran · 7 unverified · The assembly has not been run end-to-end · assemblies[17] in the JSON twin
- DDPG · 3f776ca0f59565ee · 12 bricks; individually on a fixture: 11 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[18] in the JSON twin
- DDPGAgent · 4324d10d32827a86 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[19] in the JSON twin
- DDPG · 4846ad338fbde244 · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[20] in the JSON twin
- run_ddpg · 4b601e5f92f24f81 · 10 bricks; individually on a fixture: 6 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[21] in the JSON twin
- Agent · 4d632ac3c373957c · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[22] in the JSON twin
- NAF · 52dbca10bd4dd1b5 · 7 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[23] in the JSON twin
- AC_Off_POC_DDPG · 56e4aae9562efa8c · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[24] in the JSON twin
- DDPG · 5858e61727190ae7 · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[25] in the JSON twin
- DDPG · 5a98dbf6b7df4dab · 2 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[26] in the JSON twin
- Agent · 5df767b245e70484 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[27] in the JSON twin
- DDPGAgent · 619824e8214c2b89 · 4 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[28] in the JSON twin
- DDPG · 6a36d557787ed8fb · 5 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[29] in the JSON twin
- DDPG · 6a4d238888f8f3fa · 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[30] in the JSON twin
- Agent · 6c13343efa1f8ffd · 7 bricks; individually on a fixture: 7 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[31] in the JSON twin
- Actor · 7467f26bf299b48f · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[32] in the JSON twin
- DDPG · 75b425e7455741dc · 3 bricks; individually on a fixture: 0 ran · 3 unverified · The assembly has not been run end-to-end · assemblies[33] in the JSON twin
- DDPG · 773437a2fdc4169a · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[34] in the JSON twin
- ActorCriticNetworkContinuous · 782c1a473cb79310 · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[35] in the JSON twin
- Agent · 7a29d8f92c8e0151 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[36] in the JSON twin
- DDPG · 7c28372ca99ab535 · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[37] in the JSON twin
- ddpg_trainer · 7db9923735b49314 · 11 bricks; individually on a fixture: 9 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[38] in the JSON twin
- DDPG · 7dc40ea6e071b1ad · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[39] in the JSON twin
- Agent · 7f99fd231fb9ce40 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[40] in the JSON twin
- Agent · 825277bfb421a534 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[41] in the JSON twin
- Agents · 829120e2e772e992 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[42] in the JSON twin
- DDPG · 83325fcb0085d203 · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[43] in the JSON twin
- SAC · 83fe5afc7604b5ca · 15 bricks; individually on a fixture: 11 ran (of which 8 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[44] in the JSON twin
- MLPActor · 86052d13d9afa404 · 2 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[45] in the JSON twin
- policy · 86d8f385621f0bce · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[46] in the JSON twin
- Actor · 935f276f542f0be0 · 2 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[47] in the JSON twin
- ActorCriticDeterministic · 94002b2f6ce6ae77 · 3 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[48] in the JSON twin
- DDPGAgent · 94194bb75c843d8f · 5 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[49] in the JSON twin
- Agent · 99316fac409eb89b · 5 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[50] in the JSON twin
- DDPGController · 9aace1eddd6d2474 · 4 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[51] in the JSON twin
- Actor · 9d08d08e65db0120 · 2 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[52] in the JSON twin
- DDPG · 9d9628b94754b8fb · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[53] in the JSON twin
- Agent · 9fb996564f47be5d · 5 bricks; individually on a fixture: 5 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 5 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[54] in the JSON twin
- DDPGAgent · a4abcc678a41282d · 3 bricks; individually on a fixture: 0 ran · 3 unverified · The assembly has not been run end-to-end · assemblies[55] in the JSON twin
- DDPG · a6b0c01430274b83 · 5 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[56] in the JSON twin
- ContinuousDeepQ · a7eb3fe8dadcce7f · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[57] in the JSON twin
- DDPG_Agent · ab3d4becf5043afe · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[58] in the JSON twin
- Actor · ad26f00e02136613 · 2 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[59] in the JSON twin
- Agent · b15fe936990cb2cb · 4 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[60] in the JSON twin
- DDPGAgent · b1c6a909072dc8f5 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[61] in the JSON twin
- DDPG · b258d6ccfb363b8e · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[62] in the JSON twin
- DDPG · b297b68b54988f2b · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[63] in the JSON twin
- DDPGAgent · b5827c6082d2d907 · 5 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[64] in the JSON twin
- DDPG_agent · b65359aff4f7ea73 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[65] in the JSON twin
- ActorNetwork · baa02ded8155d9e6 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[66] in the JSON twin
- DDPG · bbd849fd1c40fc30 · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[67] in the JSON twin
- DDPG · bf6e355f91e80d55 · 8 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[68] in the JSON twin
- Agent · c051f003e5e54ca9 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[69] in the JSON twin
- Brain · c46e5f0ceb121cf3 · 5 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[70] in the JSON twin
- DDPG · cd3c0f24c5b6f2ee · 8 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[71] in the JSON twin
- DDPG · cfad4b4472ed9dcb · 4 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[72] in the JSON twin
- DDPG · d68837aaed5c6dca · 5 bricks; individually on a fixture: 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[73] in the JSON twin
- DDPG · d72a8e9b303a30cb · 2 bricks; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[74] in the JSON twin
- DDPG · d75ebed945db5b3a · 6 bricks; individually on a fixture: 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[75] in the JSON twin
- DDPG_model · df8ea20614f74358 · 3 bricks; individually on a fixture: 0 ran · 3 unverified · The assembly has not been run end-to-end · assemblies[76] in the JSON twin
- Actor · e05dd8378b51e5ad · 2 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[77] in the JSON twin
- DDPG · e0db7cd24aba773c · 3 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[78] in the JSON twin
- ActorNetwork · e2985836f7078e60 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[79] in the JSON twin
- Actor · e9a07a0089b67d54 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[80] in the JSON twin
- DDPG · ebc550f5cc7160fb · 4 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[81] in the JSON twin
- SACModel · f0c588b70084933d · 10 bricks; individually on a fixture: 0 ran · 10 unverified · The assembly has not been run end-to-end · assemblies[82] in the JSON twin
- DDPG · f397dc4ab99713eb · 3 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[83] in the JSON twin
Each brick ends with its code_sha256, Syntology's identity for that exact code; click one to copy the get_code call that returns it. For agents, on Syntology's MCP service: assembly(arxiv_id="1509.02971") returns these assemblies with each brick's role and wiring (how to connect).
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Continuous Control | Lunar Lander (OpenAI Gym) | DDPG | Score | 256.98±14.38 | #3 of 5 | Archive leaderboard | report |
| OpenAI Gym | Ant-v4 | DDPG | Average Return | 1712.12 | #4 of 5 | Archive leaderboard | report |
| OpenAI Gym | HalfCheetah-v4 | DDPG | Average Return | 14934.86 | #2 of 5 | Archive leaderboard | report |
| OpenAI Gym | Hopper-v4 | DDPG | Average Return | 1290.24 | #4 of 5 | Archive leaderboard | report |
| OpenAI Gym | Humanoid-v4 | DDPG | Average Return | 139.14 | #5 of 5 | Archive leaderboard | report |
| OpenAI Gym | Walker2d-v4 | DDPG | Average Return | 2994.54 | #3 of 5 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Introduced by this paper: DDPG
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections