Papers › Playing Atari with Deep Reinforcement Learning
Playing Atari with Deep Reinforcement Learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller
We present the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is a convolutional neural network, trained with a variant of Q-learning, whose input is raw pixels and whose output is a value function estimating future rewards. We apply our method to seven Atari 2600 games from the Arcade Learning Environment, with no adjustment of the architecture or learning algorithm. We find that it outperforms all previous approaches on six of the games and surpasses a human expert on three of them.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1312.5602")
Code
Syntology Ran 56 of 117 code samples harvested from 50 repositories linked to this paper; 61 have no recorded run. Of those that ran: 5 ran · honoured contract; 16 ran · our draft was wrong; 2 ran · fixture could not drive it; 33 ran with no contract checked.
By repository: community (archive-listed): 117 samples from 50 repositories, 56 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.
112 repositories listed; official and paper-mentioned ones first.
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
117 samples harvested; 56 ran; 5 honoured the contract we drafted; 61 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.
Licence: 56 of the 117 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.
Harvested from 50 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.
Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.
Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.
69b2f2e5a6967e4c · report
8da78c4bfe306c3e · report
81c2538f25d49bf5 · report
9c1d06fe674d019d · report
a54a3b810f63e7d1 · report
cc31fb79a4c9cfad · report
e65d2c13d9aa7641 · report
51cf7eff17d1081c · report
7ac5ee56c6e889b6 · report
c7a2e9b74e4de596 · report
9dc82f090fea3bda · report
73b097a72c5ea2f5 · report
f67fec3bfe6045aa · report
8eceb653c628a651 · report
f9118b06dae7f603 · report
96164b4731db1134 · report
373f5c8eb72337f4 · report
ddd25e3de70197a2 · report
400c752a0d8d06f7 · report
6734b023c48264d1 · report
7af2befd6fd71b28 · report
2e7175149cc42e4e · report
0387692d5cb08179 · report
c448520babac98f1 · report
93b98bd6ec8a54eb · report
e2d32d93aef8dd96 · report
391471b2e6f9888c · report
770e704a180ff720 · report
cb2515fde4e1a0e0 · report
3298a4358c400287 · report
54e74edb75cc6f83 · report
a1061c9f352373b7 · report
18e2a7b2917f4571 · report
bff3b19f646bee04 · report
dca827af2639f99d · report
d09a6a1f1807cb36 · report
9c004a3c7f80a048 · report
6ec20a43d727c364 · report
58a16fa9e75bc087 · report
b93a2d0046d7cf64 · report
391c3adc43a9fb2d · report
143311d10e7d046c · report
e57b423feb455f31 · report
436e0ec3f2b87eea · report
eaf9a525f0459416 · report
802a4fa23e5c7036 · report
ac7dc76edd237aa9 · report
1afb1d67cec9b38b · report
634d6466b3771df7 · report
08037869b6206d12 · report
14bcfdbb8473e4b3 · report
67e350096b3030fb · report
8f8fae04132f94eb · report
e97f3b4aab9510ab · report
d613b8ca99bc2295 · report
1f72577dd8ccaa95 · report
26d04828131d058e · report
623be0021af9cc32 · report
9097edcc955ed803 · report
d16973e80e747353 · report
ed92e17b3aae8048 · report
986b511bd19889fc · report
39be9974e39c4007 · report
c1adecea275c4a2d · report
c9bddbe2aee30eac · report
7a2a672d94b88c2c · report
5114ef5f140eab1f · report
01a1660b174e9811 · report
b80d6818598d15d7 · report
f09be9cc319f8b95 · report
1e1c270d61b7ea4b · report
e7dc84f99d692574 · report
77ebfb9f870755e5 · report
82c4ff3ff8f63e05 · report
13f78b113956d77f · report
15169eebbda3dcc8 · report
0f47d6422b2c5369 · report
85acd99c58ce6d0c · report
dc3336e8f1fdf44a · report
e53b0eb94184ff85 · report
ee0b2a23c9478bfc · report
30e46a646e08a7d8 · report
0e08e7a4d7c5d8b2 · report
42f3816a2d486c1a · report
7f1cd947395254b0 · report
92a00d39074b7d60 · report
58ded9af82892cc0 · report
89b4b37f6d5d8c72 · report
d78e88b5a6d2c2b1 · report
6f34cfb42a2fac86 · report
7a20c93d8aa9f48b · report
d2c233a4e64933cb · report
e444b6d743c4c506 · report
21077a0a5bf80f4e · report
4d830cd514f6cb32 · report
4577713d4b86ef2b · report
8e415301ac3c74a1 · report
4f7455bb7e545246 · report
8d6b5d3084a9d52f · report
8852f55a6471cb78 · report
11c5727aaabe378a · report
77ef8402d44c461b · report
4519c6fdfa92a307 · report
1e29c6e3df986421 · report
3f487113acd567b9 · report
eecf538e06851adc · report
8f9da127eceb2a1d · report
a8cd6ded600d9813 · report
215e80576955e5a8 · report
3d3d55b5d8bd5963 · report
57c6b35d80e952e1 · report
5448b18f64386fdb · report
316b3c2ef7ed0d5e · report
8987d3556f2dbdbe · report
00500c0bcb8ead09 · report
df21990110979f81 · report
284562b888d37de3 · report
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Atari Games | Atari 2600 Beam Rider | DQN Best | Score | 5184 | #40 of 49 | Archive leaderboard | report |
| Atari Games | Atari 2600 Breakout | DQN Best | Score | 225 | #46 of 58 | Archive leaderboard | report |
| Atari Games | Atari 2600 Enduro | DQN Best | Score | 661 | #33 of 48 | Archive leaderboard | report |
| Atari Games | Atari 2600 Pong | DQN Best | Score | 21 | #7 of 52 | Archive leaderboard | report |
| Atari Games | Atari 2600 Q*Bert | DQN Best | Score | 4500 | #44 of 57 | Archive leaderboard | report |
| Atari Games | Atari 2600 Seaquest | DQN Best | Score | 1740 | #42 of 57 | Archive leaderboard | report |
| Atari Games | Atari 2600 Space Invaders | DQN Best | Score | 1075 | #45 of 55 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Introduced by this paper: DQN
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections