{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/increasing-the-action-gap-new-operators-for","title":"Increasing the Action Gap: New Operators for Reinforcement Learning","arxiv_id":"1512.04860","date":"2015-12-15","proceeding":null,"authors":["Marc G. Bellemare","Georg Ostrovski","Arthur Guez","Philip S. Thomas","Rémi Munos"],"abstract":"This paper introduces new optimality-preserving operators on Q-functions. We\nfirst describe an operator for tabular representations, the consistent Bellman\noperator, which incorporates a notion of local policy consistency. We show that\nthis local consistency leads to an increase in the action gap at each state;\nincreasing this gap, we argue, mitigates the undesirable effects of\napproximation and estimation errors on the induced greedy policies. This\noperator can also be applied to discretized continuous space and time problems,\nand we provide empirical results evidencing superior performance in this\ncontext. Extending the idea of a locally consistent operator, we then derive\nsufficient conditions for an operator to preserve optimality, leading to a\nfamily of operators which includes our consistent Bellman operator. As\ncorollaries we provide a proof of optimality for Baird's advantage learning\nalgorithm and derive other gap-increasing operators with interesting\nproperties. We conclude with an empirical study on 60 Atari 2600 games\nillustrating the strong potential of these new operators.","url_abs":"http://arxiv.org/abs/1512.04860v1","url_pdf":"http://arxiv.org/pdf/1512.04860v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"increasing-the-action-gap-new-operators-for","repo_url":"https://github.com/chainer/chainerrl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"increasing-the-action-gap-new-operators-for","repo_url":"https://github.com/janhuenermann/neurojs","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"atari-games","task_name":"Atari Games"},{"task_slug":"q-learning","task_name":"Q-Learning"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/atari-games-on-atari-2600-alien","task":"Atari Games","dataset":"Atari 2600 Alien","model":"Persistent AL","rank_in_archive_order":16,"of":49,"metrics":{"Score":"5699.81"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-alien","task":"Atari Games","dataset":"Atari 2600 Alien","model":"Advantage Learning","rank_in_archive_order":18,"of":49,"metrics":{"Score":"4990.91"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-amidar","task":"Atari Games","dataset":"Atari 2600 Amidar","model":"Advantage Learning","rank_in_archive_order":16,"of":48,"metrics":{"Score":"1557.43"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-amidar","task":"Atari Games","dataset":"Atari 2600 Amidar","model":"Persistent AL","rank_in_archive_order":18,"of":48,"metrics":{"Score":"1451.65"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-assault","task":"Atari Games","dataset":"Atari 2600 Assault","model":"Advantage Learning","rank_in_archive_order":33,"of":45,"metrics":{"Score":"3661.51"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-assault","task":"Atari Games","dataset":"Atari 2600 Assault","model":"Persistent AL","rank_in_archive_order":36,"of":45,"metrics":{"Score":"3304.33"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-asterix","task":"Atari Games","dataset":"Atari 2600 Asterix","model":"Persistent AL","rank_in_archive_order":28,"of":49,"metrics":{"Score":"19564.9"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-asterix","task":"Atari Games","dataset":"Atari 2600 Asterix","model":"Advantage Learning","rank_in_archive_order":36,"of":49,"metrics":{"Score":"12852.08"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-asteroids","task":"Atari Games","dataset":"Atari 2600 Asteroids","model":"Advantage Learning","rank_in_archive_order":28,"of":43,"metrics":{"Score":"1924.42"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-asteroids","task":"Atari Games","dataset":"Atari 2600 Asteroids","model":"Persistent AL","rank_in_archive_order":30,"of":43,"metrics":{"Score":"1673.52"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-atlantis","task":"Atari Games","dataset":"Atari 2600 Atlantis","model":"Persistent AL","rank_in_archive_order":8,"of":42,"metrics":{"Score":"1465250"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-atlantis","task":"Atari Games","dataset":"Atari 2600 Atlantis","model":"Advantage Learning","rank_in_archive_order":25,"of":42,"metrics":{"Score":"553591.67"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-bank-heist","task":"Atari Games","dataset":"Atari 2600 Bank Heist","model":"Persistent AL","rank_in_archive_order":32,"of":45,"metrics":{"Score":"874.99"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-bank-heist","task":"Atari Games","dataset":"Atari 2600 Bank Heist","model":"Advantage Learning","rank_in_archive_order":33,"of":45,"metrics":{"Score":"633.63"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-battle-zone","task":"Atari Games","dataset":"Atari 2600 Battle Zone","model":"Persistent AL","rank_in_archive_order":20,"of":47,"metrics":{"Score":"34583.07"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-battle-zone","task":"Atari Games","dataset":"Atari 2600 Battle Zone","model":"Advantage Learning","rank_in_archive_order":27,"of":47,"metrics":{"Score":"28789.29"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-beam-rider","task":"Atari Games","dataset":"Atari 2600 Beam Rider","model":"Persistent AL","rank_in_archive_order":29,"of":49,"metrics":{"Score":"13145.34"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-beam-rider","task":"Atari Games","dataset":"Atari 2600 Beam Rider","model":"Advantage Learning","rank_in_archive_order":32,"of":49,"metrics":{"Score":"10054.58"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-berzerk","task":"Atari Games","dataset":"Atari 2600 Berzerk","model":"Persistent AL","rank_in_archive_order":22,"of":39,"metrics":{"Score":"1328.25"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-berzerk","task":"Atari Games","dataset":"Atari 2600 Berzerk","model":"Advantage Learning","rank_in_archive_order":34,"of":39,"metrics":{"Score":"747.26"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-bowling","task":"Atari Games","dataset":"Atari 2600 Bowling","model":"Persistent AL","rank_in_archive_order":18,"of":44,"metrics":{"Score":"71.59"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-bowling","task":"Atari Games","dataset":"Atari 2600 Bowling","model":"Advantage Learning","rank_in_archive_order":26,"of":44,"metrics":{"Score":"57.41"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-boxing","task":"Atari Games","dataset":"Atari 2600 Boxing","model":"Persistent AL","rank_in_archive_order":25,"of":45,"metrics":{"Score":"94.3"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-boxing","task":"Atari Games","dataset":"Atari 2600 Boxing","model":"Advantage Learning","rank_in_archive_order":26,"of":45,"metrics":{"Score":"93.94"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-breakout","task":"Atari Games","dataset":"Atari 2600 Breakout","model":"Persistent AL","rank_in_archive_order":23,"of":58,"metrics":{"Score":"431.89"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-breakout","task":"Atari Games","dataset":"Atari 2600 Breakout","model":"Advantage Learning","rank_in_archive_order":24,"of":58,"metrics":{"Score":"425.32"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-centipede","task":"Atari Games","dataset":"Atari 2600 Centipede","model":"Persistent AL","rank_in_archive_order":34,"of":45,"metrics":{"Score":"4539.55"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-centipede","task":"Atari Games","dataset":"Atari 2600 Centipede","model":"Advantage Learning","rank_in_archive_order":36,"of":45,"metrics":{"Score":"4225.18"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-chopper-command","task":"Atari Games","dataset":"Atari 2600 Chopper Command","model":"Persistent AL","rank_in_archive_order":30,"of":45,"metrics":{"Score":"5734.93"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-chopper-command","task":"Atari Games","dataset":"Atari 2600 Chopper Command","model":"Advantage Learning","rank_in_archive_order":31,"of":45,"metrics":{"Score":"5431.36"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-crazy-climber","task":"Atari Games","dataset":"Atari 2600 Crazy Climber","model":"Persistent AL","rank_in_archive_order":25,"of":49,"metrics":{"Score":"130002.71"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-crazy-climber","task":"Atari Games","dataset":"Atari 2600 Crazy Climber","model":"Advantage Learning","rank_in_archive_order":29,"of":49,"metrics":{"Score":"123410.71"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-defender","task":"Atari Games","dataset":"Atari 2600 Defender","model":"Persistent AL","rank_in_archive_order":20,"of":21,"metrics":{"Score":"32038.93"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-defender","task":"Atari Games","dataset":"Atari 2600 Defender","model":"Advantage Learning","rank_in_archive_order":21,"of":21,"metrics":{"Score":"30643.59"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-demon-attack","task":"Atari Games","dataset":"Atari 2600 Demon Attack","model":"Persistent AL","rank_in_archive_order":25,"of":46,"metrics":{"Score":"70908.17"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-demon-attack","task":"Atari Games","dataset":"Atari 2600 Demon Attack","model":"Advantage Learning","rank_in_archive_order":35,"of":46,"metrics":{"Score":"27153.48"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-double-dunk","task":"Atari Games","dataset":"Atari 2600 Double Dunk","model":"Advantage Learning","rank_in_archive_order":39,"of":43,"metrics":{"Score":"-0.15"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-double-dunk","task":"Atari Games","dataset":"Atari 2600 Double Dunk","model":"Persistent AL","rank_in_archive_order":40,"of":43,"metrics":{"Score":"-2.51"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-elevator-action","task":"Atari Games","dataset":"Atari 2600 Elevator Action","model":"Persistent AL","rank_in_archive_order":1,"of":3,"metrics":{"Score":"29100"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-elevator-action","task":"Atari Games","dataset":"Atari 2600 Elevator Action","model":"Advantage Learning","rank_in_archive_order":2,"of":3,"metrics":{"Score":"27088.89"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-enduro","task":"Atari Games","dataset":"Atari 2600 Enduro","model":"Persistent AL","rank_in_archive_order":25,"of":48,"metrics":{"Score":"1343.1"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-enduro","task":"Atari Games","dataset":"Atari 2600 Enduro","model":"Advantage Learning","rank_in_archive_order":26,"of":48,"metrics":{"Score":"1252.7"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-fishing-derby","task":"Atari Games","dataset":"Atari 2600 Fishing Derby","model":"Persistent AL","rank_in_archive_order":24,"of":44,"metrics":{"Score":"28.13"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-fishing-derby","task":"Atari Games","dataset":"Atari 2600 Fishing Derby","model":"Advantage Learning","rank_in_archive_order":27,"of":44,"metrics":{"Score":"21.32"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-freeway","task":"Atari Games","dataset":"Atari 2600 Freeway","model":"Persistent AL","rank_in_archive_order":26,"of":59,"metrics":{"Score":"32.3"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-freeway","task":"Atari Games","dataset":"Atari 2600 Freeway","model":"Advantage Learning","rank_in_archive_order":28,"of":59,"metrics":{"Score":"31.72"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-frostbite","task":"Atari Games","dataset":"Atari 2600 Frostbite","model":"Persistent AL","rank_in_archive_order":25,"of":53,"metrics":{"Score":"3248.96"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-frostbite","task":"Atari Games","dataset":"Atari 2600 Frostbite","model":"Advantage Learning","rank_in_archive_order":30,"of":53,"metrics":{"Score":"2305.82"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-gopher","task":"Atari Games","dataset":"Atari 2600 Gopher","model":"Advantage Learning","rank_in_archive_order":29,"of":43,"metrics":{"Score":"11912.68"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-gopher","task":"Atari Games","dataset":"Atari 2600 Gopher","model":"Persistent AL","rank_in_archive_order":30,"of":43,"metrics":{"Score":"10611.81"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-gravitar","task":"Atari Games","dataset":"Atari 2600 Gravitar","model":"Persistent AL","rank_in_archive_order":34,"of":53,"metrics":{"Score":"446.92"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-gravitar","task":"Atari Games","dataset":"Atari 2600 Gravitar","model":"Advantage Learning","rank_in_archive_order":37,"of":53,"metrics":{"Score":"417.65"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-hero","task":"Atari Games","dataset":"Atari 2600 HERO","model":"Advantage Learning","rank_in_archive_order":20,"of":44,"metrics":{"Score":"24788.86"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-hero","task":"Atari Games","dataset":"Atari 2600 HERO","model":"Persistent AL","rank_in_archive_order":21,"of":44,"metrics":{"Score":"24175.79"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-ice-hockey","task":"Atari Games","dataset":"Atari 2600 Ice Hockey","model":"Persistent AL","rank_in_archive_order":37,"of":43,"metrics":{"Score":"-0.25"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-ice-hockey","task":"Atari Games","dataset":"Atari 2600 Ice Hockey","model":"Advantage Learning","rank_in_archive_order":38,"of":43,"metrics":{"Score":"-1.24"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-james-bond","task":"Atari Games","dataset":"Atari 2600 James Bond","model":"Advantage Learning","rank_in_archive_order":24,"of":45,"metrics":{"Score":"848.46"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-james-bond","task":"Atari Games","dataset":"Atari 2600 James Bond","model":"Persistent AL","rank_in_archive_order":27,"of":45,"metrics":{"Score":"772.09"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-kangaroo","task":"Atari Games","dataset":"Atari 2600 Kangaroo","model":"Persistent AL","rank_in_archive_order":21,"of":47,"metrics":{"Score":"11478.46"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-kangaroo","task":"Atari Games","dataset":"Atari 2600 Kangaroo","model":"Advantage Learning","rank_in_archive_order":24,"of":47,"metrics":{"Score":"10809.16"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-krull","task":"Atari Games","dataset":"Atari 2600 Krull","model":"Advantage Learning","rank_in_archive_order":22,"of":45,"metrics":{"Score":"9548.92"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-krull","task":"Atari Games","dataset":"Atari 2600 Krull","model":"Persistent AL","rank_in_archive_order":24,"of":45,"metrics":{"Score":"8689.81"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-kung-fu-master","task":"Atari Games","dataset":"Atari 2600 Kung-Fu Master","model":"Persistent AL","rank_in_archive_order":25,"of":43,"metrics":{"Score":"34650.91"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-kung-fu-master","task":"Atari Games","dataset":"Atari 2600 Kung-Fu Master","model":"Advantage Learning","rank_in_archive_order":30,"of":43,"metrics":{"Score":"32182.99"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-montezumas-revenge","task":"Atari Games","dataset":"Atari 2600 Montezuma's Revenge","model":"Persistent AL","rank_in_archive_order":40,"of":50,"metrics":{"Score":"1.72"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-montezumas-revenge","task":"Atari Games","dataset":"Atari 2600 Montezuma's Revenge","model":"Advantage Learning","rank_in_archive_order":41,"of":50,"metrics":{"Score":"0.42"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-ms-pacman","task":"Atari Games","dataset":"Atari 2600 Ms. Pacman","model":"Advantage Learning","rank_in_archive_order":22,"of":47,"metrics":{"Score":"4065.8"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-ms-pacman","task":"Atari Games","dataset":"Atari 2600 Ms. Pacman","model":"Persistent AL","rank_in_archive_order":24,"of":47,"metrics":{"Score":"3917.55"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-name-this-game","task":"Atari Games","dataset":"Atari 2600 Name This Game","model":"Advantage Learning","rank_in_archive_order":27,"of":43,"metrics":{"Score":"11025.26"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-name-this-game","task":"Atari Games","dataset":"Atari 2600 Name This Game","model":"Persistent AL","rank_in_archive_order":31,"of":43,"metrics":{"Score":"10431.33"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-phoenix","task":"Atari Games","dataset":"Atari 2600 Phoenix","model":"Advantage Learning","rank_in_archive_order":16,"of":21,"metrics":{"Score":"22038.27"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-phoenix","task":"Atari Games","dataset":"Atari 2600 Phoenix","model":"Persistent AL","rank_in_archive_order":18,"of":21,"metrics":{"Score":"14495.56"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-pitfall","task":"Atari Games","dataset":"Atari 2600 Pitfall!","model":"Advantage Learning","rank_in_archive_order":10,"of":23,"metrics":{"Score":"0"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-pong","task":"Atari Games","dataset":"Atari 2600 Pong","model":"Persistent AL","rank_in_archive_order":31,"of":52,"metrics":{"Score":"19.76"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-pong","task":"Atari Games","dataset":"Atari 2600 Pong","model":"Advantage Learning","rank_in_archive_order":33,"of":52,"metrics":{"Score":"19.66"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-pooyan","task":"Atari Games","dataset":"Atari 2600 Pooyan","model":"Advantage Learning","rank_in_archive_order":2,"of":3,"metrics":{"Score":"4801.27"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-private-eye","task":"Atari Games","dataset":"Atari 2600 Private Eye","model":"Advantage Learning","rank_in_archive_order":14,"of":52,"metrics":{"Score":"5276.16"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-qbert","task":"Atari Games","dataset":"Atari 2600 Q*Bert","model":"Advantage Learning","rank_in_archive_order":31,"of":57,"metrics":{"Score":"14368.03"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-river-raid","task":"Atari Games","dataset":"Atari 2600 River Raid","model":"Advantage Learning","rank_in_archive_order":28,"of":41,"metrics":{"Score":"10585.12"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-road-runner","task":"Atari Games","dataset":"Atari 2600 Road Runner","model":"Advantage Learning","rank_in_archive_order":24,"of":44,"metrics":{"Score":"52351.23"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-robotank","task":"Atari Games","dataset":"Atari 2600 Robotank","model":"Advantage Learning","rank_in_archive_order":11,"of":42,"metrics":{"Score":"69.31"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-seaquest","task":"Atari Games","dataset":"Atari 2600 Seaquest","model":"Persistent AL","rank_in_archive_order":20,"of":57,"metrics":{"Score":"13230.74"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-seaquest","task":"Atari Games","dataset":"Atari 2600 Seaquest","model":"Advantage Learning","rank_in_archive_order":24,"of":57,"metrics":{"Score":"8670.5"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-skiing","task":"Atari Games","dataset":"Atari 2600 Skiing","model":"Advantage Learning","rank_in_archive_order":12,"of":23,"metrics":{"Score":"-13264.51"},"uses_additional_data":true},{"leaderboard":"/sota/atari-games-on-atari-2600-solaris","task":"Atari Games","dataset":"Atari 2600 Solaris","model":"Advantage Learning","rank_in_archive_order":14,"of":23,"metrics":{"Score":"4785.16"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-space-invaders","task":"Atari Games","dataset":"Atari 2600 Space Invaders","model":"Advantage Learning","rank_in_archive_order":25,"of":55,"metrics":{"Score":"3460.79"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-space-invaders","task":"Atari Games","dataset":"Atari 2600 Space Invaders","model":"Persistent AL","rank_in_archive_order":26,"of":55,"metrics":{"Score":"3277.59"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-star-gunner","task":"Atari Games","dataset":"Atari 2600 Star Gunner","model":"Advantage Learning","rank_in_archive_order":26,"of":43,"metrics":{"Score":"61353.59"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-surround","task":"Atari Games","dataset":"Atari 2600 Surround","model":"Persistent AL","rank_in_archive_order":13,"of":15,"metrics":{"Score":"0.72"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-tennis","task":"Atari Games","dataset":"Atari 2600 Tennis","model":"Advantage Learning","rank_in_archive_order":27,"of":43,"metrics":{"Score":"0"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-time-pilot","task":"Atari Games","dataset":"Atari 2600 Time Pilot","model":"Advantage Learning","rank_in_archive_order":26,"of":44,"metrics":{"Score":"8969.12"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-tutankham","task":"Atari Games","dataset":"Atari 2600 Tutankham","model":"Advantage Learning","rank_in_archive_order":18,"of":44,"metrics":{"Score":"245.22"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-up-and-down","task":"Atari Games","dataset":"Atari 2600 Up and Down","model":"Advantage Learning","rank_in_archive_order":35,"of":44,"metrics":{"Score":"13909.74"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-venture","task":"Atari Games","dataset":"Atari 2600 Venture","model":"Advantage Learning","rank_in_archive_order":29,"of":55,"metrics":{"Score":"198.69"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-video-pinball","task":"Atari Games","dataset":"Atari 2600 Video Pinball","model":"Advantage Learning","rank_in_archive_order":15,"of":42,"metrics":{"Score":"543504"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-wizard-of-wor","task":"Atari Games","dataset":"Atari 2600 Wizard of Wor","model":"Advantage Learning","rank_in_archive_order":20,"of":41,"metrics":{"Score":"9541.14"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-yars-revenge","task":"Atari Games","dataset":"Atari 2600 Yars Revenge","model":"Advantage Learning","rank_in_archive_order":17,"of":17,"metrics":{"Score":"24240.03"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-zaxxon","task":"Atari Games","dataset":"Atari 2600 Zaxxon","model":"Advantage Learning","rank_in_archive_order":31,"of":41,"metrics":{"Score":"9129.61"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1512.04860","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}