{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-game-theoretic-analysis-of-networked-system","title":"A game-theoretic analysis of networked system control for common-pool resource management using multi-agent reinforcement learning","arxiv_id":"2010.07777","date":"2020-10-15","proceeding":"NeurIPS 2020 12","authors":["Arnu Pretorius","Scott Cameron","Elan van Biljon","Tom Makkink","Shahil Mawjee","Jeremy du Plessis","Jonathan Shock","Alexandre Laterre","Karim Beguir"],"abstract":"Multi-agent reinforcement learning has recently shown great promise as an approach to networked system control. Arguably, one of the most difficult and important tasks for which large scale networked system control is applicable is common-pool resource management. Crucial common-pool resources include arable land, fresh water, wetlands, wildlife, fish stock, forests and the atmosphere, of which proper management is related to some of society's greatest challenges such as food security, inequality and climate change. Here we take inspiration from a recent research program investigating the game-theoretic incentives of humans in social dilemma situations such as the well-known tragedy of the commons. However, instead of focusing on biologically evolved human-like agents, our concern is rather to better understand the learning and operating behaviour of engineered networked systems comprising general-purpose reinforcement learning agents, subject only to nonbiological constraints such as memory, computation and communication bandwidth. Harnessing tools from empirical game-theoretic analysis, we analyse the differences in resulting solution concepts that stem from employing different information structures in the design of networked multi-agent systems. These information structures pertain to the type of information shared between agents as well as the employed communication protocol and network topology. Our analysis contributes new insights into the consequences associated with certain design choices and provides an additional dimension of comparison between systems beyond efficiency, robustness, scalability and mean control performance.","url_abs":"https://arxiv.org/abs/2010.07777v1","url_pdf":"https://arxiv.org/pdf/2010.07777v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-game-theoretic-analysis-of-networked-system","repo_url":"https://github.com/instadeepai/EGTA-NMARL","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"management","task_name":"Management"},{"task_slug":"multi-agent-reinforcement-learning","task_name":"Multi-agent Reinforcement Learning"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2010.07777","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.07777"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/instadeepai/EGTA-NMARL","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"unverified":14},"by_repo_kind":{"official":{"samples":15,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6583a667fee3e221","entry":"ortho_init","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/agents/utils.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/agents/utils.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6583a667fee3e221"}},{"code_sha256_prefix":"286a6ee6f1c18b25","entry":"Equality","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/experiments/evaluation_metrics.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/experiments/evaluation_metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"286a6ee6f1c18b25"}},{"code_sha256_prefix":"2a7651747e8463f0","entry":"Utilitarian","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/experiments/evaluation_metrics.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/experiments/evaluation_metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a7651747e8463f0"}},{"code_sha256_prefix":"4452545364e90dfc","entry":"calculate_condition_3","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/experiments/plot_schelling_diagram.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/experiments/plot_schelling_diagram.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4452545364e90dfc"}},{"code_sha256_prefix":"dd717e5c4ccf4c7b","entry":"calculate_global_xlim_and_ylim","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/experiments/plot_schelling_diagram.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/experiments/plot_schelling_diagram.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dd717e5c4ccf4c7b"}},{"code_sha256_prefix":"a774e08f7631887e","entry":"check_dir","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/utils.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a774e08f7631887e"}},{"code_sha256_prefix":"3d1a6d68723115b4","entry":"conv","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/agents/utils.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/agents/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3d1a6d68723115b4"}},{"code_sha256_prefix":"7c300262e2261af2","entry":"find_file","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/utils.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7c300262e2261af2"}},{"code_sha256_prefix":"0160b7b5a9ca4259","entry":"get_total_returns","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/experiments/evaluation_metrics.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/experiments/evaluation_metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0160b7b5a9ca4259"}},{"code_sha256_prefix":"07e87df9a478ba23","entry":"init_dir","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/utils.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"07e87df9a478ba23"}},{"code_sha256_prefix":"e4affefdc674b157","entry":"load_actions","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/experiments/utils.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/experiments/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e4affefdc674b157"}},{"code_sha256_prefix":"23557072b6c01f33","entry":"load_cooperator_ids","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/experiments/utils.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/experiments/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"23557072b6c01f33"}},{"code_sha256_prefix":"e1b3265de807b4aa","entry":"load_rewards","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/experiments/utils.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/experiments/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e1b3265de807b4aa"}},{"code_sha256_prefix":"5af19b29d5176250","entry":"norm_init","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/agents/utils.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/agents/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5af19b29d5176250"}},{"code_sha256_prefix":"e8cde3414bc94ecb","entry":"transform_data","repo":"instadeepai/EGTA-NMARL","repo_kind":"official","path":"egta/experiments/plot_schelling_diagram.py","file_url":"https://github.com/instadeepai/EGTA-NMARL/blob/HEAD/egta/experiments/plot_schelling_diagram.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e8cde3414bc94ecb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}