{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/adaptive-incentive-design","title":"Adaptive Incentive Design","arxiv_id":"1806.05749","date":"2018-06-14","proceeding":null,"authors":["Lillian J. Ratliff","Tanner Fiez"],"abstract":"We apply control theoretic and optimization techniques to adaptively design incentives. In particular, we consider the problem of a planner with an objective that depends on data from strategic decision makers. The planner does not know the process by which the strategic agents make decisions. Under the assumption that the agents are utility maximizers, we model their interactions as a non-cooperative game and utilize the Nash equilibrium concept as well as myopic update rules to model the selection of their decision. By parameterizing the agents' utility functions and the incentives offered, we develop an algorithm that the planner can employ to learn the agents' decision-making processes while simultaneously designing incentives to change their response to a more desirable response from the planner's perspective. We provide convergence results for this algorithm both in the noise-free and noisy cases and present illustrative examples.","url_abs":"http://arxiv.org/abs/1806.05749v1","url_pdf":"http://arxiv.org/pdf/1806.05749v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"adaptive-incentive-design","repo_url":"https://github.com/fiezt/Online-Utility-Learning-Incentive-Design","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1806.05749","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1806.05749"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fiezt/Online-Utility-Learning-Incentive-Design","reach":null}],"summary":{"ran_honours":1,"unverified":2},"by_repo_kind":{"official":{"samples":3,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"cc67a6b0392c195e","entry":"play_step","repo":"fiezt/Online-Utility-Learning-Incentive-Design","repo_kind":"official","path":"online_ulid.py","file_url":"https://github.com/fiezt/Online-Utility-Learning-Incentive-Design/blob/HEAD/online_ulid.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cc67a6b0392c195e"}},{"code_sha256_prefix":"4bbdb4fd88aafb57","entry":"online_ulid","repo":"fiezt/Online-Utility-Learning-Incentive-Design","repo_kind":"official","path":"online_ulid.py","file_url":"https://github.com/fiezt/Online-Utility-Learning-Incentive-Design/blob/HEAD/online_ulid.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4bbdb4fd88aafb57"}},{"code_sha256_prefix":"f43afb171a6bf5b6","entry":"play_step_inc","repo":"fiezt/Online-Utility-Learning-Incentive-Design","repo_kind":"official","path":"online_ulid.py","file_url":"https://github.com/fiezt/Online-Utility-Learning-Incentive-Design/blob/HEAD/online_ulid.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f43afb171a6bf5b6"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}