{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/data-generation-as-sequential-decision-making","title":"Data Generation as Sequential Decision Making","arxiv_id":"1506.03504","date":"2015-06-10","proceeding":"NeurIPS 2015 12","authors":["Philip Bachman","Doina Precup"],"abstract":"We connect a broad class of generative models through their shared reliance\non sequential decision making. Motivated by this view, we develop extensions to\nan existing model, and then explore the idea further in the context of data\nimputation -- perhaps the simplest setting in which to investigate the relation\nbetween unconditional and conditional generative modelling. We formulate data\nimputation as an MDP and develop models capable of representing effective\npolicies for it. We construct the models using neural networks and train them\nusing a form of guided policy search. Our models generate predictions through\nan iterative process of feedback and refinement. We show that this approach can\nlearn effective policies for imputation problems of varying difficulty and\nacross multiple datasets.","url_abs":"http://arxiv.org/abs/1506.03504v3","url_pdf":"http://arxiv.org/pdf/1506.03504v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"data-generation-as-sequential-decision-making","repo_url":"https://github.com/Philip-Bachman/Sequential-Generation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"imputation","task_name":"Imputation"},{"task_slug":"sequential-decision-making","task_name":"Sequential Decision Making"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1506.03504","atlas_url":"https://app.syntology.ai/?focus=1506.03504","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1506.03504"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Philip-Bachman/Sequential-Generation","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":2},"by_repo_kind":{"official":{"samples":2,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3d6b800f7f68453b","entry":"img_grid","repo":"Philip-Bachman/Sequential-Generation","repo_kind":"official","path":"TestBlocksCLModels.py","file_url":"https://github.com/Philip-Bachman/Sequential-Generation/blob/HEAD/TestBlocksCLModels.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3d6b800f7f68453b"}},{"code_sha256_prefix":"14287d7ddc6d235c","entry":"scale_norm","repo":"Philip-Bachman/Sequential-Generation","repo_kind":"official","path":"TestBlocksCLModels.py","file_url":"https://github.com/Philip-Bachman/Sequential-Generation/blob/HEAD/TestBlocksCLModels.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"14287d7ddc6d235c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}