{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/star-gate-teaching-language-models-to-ask","title":"STaR-GATE: Teaching Language Models to Ask Clarifying Questions","arxiv_id":"2403.19154","date":"2024-03-28","proceeding":null,"authors":["Chinmaya Andukuri","Jan-Philipp Fränken","Tobias Gerstenberg","Noah D. Goodman"],"abstract":"When prompting language models to complete a task, users often leave important aspects unsaid. While asking questions could resolve this ambiguity (GATE; Li et al., 2023), models often struggle to ask good questions. We explore a language model's ability to self-improve (STaR; Zelikman et al., 2022) by rewarding the model for generating useful questions-a simple method we dub STaR-GATE. We generate a synthetic dataset of 25,500 unique persona-task prompts to simulate conversations between a pretrained language model-the Questioner-and a Roleplayer whose preferences are unknown to the Questioner. By asking questions, the Questioner elicits preferences from the Roleplayer. The Questioner is iteratively finetuned on questions that increase the probability of high-quality responses to the task, which are generated by an Oracle with access to the Roleplayer's latent preferences. After two iterations of self-improvement, the Questioner asks better questions, allowing it to generate responses that are preferred over responses from the initial model on 72% of tasks. Our results indicate that teaching a language model to ask better questions leads to better personalized responses.","url_abs":"https://arxiv.org/abs/2403.19154v3","url_pdf":"https://arxiv.org/pdf/2403.19154v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"star-gate-teaching-language-models-to-ask","repo_url":"https://github.com/scandukuri/assistant-gate","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.19154","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.19154"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/scandukuri/assistant-gate","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":4,"unverified":1},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e9ba52f006c28c65","entry":"calculate_mean_and_sem","repo":"scandukuri/assistant-gate","repo_kind":"official","path":"experiments/star-gate-gemma-ablation/general-vs-specific/utils.py","file_url":"https://github.com/scandukuri/assistant-gate/blob/HEAD/experiments/star-gate-gemma-ablation/general-vs-specific/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e9ba52f006c28c65"}},{"code_sha256_prefix":"045d82871430ec08","entry":"dict_to_list","repo":"scandukuri/assistant-gate","repo_kind":"official","path":"experiments/star-gate-gemma-ablation/general-vs-specific/utils.py","file_url":"https://github.com/scandukuri/assistant-gate/blob/HEAD/experiments/star-gate-gemma-ablation/general-vs-specific/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"045d82871430ec08"}},{"code_sha256_prefix":"f9b95ab7d30cf5dd","entry":"flatten_list","repo":"scandukuri/assistant-gate","repo_kind":"official","path":"experiments/star-gate-gemma-ablation/build-gold-responses/utils.py","file_url":"https://github.com/scandukuri/assistant-gate/blob/HEAD/experiments/star-gate-gemma-ablation/build-gold-responses/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f9b95ab7d30cf5dd"}},{"code_sha256_prefix":"96f770858f3a4392","entry":"flatten_list","repo":"scandukuri/assistant-gate","repo_kind":"official","path":"experiments/star-gate-gemma-ablation/general-vs-specific/utils.py","file_url":"https://github.com/scandukuri/assistant-gate/blob/HEAD/experiments/star-gate-gemma-ablation/general-vs-specific/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"96f770858f3a4392"}},{"code_sha256_prefix":"66fd4b46def3ecdd","entry":"main","repo":"scandukuri/assistant-gate","repo_kind":"official","path":"experiments/star-gate-gemma-ablation/instruct-questions/extract-questions.py","file_url":"https://github.com/scandukuri/assistant-gate/blob/HEAD/experiments/star-gate-gemma-ablation/instruct-questions/extract-questions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"66fd4b46def3ecdd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}