{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/tell-me-more-towards-implicit-user-intention","title":"Tell Me More! Towards Implicit User Intention Understanding of Language Model Driven Agents","arxiv_id":"2402.09205","date":"2024-02-14","proceeding":null,"authors":["Cheng Qian","Bingxiang He","Zhong Zhuang","Jia Deng","Yujia Qin","Xin Cong","Zhong Zhang","Jie zhou","Yankai Lin","Zhiyuan Liu","Maosong Sun"],"abstract":"Current language model-driven agents often lack mechanisms for effective user participation, which is crucial given the vagueness commonly found in user instructions. Although adept at devising strategies and performing tasks, these agents struggle with seeking clarification and grasping precise user intentions. To bridge this gap, we introduce Intention-in-Interaction (IN3), a novel benchmark designed to inspect users' implicit intentions through explicit queries. Next, we propose the incorporation of model experts as the upstream in agent designs to enhance user-agent interaction. Employing IN3, we empirically train Mistral-Interact, a powerful model that proactively assesses task vagueness, inquires user intentions, and refines them into actionable goals before starting downstream agent task execution. Integrating it into the XAgent framework, we comprehensively evaluate the enhanced agent system regarding user instruction understanding and execution, revealing that our approach notably excels at identifying vague user tasks, recovering and summarizing critical missing information, setting precise and necessary agent execution goals, and minimizing redundant tool usage, thus boosting overall efficiency. All the data and codes are released.","url_abs":"https://arxiv.org/abs/2402.09205v2","url_pdf":"https://arxiv.org/pdf/2402.09205v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"tell-me-more-towards-implicit-user-intention","repo_url":"https://github.com/hbx-hbx/mistral-interact","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2402.09205","atlas_url":"https://app.syntology.ai/?focus=2402.09205","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.09205"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hbx-hbx/mistral-interact","reach":null}],"summary":{"ran_draft_wrong":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6a57a6a86671a69e","entry":"format_missing_details","repo":"hbx-hbx/mistral-interact","repo_kind":"official","path":"src/sft.py","file_url":"https://github.com/hbx-hbx/mistral-interact/blob/HEAD/src/sft.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6a57a6a86671a69e"}},{"code_sha256_prefix":"2d5620df446a127e","entry":"format_one","repo":"hbx-hbx/mistral-interact","repo_kind":"official","path":"src/sft.py","file_url":"https://github.com/hbx-hbx/mistral-interact/blob/HEAD/src/sft.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2d5620df446a127e"}},{"code_sha256_prefix":"3c0273dded3c124d","entry":"preprocess_data","repo":"hbx-hbx/mistral-interact","repo_kind":"official","path":"src/sft.py","file_url":"https://github.com/hbx-hbx/mistral-interact/blob/HEAD/src/sft.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3c0273dded3c124d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}