Browse State-of-the-Art › User Simulation
User Simulation
25 papers with code · 0 benchmarks · 2 datasets archive 2025-07-28
Simulation of user interacting with a dialog system
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 64 · with a code link: 25 · where Syntology ran a sample: 3 (2 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3 of 64 tagged: 2 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 64 of 64, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
17 Dec 2016 10 repositories listedThen, one can train reinforcement learning agents in an online fashion as they interact with the simulator.
-
22 Feb 2022 3 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)The progress of recommender systems is hampered mainly by evaluation as it requires real-time interactions between humans and systems, which is too laborious and expensive.
-
1 Jun 2023 2 repositories listedThis paper presents a novel application of large language models in user simulation for task-oriented dialog systems, specifically focusing on an in-context learning approach.
-
27 Feb 2020 2 repositories listedTo advance multi-domain (cross-domain) dialogue modeling as well as alleviate the shortage of Chinese task-oriented datasets, we propose CrossWOZ, the first large-scale Chinese Cross-Domain Wizard-of-Oz task-oriented…
-
30 Jun 2025 1 repository listedInteractive recommendation is a typical information-seeking task that allows users to interactively express their needs through natural language and obtain personalized recommendations.
-
10 Apr 2025 1 repository listedAs existing search datasets do not include users' thought processes, we conducted a user study to collect a new dataset enriched with users' explicit thinking.
-
26 Oct 2024 1 repository listedSpecifically, the recommendation agent refines its understanding of user preferences by analyzing the feedback from the user agent on the item recommendation.
-
16 Oct 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Conversational systems must be robust to user interactions that naturally exhibit diverse conversational traits.
-
Towards a Formal Characterization of User Simulation Objectives in Conversational Information Access27 Jun 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)User simulation is a promising approach for automatically training and evaluating conversational information access agents, enabling the generation of synthetic dialogues and facilitating reproducible experiments at…
-
23 May 2024 1 repository listedWe present a methodology to systematically test conversational recommender systems with regards to conversational breakdowns.
-
22 May 2024 1 repository listedReinforcement learning (RL) recommender systems often rely on static datasets that fail to capture the fluid, ever changing nature of user preferences in real-world scenarios.
-
4 Apr 2024 1 repository listedCounterfactual learning to rank (CLTR) has attracted extensive attention in the IR community for its ability to leverage massive logged user interaction data to train ranking models.
-
14 Mar 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)However, the potential of using LLMs in simulating search behaviors has not yet been fully explored.
-
26 Feb 2024 1 repository listedSimulating the response of the public and forecasting the potential impact has become increasingly important.
-
5 Jun 2023 1 repository listedSimulating high quality user behavior data has always been a fundamental problem in human-centered applications, where the major difficulty originates from the intricate mechanism of human decision process.
-
24 Jan 2023 1 repository listedRecently, deep learning enabled the accurate segmentation of various diseases in medical imaging.
-
13 Jan 2023 1 repository listedWe present an extensible user simulation toolkit to facilitate automatic evaluation of conversational recommender systems.
-
29 Nov 2022 1 repository listedBotSIM adopts a layered design comprising the infrastructure layer, the adaptor layer and the application layer.
-
3 May 2022 1 repository listedUser simulation has been a cost-effective technique for evaluating conversational recommender systems.
-
17 Apr 2022 1 repository listedClarifying the underlying user information need by asking clarifying questions is an important feature of modern conversational search system.
-
14 Sep 2021 1 repository listedReactive and safe agent modelings are important for nowadays traffic simulator designs and safe planning applications.
-
8 May 2021 1 repository listedThe purpose of the task is to increase the evaluation power of user simulations and to make the simulation more human-like.
-
15 Jun 2020 1 repository listedConversational information access is an emerging research area.
-
23 Jan 2020 1 repository listedRecent works have shown that generative data augmentation, where synthetic samples generated from deep generative models complement the training dataset, benefit NLP tasks.
-
3 Sep 2019 1 repository listedWe propose a method of standardizing user simulator building that can be used by the community to compare dialog system quality using the same set of user simulators fairly.
-
ECom-Bench: Can LLM Agent Resolve Real-World E-commerce Customer Support Issues?8 Jul 2025 0 repositories listedIn this paper, we introduce ECom-Bench, the first benchmark framework for evaluating LLM agent with multimodal capabilities in the e-commerce customer support domain.
-
The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systems2 Jul 2025 0 repositories listedLarge language models (LLMs) are rapidly evolving from passive engines of text generation into agentic entities that can plan, remember, invoke external tools, and co-operate with one another.
-
LLM-Based User Simulation for Low-Knowledge Shilling Attacks on Recommender Systems18 May 2025 0 repositories listedRecommender systems (RS) are increasingly vulnerable to shilling attacks, where adversaries inject fake user profiles to manipulate system outputs.
-
Exploring the Impact of Personality Traits on Conversational Recommender Systems: A Simulation with Large Language Models9 Apr 2025 0 repositories listedConversational Recommender Systems (CRSs) engage users in multi-turn interactions to deliver personalized recommendations.
-
User Simulation in the Era of Generative AI: User Modeling, Synthetic Data Generation, and System Evaluation8 Jan 2025 0 repositories listedUser simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI.
-
VicSim: Enhancing Victim Simulation with Emotional and Linguistic Fidelity6 Jan 2025 0 repositories listed
-
Simulation-Free Hierarchical Latent Policy Planning for Proactive Dialogues19 Dec 2024 0 repositories listed
-
LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation12 Dec 2024 0 repositories listed
-
Stop Playing the Guessing Game! Target-free User Simulation for Evaluating Conversational Recommender Systems25 Nov 2024 0 repositories listed
-
VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation20 Nov 2024 0 repositories listed
-
Minimizing Live Experiments in Recommender Systems: User Simulation to Evaluate Preference Elicitation Policies26 Sep 2024 0 repositories listed
-
Reformulating Conversational Recommender Systems as Tri-Phase Offline Policy Learning13 Aug 2024 0 repositories listed
-
Strength Lies in Differences! Improving Strategy Planning for Non-collaborative Dialogues via Diversified User Simulation11 Mar 2024 0 repositories listed
-
BASES: Large-scale Web Search User Simulation with Large Language Model based Agents27 Feb 2024 0 repositories listed
-
Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems20 Feb 2024 0 repositories listed
-
Leveraging User Simulation to Develop and Evaluate Conversational Information Access Agents13 Dec 2023 0 repositories listed
-
CIRCLE: Multi-Turn Query Clarifications with Reinforcement Learning5 Nov 2023 0 repositories listed
-
User Simulation with Large Language Models for Evaluating Task-Oriented Dialogue23 Sep 2023 0 repositories listed
-
User Simulation for Evaluating Information Access Systems14 Jun 2023 0 repositories listed
-
Theoretical Analysis on the Efficiency of Interleaved Comparisons31 May 2023 0 repositories listed
-
An In-depth Investigation of User Response Simulation for Conversational Search17 Apr 2023 0 repositories listed
-
Leveraging Centric Data Federated Learning Using Blockchain For Integrity Assurance9 Jun 2022 0 repositories listed
-
Interactive Query Clarification and Refinement via User Simulation31 May 2022 0 repositories listed
-
State of the Art of User Simulation approaches for conversational information retrieval10 Jan 2022 0 repositories listed
-
Domain-independent User Simulation with Transformers for Task-oriented Dialogue Systems16 Jun 2021 0 repositories listed
-
Advances and Challenges in Conversational Recommender Systems: A Survey23 Jan 2021 0 repositories listed
-
Energy-efficient Deployment of Multiple UAVs Using Ellipse Clustering to Establish Base Stations12 Mar 2020 0 repositories listed
-
User Modeling for Task Oriented Dialogues11 Nov 2018 0 repositories listed
-
Neural User Simulation for Corpus-based Policy Optimisation of Spoken Dialogue Systems1 Jul 2018 0 repositories listed
-
Explainable Agreement through Simulation for Tasks with Subjective Labels13 Jun 2018 0 repositories listed
-
Neural User Simulation for Corpus-based Policy Optimisation for Spoken Dialogue Systems17 May 2018 0 repositories listed
-
Massive MIMO relaying with linear precoding in correlated channels under limited feedback28 Feb 2018 0 repositories listed
-
A Sequence-to-Sequence Model for User Simulation in Spoken Dialogue Systems30 Jun 2016 0 repositories listed
-
Continuously Learning Neural Dialogue Management8 Jun 2016 0 repositories listed
-
Optimizing human-interpretable dialog management policy using Genetic Algorithm12 May 2016 0 repositories listed
-
A Generative Model for User Simulation in a Spatial Navigation Domain1 Apr 2014 0 repositories listed
-
An Unsupervised Approach to User Simulation: Toward Self-Improving Dialog Systems1 Jul 2012 0 repositories listed
-
Generative Goal-Driven User Simulation for Dialog Management1 Jul 2012 0 repositories listed
-
Statistical User Simulation for Spoken Dialogue Systems: What for, Which Data, Which Future?1 Jun 2012 0 repositories listed
Syntology lines on 4 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections