User Simulation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

25 shown of 25 papers with code (64 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• A User Simulator for Task-Completion Dialogues
  17 Dec 2016 10 repositories listed
  Then, one can train reinforcement learning agents in an online fashion as they interact with the simulator.
• KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systems
  22 Feb 2022 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  The progress of recommender systems is hampered mainly by evaluation as it requires real-time interactions between humans and systems, which is too laborious and expensive.
• In-Context Learning User Simulators for Task-Oriented Dialog Systems
  1 Jun 2023 2 repositories listed
  This paper presents a novel application of large language models in user simulation for task-oriented dialog systems, specifically focusing on an in-context learning approach.
• CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Dataset
  27 Feb 2020 2 repositories listed
  To advance multi-domain (cross-domain) dialogue modeling as well as alleviate the shortage of Chinese task-oriented datasets, we propose CrossWOZ, the first large-scale Chinese Cross-Domain Wizard-of-Oz task-oriented…
• Thought-Augmented Planning for LLM-Powered Interactive Recommender Agent
  30 Jun 2025 1 repository listed
  Interactive recommendation is a typical information-seeking task that allows users to interactively express their needs through natural language and obtain personalized recommendations.
• Exploring Human-Like Thinking in Search Simulations with Large Language Models
  10 Apr 2025 1 repository listed
  As existing search datasets do not include users' thought processes, we conducted a user study to collect a new dataset enriched with users' explicit thinking.
• Agentic Feedback Loop Modeling Improves Recommendation and User Simulation
  26 Oct 2024 1 repository listed
  Specifically, the recommendation agent refines its understanding of user preferences by analyzing the feedback from the user agent on the item recommendation.
• Multi-trait User Simulation with Adaptive Decoding for Conversational Task Assistants
  16 Oct 2024 1 repository listed Syntology ran 3 of 3 samples · 0 unverified
  Conversational systems must be robust to user interactions that naturally exhibit diverse conversational traits.
• Towards a Formal Characterization of User Simulation Objectives in Conversational Information Access
  27 Jun 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  User simulation is a promising approach for automatically training and evaluating conversational information access agents, enabling the generation of synthetic dialogues and facilitating reproducible experiments at…
• Identifying Breakdowns in Conversational Recommender Systems using User Simulation
  23 May 2024 1 repository listed
  We present a methodology to systematically test conversational recommender systems with regards to conversational breakdowns.
• Lusifer: LLM-based User SImulated Feedback Environment for online Recommender systems
  22 May 2024 1 repository listed
  Reinforcement learning (RL) recommender systems often rely on static datasets that fail to capture the fluid, ever changing nature of user preferences in real-world scenarios.
• Investigating the Robustness of Counterfactual Learning to Rank Models: A Reproducibility Study
  4 Apr 2024 1 repository listed
  Counterfactual learning to rank (CLTR) has attracted extensive attention in the IR community for its ability to leverage massive logged user interaction data to train ranking models.
• USimAgent: Large Language Models for Simulating Search Users
  14 Mar 2024 1 repository listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  However, the potential of using LLMs in simulating search behaviors has not yet been fully explored.
• Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulation
  26 Feb 2024 1 repository listed
  Simulating the response of the public and forecasting the potential impact has become increasingly important.
• User Behavior Simulation with Large Language Model based Agents
  5 Jun 2023 1 repository listed
  Simulating high quality user behavior data has always been a fundamental problem in human-centered applications, where the major difficulty originates from the intricate mechanism of human decision process.
• Multimodal Interactive Lung Lesion Segmentation: A Framework for Annotating PET/CT Images based on Physiological and Anatomical Cues
  24 Jan 2023 1 repository listed
  Recently, deep learning enabled the accurate segmentation of various diseases in medical imaging.
• UserSimCRS: A User Simulation Toolkit for Evaluating Conversational Recommender Systems
  13 Jan 2023 1 repository listed
  We present an extensible user simulation toolkit to facilitate automatic evaluation of conversational recommender systems.
• BotSIM: An End-to-End Bot Simulation Toolkit for Commercial Task-Oriented Dialog Systems
  29 Nov 2022 1 repository listed
  BotSIM adopts a layered design comprising the infrastructure layer, the adaptor layer and the application layer.
• Analyzing and Simulating User Utterance Reformulation in Conversational Recommender Systems
  3 May 2022 1 repository listed
  User simulation has been a cost-effective technique for evaluating conversational recommender systems.
• Evaluating Mixed-initiative Conversational Search Systems via User Simulation
  17 Apr 2022 1 repository listed
  Clarifying the underlying user information need by asking clarifying questions is an important feature of modern conversational search system.
• Reactive and Safe Road User Simulations using Neural Barrier Certificates
  14 Sep 2021 1 repository listed
  Reactive and safe agent modelings are important for nowadays traffic simulator designs and safe planning applications.
• Simulating User Satisfaction for the Evaluation of Task-oriented Dialogue Systems
  8 May 2021 1 repository listed
  The purpose of the task is to increase the evaluation power of user simulations and to make the simulation more human-like.
• Evaluating Conversational Recommender Systems via User Simulation
  15 Jun 2020 1 repository listed
  Conversational information access is an emerging research area.
• Variational Hierarchical Dialog Autoencoder for Dialog State Tracking Data Augmentation
  23 Jan 2020 1 repository listed
  Recent works have shown that generative data augmentation, where synthetic samples generated from deep generative models complement the training dataset, benefit NLP tasks.
• How to Build User Simulators to Train RL-based Dialog Systems
  3 Sep 2019 1 repository listed
  We propose a method of standardizing user simulator building that can be used by the community to compare dialog system quality using the same set of user simulators fairly.

Syntology lines on 4 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.