Multi-domain Dialogue State Tracking

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

29 shown of 29 papers with code (50 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• MultiWOZ 2.1: A Consolidated Multi-Domain Dialogue Dataset with State Corrections and State Tracking Baselines
  2 Jul 2019 6 repositories listed Syntology ran 2 of 23 samples · 21 unverified
  To fix the noisy state annotations, we use crowdsourced workers to re-annotate state and utterances based on the original utterances in the dataset.
• Efficient Dialogue State Tracking by Selectively Overwriting Memory
  10 Nov 2019 3 repositories listed
  This mechanism consists of two steps: (1) predicting state operation on each of the memory slots, and (2) overwriting the memory with new values, of which only a few are generated according to the predicted state…
• SUMBT: Slot-Utterance Matching for Universal and Scalable Belief Tracking
  17 Jul 2019 3 repositories listed Syntology ran 4 of 9 samples · 5 unverified · 2 pointer-only (licence)
  In goal-oriented dialog systems, belief trackers estimate the probability distribution of slot-values at every dialog turn.
• Know Thy Strengths: Comprehensive Dialogue State Tracking Diagnostics
  15 Dec 2021 2 repositories listed
  Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses increasingly important for…
• CoCo: Controllable Counterfactuals for Evaluating Dialogue State Trackers
  24 Oct 2020 2 repositories listed Syntology ran 9 of 10 samples · 1 unverified
  Dialogue state trackers have made significant progress on benchmark datasets, but their generalization capability to novel and realistic scenarios beyond the held-out conversations is less understood.
• Jointly Optimizing State Operation Prediction and Value Generation for Dialogue State Tracking
  24 Oct 2020 2 repositories listed
  However, in such a stacked encoder-decoder structure, the operation prediction objective only affects the BERT encoder and the value generation objective mainly affects the RNN decoder.
• Multi-domain Dialogue State Tracking as Dynamic Knowledge Graph Enhanced Question Answering
  7 Nov 2019 2 repositories listed
  Multi-domain dialogue state tracking (DST) is a critical component for conversational AI systems.
• Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systems
  21 May 2019 2 repositories listed
  Over-dependence on domain ontology and lack of knowledge sharing across domains are two practical and yet less studied problems of dialogue state tracking.
• Large-Scale Multi-Domain Belief Tracking with Knowledge Sharing
  17 Jul 2018 2 repositories listed
  Robust dialogue belief tracking is a key component in maintaining good quality dialogue systems.
• Global-Locally Self-Attentive Dialogue State Tracker
  19 May 2018 2 repositories listed Syntology ran 0 of 8 samples · 8 unverified · 3 pointer-only (licence)
  Dialogue state tracking, which estimates user goals and requests given the dialogue context, is an essential part of task-oriented dialogue systems.
• Act-Aware Slot-Value Predicting in Multi-Domain Dialogue State Tracking
  4 Aug 2022 1 repository listed
  As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue.
• Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Tracking
  3 Mar 2022 1 repository listed Syntology ran 9 of 15 samples · 6 unverified · 15 pointer-only (licence)
  In this paper, we hypothesize that dialogue summaries are essentially unstructured dialogue states; hence, we propose to reformulate dialogue state tracking as a dialogue summarization problem.
• Amendable Generation for Dialogue State Tracking
  29 Oct 2021 1 repository listed
  In this paper, we propose a novel Amendable Generation for Dialogue State Tracking (AG-DST), which contains a two-pass generation process: (1) generating a primitive dialogue state based on the dialogue of the current…
• Robustness through Data Augmentation Loss Consistency
  21 Oct 2021 1 repository listed
  Our experiments show that DAIR consistently outperforms ERM and DA-ERM with little marginal computational cost and sets new state-of-the-art results in several benchmarks involving covariant data augmentation.
• "How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversations
  28 Sep 2021 1 repository listed
  Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets.
• Dialogue State Tracking with a Language Model using Schema-Driven Prompting
  15 Sep 2021 1 repository listed
  Task-oriented conversational systems often use dialogue state tracking to represent the user's intentions, which involves filling in values of pre-defined slots.
• Effective Sequence-to-Sequence Dialogue State Tracking
  31 Aug 2021 1 repository listed
  We also explore using Pegasus, a span prediction-based pre-training objective for text summarization, for the state tracking model.
• Knowledge-Aware Graph-Enhanced GPT-2 for Dialogue State Tracking
  9 Apr 2021 1 repository listed
  Dialogue State Tracking is central to multi-domain task-oriented dialogue systems, responsible for extracting information from user utterances.
• A Sequence-to-Sequence Approach to Dialogue State Tracking
  18 Nov 2020 1 repository listed
  This paper is concerned with dialogue state tracking (DST) in a task-oriented dialogue system.
• DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue
  28 Sep 2020 1 repository listed
  A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains.
• MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems
  25 Sep 2020 1 repository listed Syntology ran 3 of 9 samples · 6 unverified
  In this paper, we propose Minimalist Transfer Learning (MinTL) to simplify the system design process of task-oriented dialogue systems and alleviate the over-dependency on annotated data.
• Parallel Interactive Networks for Multi-Domain Dialogue State Generation
  16 Sep 2020 1 repository listed
  In this study, we argue that the incorporation of these dependencies is crucial for the design of MDST and propose Parallel Interactive Networks (PIN) to model these dependencies.
• Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Tracking
  2 May 2020 1 repository listed
  We show that data augmentation through synthesized data can improve the accuracy of zero-shot learning for both the TRADE model and the BERT-based SUMBT model on the MultiWOZ 2.
• A Simple Language Model for Task-Oriented Dialogue
  2 May 2020 1 repository listed Syntology ran 3 of 14 samples · 11 unverified
  Task-oriented dialogue is often decomposed into three tasks: understanding user input, deciding actions, and generating a response.
• Non-Autoregressive Dialog State Tracking
  19 Feb 2020 1 repository listed Syntology ran 0 of 2 samples · 2 unverified
  Recent efforts in Dialogue State Tracking (DST) for task-oriented dialogues have progressed toward open-vocabulary or generation-based approaches where the models can generate slot value candidates from the dialogue…
• Find or Classify? Dual Strategy for Slot-Value Predictions on Multi-Domain Dialog State Tracking
  8 Oct 2019 1 repository listed
  Dialog state tracking (DST) is a core component in task-oriented dialog systems.
• Scalable and Accurate Dialogue State Tracking via Hierarchical Sequence Generation
  2 Sep 2019 1 repository listed
  Experiments on both the multi-domain and the single domain dialogue state tracking dataset show that our model not only scales easily with the increasing number of pre-defined domains and slots but also reaches the…
• Toward Scalable Neural Dialogue State Tracking Model
  3 Dec 2018 1 repository listed Syntology ran 0 of 6 samples · 6 unverified · 6 pointer-only (licence)
  The latency in the current neural based dialogue state tracking models prohibits them from being used efficiently for deployment in production systems, albeit their highly accurate performance.
• Scalable Multi-Domain Dialogue State Tracking
  29 Dec 2017 1 repository listed
  We introduce a novel framework for state tracking which is independent of the slot value set, and represent the dialogue state as a distribution over a set of values of interest (candidate set) derived from the dialogue…

Syntology lines on 9 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.