Dialogue Understanding

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

9 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

2 subtasks in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 35 papers with code (79 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Unsupervised Abstractive Meeting Summarization with Multi-Sentence Compression and Budgeted Submodular Maximization
  14 May 2018 4 repositories listed
  We introduce a novel graph-based framework for abstractive meeting speech summarization that is fully unsupervised and does not rely on any annotations.
• ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control Communications
  8 Nov 2022 3 repositories listed
  In this paper, we introduce the ATCO2 corpus, a dataset that aims at fostering research on the challenging ATC field, which has lagged behind due to lack of annotated data.
• TEACh: Task-driven Embodied Agents that Chat
  1 Oct 2021 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Robots operating in human spaces must be able to engage in natural language interaction with people, both understanding and executing instructions, and using conversation to resolve ambiguity and recover from mistakes.
• A Repository of Conversational Datasets
  13 Apr 2019 3 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  Progress in Machine Learning is often driven by the availability of large datasets, and consistent evaluation metrics for comparing modeling approaches.
• Utterance-level Dialogue Understanding: An Empirical Study
  29 Sep 2020 2 repositories listed Syntology ran 0 of 11 samples · 11 unverified
  Most of these approaches account for the context for effective understanding.
• Masking Orchestration: Multi-task Pretraining for Multi-role Dialogue Representation Learning
  27 Feb 2020 2 repositories listed
  Multi-role dialogue understanding comprises a wide range of diverse tasks such as question answering, act classification, dialogue summarization etc.
• A Zero-Shot Open-Vocabulary Pipeline for Dialogue Understanding
  24 Sep 2024 1 repository listed
  Dialogue State Tracking (DST) is crucial for understanding user needs and executing appropriate system actions in task-oriented dialogues.
• Visualizing Dialogues: Enhancing Image Selection through Dialogue Understanding with Large Language Models
  4 Jul 2024 1 repository listed
  Recent advancements in dialogue systems have highlighted the significance of integrating multimodal responses, which enable conveying ideas through diverse modalities rather than solely relying on text-based…
• Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations
  27 Jun 2024 1 repository listed
  We present a generalizable classification approach that leverages Large Language Models (LLMs) to facilitate the detection of implicitly encoded social meaning in conversations.
• DialSim: A Real-Time Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agents
  19 Jun 2024 1 repository listed Syntology ran 8 of 11 samples · 3 unverified · 11 pointer-only (licence)
  Recent advancements in Large Language Models (LLMs) have significantly enhanced the capabilities of conversational agents, making them applicable to various fields (e.
• SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words
  19 Jun 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  We argue that this is due to the lack of principles on task definition and model development, which requires open-source datasets and metrics suitable for model evaluation.
• MathChat: Benchmarking Mathematical Reasoning and Instruction Following in Multi-Turn Interactions
  29 May 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  We evaluate the performance of various SOTA LLMs on the MathChat benchmark, and we observe that while these models excel in single turn question answering, they significantly underperform in more complex scenarios that…
• PromptCBLUE: A Chinese Prompt Tuning Benchmark for the Medical Domain
  22 Oct 2023 1 repository listed
  Biomedical language understanding benchmarks are the driving forces for artificial intelligence applications with large language model (LLM) back-ends.
• From Multilingual Complexity to Emotional Clarity: Leveraging Commonsense to Unveil Emotions in Code-Mixed Dialogues
  19 Oct 2023 1 repository listed
  Recognizing that emotional intelligence encompasses a comprehension of worldly knowledge, we propose an innovative approach that integrates commonsense information with dialogue context to facilitate a deeper…
• Revisit Input Perturbation Problems for LLMs: A Unified Robustness Evaluation Framework for Noisy Slot Filling Task
  10 Oct 2023 1 repository listed
  To address these challenges, we propose a unified robustness evaluation framework based on the slot-filling task to systematically evaluate the dialogue understanding capability of LLMs in diverse input perturbation…
• VSTAR: A Video-grounded Dialogue Dataset for Situated Semantic Understanding with Scene and Topic Transitions
  30 May 2023 1 repository listed
  Video-grounded dialogue understanding is a challenging problem that requires machine to perceive, parse and reason over situated semantics extracted from weakly aligned video and dialogues.
• Medical Dialogue Generation via Dual Flow Modeling
  29 May 2023 1 repository listed
  It extracts the medical entities and dialogue acts used in the dialogue history and models their transitions with an entity-centric graph flow and a sequential act flow, respectively.
• Hierarchical Dialogue Understanding with Special Tokens and Turn-level Attention
  29 Apr 2023 1 repository listed
  We evaluate our model on various dialogue understanding tasks including dialogue relation extraction, dialogue emotion recognition, and dialogue act classification.
• DialoGen: Generalized Long-Range Context Representation for Dialogue Systems
  12 Oct 2022 1 repository listed
  In this work, we propose DialoGen, a novel encoder-decoder based framework for dialogue generation with a generalized context representation that can look beyond the last-k utterances.
• Semantic-based Pre-training for Dialogue Understanding
  19 Sep 2022 1 repository listed
  However, these models are typically trained on surface dialogue text, thus are proven to be weak in understanding the main semantic meaning of a dialogue context.
• Learning Dialogue Representations from Consecutive Utterances
  26 May 2022 1 repository listed
  In this paper, we introduce Dialogue Sentence Embedding (DSE), a self-supervised contrastive learning method that learns effective dialogue representations suitable for a wide range of dialogue tasks.
• FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue
  12 May 2022 1 repository listed Syntology ran 0 of 9 samples · 9 unverified
  Task transfer, transferring knowledge contained in related tasks, holds the promise of reducing the quantity of labeled data required to fine-tune language models.
• User-Centric Conversational Recommendation with Multi-Aspect User Modeling
  20 Apr 2022 1 repository listed
  In this work, we highlight that the user's historical dialogue sessions and look-alike users are essential sources of user preferences besides the current dialogue session in CRS.
• A Benchmark for Automatic Medical Consultation System: Frameworks, Tasks and Datasets
  19 Apr 2022 1 repository listed
  In recent years, interest has arisen in using machine learning to improve the efficiency of automatic medical consultation and enhance patient experience.
• CSAGN: Conversational Structure Aware Graph Network for Conversational Semantic Role Labeling
  23 Sep 2021 1 repository listed Syntology ran 1 of 3 samples · 2 unverified
  Conversational semantic role labeling (CSRL) is believed to be a crucial step towards dialogue understanding.
• DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization
  6 Sep 2021 1 repository listed
  For a dialogue, it corrupts a window of text with dialogue-inspired noise, and guides the model to reconstruct this window based on the content of the remaining conversation.
• M2H2: A Multimodal Multiparty Hindi Dataset For Humor Recognition in Conversations
  3 Aug 2021 1 repository listed
  We propose several strong multimodal baselines and show the importance of contextual and multimodal information for humor recognition in conversations.
• A Structure Self-Aware Model for Discourse Parsing on Multi-Party Dialogues
  1 Aug 2021 1 repository listed
  Conversational discourse structures aim to describe how a dialogue is organised, thus they are helpful for dialogue understanding and response generation.
• Semantic Representation for Dialogue Modeling
  21 May 2021 1 repository listed Syntology ran 1 of 5 samples · 4 unverified
  Although neural models have achieved competitive results in dialogue systems, they have shown limited ability in representing core semantics, such as ignoring important entities.
• CREAD: Combined Resolution of Ellipses and Anaphora in Dialogues
  20 May 2021 1 repository listed
  In this work, we propose a novel joint learning framework of modeling coreference resolution and query rewriting for complex, multi-turn dialogue understanding.

Syntology lines on 9 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.