Conversational Response Selection

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

14 leaderboard tables shown for this task, 14 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 14 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

12 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 36 papers with code (46 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  11 Oct 2018 534 repositories listed Syntology ran 204 of 659 samples · 455 unverified · 149 pointer-only (licence)
  We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers.
• Deep contextualized word representations
  15 Feb 2018 46 repositories listed Syntology ran 23 of 58 samples · 35 unverified · 25 pointer-only (licence)
  We introduce a new type of deep contextualized word representation that models both (1) complex characteristics of word use (e.
• Universal Sentence Encoder
  29 Mar 2018 24 repositories listed Syntology ran 1 of 22 samples · 21 unverified · 1 pointer-only (licence)
  For both variants, we investigate and report the relationship between model complexity, resource consumption, the availability of transfer task training data, and task performance.
• The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems
  30 Jun 2015 21 repositories listed Syntology ran 1 of 26 samples · 25 unverified · 1 pointer-only (licence)
  This paper introduces the Ubuntu Dialogue Corpus, a dataset containing almost 1 million multi-turn dialogues, with a total of over 7 million utterances and 100 million words.
• Personalizing Dialogue Agents: I have a dog, do you have pets too?
  22 Jan 2018 15 repositories listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  Chit-chat models are known to have several problems: they lack specificity, do not display a consistent personality and are often not very captivating.
• Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring
  22 Apr 2019 7 repositories listed
  The use of deep pre-trained bidirectional transformers has led to remarkable progress in a number of applications (Devlin et al., 2018).
• ConveRT: Efficient and Accurate Conversational Representations from Transformers
  9 Nov 2019 5 repositories listed Syntology ran 0 of 9 samples · 9 unverified
  General-purpose pretrained sentence encoders such as BERT are not ideal for real-world conversational AI applications; they are computationally heavy, slow, and expensive to train.
• Sequential Attention-based Network for Noetic End-to-End Response Selection
  9 Jan 2019 4 repositories listed
  The noetic end-to-end response selection challenge as one track in Dialog System Technology Challenges 7 (DSTC7) aims to push the state of the art of utterance classification for real world goal-oriented dialog systems,…
• A Repository of Conversational Datasets
  13 Apr 2019 3 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  Progress in Machine Learning is often driven by the availability of large datasets, and consistent evaluation metrics for comparing modeling approaches.
• Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
  6 Dec 2016 3 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  Existing work either concatenates utterances in context or matches a response with a highly abstract context vector finally, which may lose relationships among utterances or important contextual information.
• Dialogue Response Ranking Training with Large-Scale Human Feedback Data
  15 Sep 2020 2 repositories listed Syntology ran 1 of 6 samples · 5 unverified
  Particularly, our ranker outperforms the conventional dialog perplexity baseline with a large margin on predicting Reddit feedback.
• Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
  7 Apr 2020 2 repositories listed
  In this paper, we study the problem of employing pre-trained language models for multi-turn response selection in retrieval-based chatbots.
• Efficient Dynamic Hard Negative Sampling for Dialogue Selection
  16 Aug 2024 1 repository listed
  Recent studies have demonstrated significant improvements in selection tasks, and a considerable portion of this success is attributed to incorporating informative negative samples during training.
• P5: Plug-and-Play Persona Prompting for Personalized Response Selection
  10 Oct 2023 1 repository listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  Our system can function as a standard open-domain chatbot if persona information is not available.
• Knowledge-aware response selection with semantics underlying multi-turn open-domain conversations
  27 Jul 2023 1 repository listed
  Then, SemSol improves the accuracy of the response by exploiting the semantic information in a knowledge graph in accordance with the dialogue context.
• Dial-MAE: ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systems
  7 Jun 2023 1 repository listed
  Dialogue response selection aims to select an appropriate response from several candidates based on a given user and system utterance history.
• Learning Dialogue Representations from Consecutive Utterances
  26 May 2022 1 repository listed
  In this paper, we introduce Dialogue Sentence Embedding (DSE), a self-supervised contrastive learning method that learns effective dialogue representations suitable for a wide range of dialogue tasks.
• One Agent To Rule Them All: Towards Multi-agent Conversational AI
  15 Mar 2022 1 repository listed
  To address these problems, we introduce a new task BBAI: Black-Box Agent Integration, focusing on combining the capabilities of multiple black-box CAs at scale.
• Exploring Dense Retrieval for Dialogue Response Selection
  13 Oct 2021 1 repository listed Syntology ran 0 of 3 samples · 3 unverified
  In this study, we present a solution to directly select proper responses from a large corpus or even a nonparallel corpus that only consists of unpaired sentences, using a dense retrieval model.
• Response Ranking with Multi-types of Deep Interactive Representations in Retrieval-based Dialogues
  17 Aug 2021 1 repository listed
  To tackle these challenges, we propose a representation[K]-interaction[L]-matching framework that explores multiple types of deep interactive representations to build context-response matching models for response…
• MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understanding
  3 Jun 2021 1 repository listed
  Recently, various neural models for multi-party conversation (MPC) have achieved impressive improvements on a variety of tasks such as addressee recognition, speaker identification and response prediction.
• Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems
  2 Jun 2021 1 repository listed
  The current state-of-the-art ranking methods mainly use an encoding paradigm called Cross-Encoder, which separately encodes each context-candidate pair and ranks the candidates according to their fitness scores.
• Fine-grained Post-training for Improving Retrieval-based Dialogue Systems
  24 May 2021 1 repository listed
  During the multi-turn response selection, BERT focuses on training the relationship between the context with multiple utterances and the response.
• Open-domain question classification and completion in conversational information search
  26 Feb 2021 1 repository listed
  Searching for new information requires talking to the system.
• Dialogue Response Selection with Hierarchical Curriculum Learning
  29 Dec 2020 1 repository listed
  As for IC, it progressively strengthens the model's ability in identifying the mismatching information between the dialogue context and a response candidate.
• Do Response Selection Models Really Know What's Next? Utterance Manipulation Strategies for Multi-turn Response Selection
  10 Sep 2020 1 repository listed
  In this paper, we study the task of selecting the optimal response given a user and system utterance history in retrieval-based multi-turn dialog systems.
• Utterance-to-Utterance Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots
  16 Nov 2019 1 repository listed
  The distances between context and response utterances are employed as a prior component when calculating the attention weights.
• Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots
  1 Nov 2019 1 repository listed
  Existing works mainly focus on matching candidate responses with every context utterance on multiple levels of granularity, which ignore the side effect of using excessive context information.
• An Effective Domain Adaptive Post-Training Method for BERT in Response Selection
  13 Aug 2019 1 repository listed
  We focus on multi-turn response selection in a retrieval-based dialog system.
• One Time of Interaction May Not Be Enough: Go Deep with an Interaction-over-Interaction Network for Response Selection in Dialogues
  1 Jul 2019 1 repository listed
  Currently, researchers have paid great attention to retrieval-based dialogues in open-domain.

Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.