Chatbot

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

10 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 269 papers with code (971 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• QLoRA: Efficient Finetuning of Quantized LLMs
  23 May 2023 20 repositories listed Syntology ran 17 of 26 samples · 9 unverified · 17 pointer-only (licence)
  Our best model family, which we name Guanaco, outperforms all previous openly released models on the Vicuna benchmark, reaching 99.
• End-to-End Task-Completion Neural Dialogue Systems
  3 Mar 2017 13 repositories listed Syntology ran 0 of 8 samples · 8 unverified · 5 pointer-only (licence)
  One of the major drawbacks of modularized task-completion dialogue systems is that each module is trained individually, which presents several challenges.
• Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
  9 Jun 2023 11 repositories listed Syntology ran 0 of 12 samples · 12 unverified
  Evaluating large language model (LLM) based chat assistants is challenging due to their broad capabilities and the inadequacy of existing benchmarks in measuring human preferences.
• Visual Dialog
  26 Nov 2016 11 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  We introduce the task of Visual Dialog, which requires an AI agent to hold a meaningful dialog with humans in natural, conversational language about visual content.
• Recipes for building an open-domain chatbot
  28 Apr 2020 8 repositories listed
  Building open-domain chatbots is a challenging area for machine learning research.
• Deep Reinforcement Learning for Dialogue Generation
  5 Jun 2016 8 repositories listed
  Recent neural models of dialogue generation offer great promise for generating responses for conversational agents, but tend to be shortsighted, predicting utterances one at a time while ignoring their influence on…
• Mistral 7B
  10 Oct 2023 6 repositories listed Syntology ran 9 of 11 samples · 2 unverified · 1 pointer-only (licence)
  We introduce Mistral 7B v0.
• Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
  7 Mar 2024 5 repositories listed Syntology ran 1 of 9 samples · 8 unverified
  To address this issue, we introduce Chatbot Arena, an open platform for evaluating LLMs based on human preferences.
• LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
  21 Sep 2023 5 repositories listed
  Studying how people interact with large language models (LLMs) in real-world scenarios is increasingly important due to their widespread use in various applications.
• Baize: An Open-Source Chat Model with Parameter-Efficient Tuning on Self-Chat Data
  3 Apr 2023 5 repositories listed Syntology ran 1 of 9 samples · 8 unverified · 1 pointer-only (licence)
  Furthermore, we propose a new technique called Self-Distill with Feedback, to further improve the performance of the Baize models with feedback from ChatGPT.
• From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline
  17 Jun 2024 4 repositories listed Syntology ran 18 of 21 samples · 3 unverified
  The rapid evolution of Large Language Models (LLMs) has outpaced the development of model evaluation, highlighting the need for continuous curation of new, challenging benchmarks.
• WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models
  26 Jun 2024 3 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  As WildJailbreak considerably upgrades the quality and scale of existing safety resources, it uniquely enables us to examine the scaling effects of data and the interplay of data properties and model capabilities during…
• RLHF Workflow: From Reward Modeling to Online RLHF
  13 May 2024 3 repositories listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  We present the workflow of Online Iterative Reinforcement Learning from Human Feedback (RLHF) in this technical report, which is widely reported to outperform its offline counterpart by a large margin in the recent…
• Don't Forget Your ABC's: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems
  18 Dec 2022 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Our method is used to evaluate four state-of-the-art open-domain dialogue systems and compared with existing approaches.
• PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learning
  30 Jun 2020 3 repositories listed
  To build a high-quality open-domain chatbot, we introduce the effective training process of PLATO-2 via curriculum learning.
• Subword Semantic Hashing for Intent Classification on Small Datasets
  16 Oct 2018 3 repositories listed
  In this paper, we introduce the use of Semantic Hashing as embedding for the task of Intent Classification and achieve state-of-the-art performance on three frequently used benchmarks.
• LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesis
  5 May 2025 2 repositories listed Syntology ran 8 of 11 samples · 3 unverified · 10 pointer-only (licence)
  Real-time, intelligent, and natural speech interaction is an essential part of the next-generation human-computer interaction.
• ELIZA Reanimated: The world's first chatbot restored on the world's first time sharing system
  12 Jan 2025 2 repositories listed
  The entire stack is open source, so that any user of a unix-like OS can run the world's first chatbot on the world's first time-sharing system.
• Low-code from frontend to backend: Connecting conversational user interfaces to backend services via a low-code IoT platform
  13 Sep 2024 2 repositories listed
  Current chatbot development platforms and frameworks facilitate setting up the language and dialog part of chatbots, while connecting it to backend services and business functions requires substantial manual coding…
• Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
  22 Aug 2024 2 repositories listed
  The model weights for both sizes are publicly available under the Jamba Open Model License and we release ExpertsInt8 as open source.
• SimPO: Simple Preference Optimization with a Reference-Free Reward
  23 May 2024 2 repositories listed Syntology ran 6 of 6 samples · 0 unverified
  Direct Preference Optimization (DPO) is a widely used offline preference optimization algorithm that reparameterizes reward functions in reinforcement learning from human feedback (RLHF) to enhance simplicity and…
• Using Adaptive Empathetic Responses for Teaching English
  21 Apr 2024 2 repositories listed
  Existing English-teaching chatbots rarely incorporate empathy explicitly in their feedback, but empathetic feedback could help keep students engaged and reduce learner anxiety.
• Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators
  6 Apr 2024 2 repositories listed
  Even simple, known confounders such as preference for longer outputs remain in existing automated evaluation metrics.
• Three Ways of Using Large Language Models to Evaluate Chat
  12 Aug 2023 2 repositories listed
  This paper describes the systems submitted by team6 for ChatEval, the DSTC 11 Track 4 competition.
• EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Education
  5 Aug 2023 2 repositories listed Syntology ran 7 of 9 samples · 2 unverified · 9 pointer-only (licence)
  Currently, EduChat is available online as an open-source project, with its code, data, and model parameters available on platforms (e.
• h2oGPT: Democratizing Large Language Models
  13 Jun 2023 2 repositories listed
  Applications built on top of Large Language Models (LLMs) such as GPT-4 represent a revolution in AI due to their human-level capabilities in natural language processing.
• Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue System
  4 May 2023 2 repositories listed Syntology ran 0 of 5 samples · 5 unverified
  As results of the experiment, our method shows competitive performance on the MultiWOZ benchmark compared to the existing end-to-end models.
• CHAI: A CHatbot AI for Task-Oriented Dialogue with Offline Reinforcement Learning
  18 Apr 2022 2 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  Conventionally, generation of natural language for dialogue agents may be viewed as a statistical learning problem: determine the patterns in human-provided data and generate appropriate responses with similar…
• EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Training
  17 Mar 2022 2 repositories listed Syntology ran 2 of 13 samples · 11 unverified
  Large-scale pre-training has shown remarkable performance in building open-domain dialogue systems.
• Automatic Evaluation and Moderation of Open-domain Dialogue Systems
  3 Nov 2021 2 repositories listed
  The development of Open-Domain Dialogue Systems (ODS)is a trending topic due to the large number of research challenges, large societal and business impact, and advances in the underlying technology.

Syntology lines on 17 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.