Intent Classification

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

14 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 113 papers with code (344 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• BERT for Joint Intent Classification and Slot Filling
  28 Feb 2019 16 repositories listed Syntology ran 9 of 32 samples · 23 unverified · 3 pointer-only (licence)
  Intent classification and slot filling are two essential tasks for natural language understanding.
• Benchmarking Natural Language Understanding Services for building Conversational Agents
  13 Mar 2019 9 repositories listed
  We have recently seen the emergence of several publicly available Natural Language Understanding (NLU) toolkits, which map user utterances to structured, but more abstract, Dialogue Act (DA) or Intent specifications,…
• MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages
  18 Apr 2022 6 repositories listed Syntology ran 1 of 10 samples · 9 unverified · 1 pointer-only (licence)
  We present the MASSIVE dataset--Multilingual Amazon Slu resource package (SLURP) for Slot-filling, Intent classification, and Virtual assistant Evaluation.
• Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling
  6 Sep 2016 6 repositories listed Syntology ran 2 of 5 samples · 3 unverified · 2 pointer-only (licence)
  Attention-based encoder-decoder neural network models have recently shown promising results in machine translation and speech recognition.
• ConveRT: Efficient and Accurate Conversational Representations from Transformers
  9 Nov 2019 5 repositories listed Syntology ran 0 of 9 samples · 9 unverified
  General-purpose pretrained sentence encoders such as BERT are not ideal for real-world conversational AI applications; they are computationally heavy, slow, and expensive to train.
• An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction
  4 Sep 2019 5 repositories listed
  We find that while the classifiers perform well on in-scope intent classification, they struggle to identify out-of-scope queries.
• Induction Networks for Few-Shot Text Classification
  27 Feb 2019 5 repositories listed
  Therefore, we should be able to learn a general representation of each class in the support set and then compare it to new queries.
• Efficient Sequence Transduction by Jointly Predicting Tokens and Durations
  13 Apr 2023 4 repositories listed Syntology ran 1 of 2 samples · 1 unverified
  TDT models for Speech Recognition achieve better accuracy and up to 2.
• End-to-End Slot Alignment and Recognition for Cross-Lingual NLU
  29 Apr 2020 3 repositories listed
  We introduce MultiATIS++, a new multilingual NLU corpus that extends the Multilingual ATIS corpus to nine languages across four language families, and evaluate our method using the corpus.
• Subword Semantic Hashing for Intent Classification on Small Datasets
  16 Oct 2018 3 repositories listed
  In this paper, we introduce the use of Semantic Hashing as embedding for the task of Intent Classification and achieve state-of-the-art performance on three frequently used benchmarks.
• Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Models
  13 Dec 2023 2 repositories listed
  Most assume that catastrophic forgetting is the biggest obstacle to achieving superior IL performance and propose various techniques to overcome this issue.
• ChatGPT to Replace Crowdsourcing of Paraphrases for Intent Classification: Higher Diversity and Comparable Model Robustness
  22 May 2023 2 repositories listed
  The emergence of generative large language models (LLMs) raises the question: what will be its impact on crowdsourcing?
• Z-BERT-A: a zero-shot Pipeline for Unknown Intent detection
  15 Aug 2022 2 repositories listed
  In our evaluation, we first analyze the quality of the model after adaptive fine-tuning on known classes.
• Finstreder: Simple and fast Spoken Language Understanding with Finite State Transducers using modern Speech-to-Text models
  29 Jun 2022 2 repositories listed
  In Spoken Language Understanding (SLU) the task is to extract important information from audio commands, like the intent of what a user wants the system to do and special entities like locations or numbers.
• Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System
  29 Sep 2021 2 repositories listed Syntology ran 0 of 10 samples · 10 unverified
  Pre-trained language models have been recently shown to benefit task-oriented dialogue (TOD) systems.
• CAPE: Context-Aware Private Embeddings for Private Language Learning
  27 Aug 2021 2 repositories listed
  Deep learning-based language models have achieved state-of-the-art results in a number of applications including sentiment analysis, topic labelling, intent classification and others.
• CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark
  15 Jun 2021 2 repositories listed Syntology ran 4 of 16 samples · 12 unverified
  Artificial Intelligence (AI), along with the recent progress in biomedical language understanding, is gradually changing medical practice.
• From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding
  15 May 2021 2 repositories listed
  To tackle the challenge, we propose a joint learning approach, with English SLU training data and non-English auxiliary tasks from raw text, syntax and translation for transfer.
• Diverse Few-Shot Text Classification with Multiple Metrics
  19 May 2018 2 repositories listed Syntology ran 5 of 5 samples · 0 unverified
  We study few-shot learning in natural language domains.
• The First Evaluation of Chinese Human-Computer Dialogue Technology
  29 Sep 2017 2 repositories listed
  In this paper, we introduce the first evaluation of Chinese human-computer dialogue technology.
• Leveraging GANs for citation intent classification and its impact on citation network analysis
  27 May 2025 1 repository listed
  In this paper, we adopted a GAN-based method to classify citation intents.
• TestNUC: Enhancing Test-Time Computing Approaches through Neighboring Unlabeled Data Consistency
  26 Feb 2025 1 repository listed
  Test-time computing approaches, which leverage additional computational resources during inference, have been proven effective in enhancing large language model performance.
• Exploring Robustness of Multilingual LLMs on Real-World Noisy Data
  14 Jan 2025 1 repository listed
  In particular, mT5 (13B), was the most robust on average overall, across the 3 tasks, and in 4 of the 6 languages.
• Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding
  13 Jan 2025 1 repository listed
  However, This method is not suitable for simultaneous speech recognition and understanding.
• Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language Understanding
  10 Jan 2025 1 repository listed
  While recent multilingual automatic speech recognition models claim to support thousands of languages, ASR for low-resource languages remains highly unreliable due to limited bimodal speech and text training data.
• Improving Dialectal Slot and Intent Detection with Auxiliary Tasks: A Multi-Dialectal Bavarian Case Study
  7 Jan 2025 1 repository listed
  Reliable slot and intent detection (SID) is crucial in natural language understanding for applications like digital assistants.
• Multi-Granularity Open Intent Classification via Adaptive Granular-Ball Decision Boundary
  18 Dec 2024 1 repository listed
  To tackle these issues, we propose a Multi-granularity Open intent classification method via adaptive Granular-Ball decision boundary (MOGB).
• Predicting User Intents and Musical Attributes from Music Discovery Conversations
  19 Nov 2024 1 repository listed
  Intent classification is a text understanding task that identifies user needs from input text queries.
• A new approach for fine-tuning sentence transformers for intent classification and out-of-scope detection tasks
  17 Oct 2024 1 repository listed
  One of the most accurate approaches for out-of-scope (OOS) rejection is to combine it with the task of intent classification on in-scope queries, and to use methods based on the similarity of embeddings produced by…
• Are Large Language Models Good Classifiers? A Study on Edit Intent Classification in Scientific Document Revisions
  2 Oct 2024 1 repository listed
  We instantiate this framework in edit intent classification (EIC), a challenging and underexplored classification task.

Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.