Intent Recognition

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

4 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

22 shown of 22 papers with code (93 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Scaling Language Models: Methods, Analysis & Insights from Training Gopher
  8 Dec 2021 3 repositories listed
  Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.
• Training Compute-Optimal Large Language Models
  29 Mar 2022 2 repositories listed Syntology ran 8 of 11 samples · 3 unverified · 4 pointer-only (licence)
  We investigate the optimal model size and number of tokens for training a transformer language model under a given compute budget.
• Call Larisa Ivanovna: Code-Switching Fools Multilingual NLU Models
  29 Sep 2021 2 repositories listed
  This is in line with the common understanding of how multilingual models conduct transferring between languages
• TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognition
  13 Sep 2021 2 repositories listed
  It is composed of two main modules: open intent detection and open intent discovery.
• Understanding and Enhancing the Transferability of Jailbreaking Attacks
  5 Feb 2025 1 repository listed Syntology ran 0 of 4 samples · 4 unverified
  By incorporating adversarial sequences, these attacks can redirect the source LLM's focus away from malicious-intent tokens in the original input, thereby obstructing the model's intent recognition and eliciting harmful…
• Large Language Models for Power Scheduling: A User-Centric Approach
  29 Jun 2024 1 repository listed
  While traditional optimization and scheduling schemes are designed to meet fixed, predefined system requirements, future systems are moving toward user-driven approaches and personalized services, aiming to achieve high…
• CoXQL: A Dataset for Parsing Explanation Requests in Conversational XAI Systems
  12 Jun 2024 1 repository listed
  Conversational explainable artificial intelligence (ConvXAI) systems based on large language models (LLMs) have garnered significant interest from the research community in natural language processing (NLP) and…
• MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversations
  16 Mar 2024 1 repository listed Syntology ran 2 of 6 samples · 4 unverified · 6 pointer-only (licence)
  We believe that MIntRec2.
• Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varieties
  3 Feb 2024 1 repository listed
  Inspired by prior work on English varieties, we craft and manually evaluate perturbation rules that transform German sentences into colloquial forms and use them to synthesize test sets in four ToD datasets.
• LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tools and Self-Explanations
  23 Jan 2024 1 repository listed
  Interpretability tools that offer explanations in the form of a dialogue have demonstrated their efficacy in enhancing users' understanding (Slack et al., 2023; Shen et al., 2023), as one-off explanations may fall short…
• Yes, this is what I was looking for! Towards Multi-modal Medical Consultation Concern Summary Generation
  10 Jan 2024 1 repository listed
  Over the past few years, the use of the Internet for healthcare-related tasks has grown by leaps and bounds, posing a challenge in effectively managing and processing information to ensure its efficient utilization.
• Token-Level Contrastive Learning with Modality-Aware Prompting for Multimodal Intent Recognition
  22 Dec 2023 1 repository listed Syntology ran 5 of 8 samples · 3 unverified
  To establish an optimal multimodal semantic environment for text modality, we develop a modality-aware prompting module (MAP), which effectively aligns and fuses features from text, video and audio modalities with…
• Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models
  20 Oct 2023 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  We propose a framework that allows reducing the calls to LLMs by caching previous LLM responses and using them to train a local inexpensive model on the SME side.
• Continual Generalized Intent Discovery: Marching Towards Dynamic and Open-world Intent Recognition
  16 Oct 2023 1 repository listed
  In a practical dialogue system, users may input out-of-domain (OOD) queries.
• MIntRec: A New Dataset for Multimodal Intent Recognition
  9 Sep 2022 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  This paper introduces a novel dataset for multimodal intent recognition (MIntRec) to address this issue.
• New Intent Discovery with Pre-training and Contrastive Learning
  25 May 2022 1 repository listed
  Existing approaches typically rely on a large amount of labeled utterances and employ pseudo-labeling methods for representation learning and clustering, which are label-intensive, inefficient, and inaccurate.
• When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
  24 May 2022 1 repository listed
  Rejecting class imbalance as the sole culprit, we reveal that the trend is closely associated with an effect we call source signal dilution, where strong lexical cues for the new symbol become diluted as the training…
• Developing a Chatbot system using Deep Learning based for Universities consultancy
  28 Feb 2022 1 repository listed
  Besides, we use the Deep Reinforcement Learning architecture to train an Agent for Dialogue Management task.
• Representation based meta-learning for few-shot spoken intent recognition
  29 Jun 2021 1 repository listed
  Spoken intent detection has become a popular approach to interface with various smart devices with ease.
• Are Pretrained Transformers Robust in Intent Classification? A Missing Ingredient in Evaluation of Out-of-Scope Intent Detection
  8 Jun 2021 1 repository listed
  Pre-trained Transformer-based models were reported to be robust in intent classification.
• Continual Learning in Task-Oriented Dialogue Systems
  31 Dec 2020 1 repository listed
  Continual learning in task-oriented dialogue systems can allow us to add new domains and functionalities through time without incurring the high cost of a whole system retraining.
• Do We Need Online NLU Tools?
  19 Nov 2020 1 repository listed
  In this paper, we suggest criteria to choose the best intent recognition algorithm for an application.

Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.