Token Classification

Benchmarks archive 2025-07-28

18 leaderboard tables shown for this task, 0 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 18 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

15 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

2 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 47 papers with code (100 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• LettuceDetect: A Hallucination Detection Framework for RAG Applications
  24 Feb 2025 2 repositories listed
  Retrieval Augmented Generation (RAG) systems remain vulnerable to hallucinated answers despite incorporating external knowledge sources.
• LettuceDetect: A Hallucination Detection Framework for RAG Applications
  24 Feb 2025 2 repositories listed
  Retrieval Augmented Generation (RAG) systems remain vulnerable to hallucinated answers despite incorporating external knowledge sources.
• POS-tagging to highlight the skeletal structure of sentences
  21 Nov 2024 2 repositories listed
  This study presents the development of a part-of-speech (POS) tagging model to extract the skeletal structure of sentences using transfer learning with the BERT architecture for token classification.
• POS-tagging to highlight the skeletal structure of sentences
  21 Nov 2024 2 repositories listed
  This study presents the development of a part-of-speech (POS) tagging model to extract the skeletal structure of sentences using transfer learning with the BERT architecture for token classification.
• Embedded Named Entity Recognition using Probing Classifiers
  18 Mar 2024 2 repositories listed Syntology ran 4 of 5 samples · 1 unverified · 5 pointer-only (licence)
  Streaming text generation has become a common way of increasing the responsiveness of language model powered applications, such as chat assistants.
• Embedded Named Entity Recognition using Probing Classifiers
  18 Mar 2024 2 repositories listed Syntology ran 4 of 5 samples · 1 unverified · 5 pointer-only (licence)
  Streaming text generation has become a common way of increasing the responsiveness of language model powered applications, such as chat assistants.
• Evaluating Named Entity Recognition: A comparative analysis of mono- and multilingual transformer models on a novel Brazilian corporate earnings call transcripts dataset
  18 Mar 2024 2 repositories listed
  Our findings provide insights into the differing performance of BERT- and T5-based models for the NER task.
• Evaluating Named Entity Recognition: A comparative analysis of mono- and multilingual transformer models on a novel Brazilian corporate earnings call transcripts dataset
  18 Mar 2024 2 repositories listed
  Our findings provide insights into the differing performance of BERT- and T5-based models for the NER task.
• Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction
  17 Oct 2023 2 repositories listed
  However, BIO-tagging scheme relies on the correct order of model inputs, which is not guaranteed in real-world NER on scanned VrDs where text are recognized and arranged by OCR systems.
• Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction
  17 Oct 2023 2 repositories listed
  However, BIO-tagging scheme relies on the correct order of model inputs, which is not guaranteed in real-world NER on scanned VrDs where text are recognized and arranged by OCR systems.
• Label Supervised LLaMA Finetuning
  2 Oct 2023 2 repositories listed
  We evaluate this approach with Label Supervised LLaMA (LS-LLaMA), based on LLaMA-2-7B, a relatively small-scale LLM, and can be finetuned on a single GeForce RTX4090 GPU.
• Label Supervised LLaMA Finetuning
  2 Oct 2023 2 repositories listed
  We evaluate this approach with Label Supervised LLaMA (LS-LLaMA), based on LLaMA-2-7B, a relatively small-scale LLM, and can be finetuned on a single GeForce RTX4090 GPU.
• Retrieval Augmented Generation using Engineering Design Knowledge
  13 Jul 2023 2 repositories listed
  For this task, we create a dataset of 375, 084 examples and fine-tune language models for relation identification (token classification) and elicitation (sequence-to-sequence).
• Retrieval Augmented Generation using Engineering Design Knowledge
  13 Jul 2023 2 repositories listed
  For this task, we create a dataset of 375, 084 examples and fine-tune language models for relation identification (token classification) and elicitation (sequence-to-sequence).
• Technical Report: Impact of Position Bias on Language Models in Token Classification
  26 Apr 2023 2 repositories listed
  Therefore, we conduct an in-depth evaluation of the impact of position bias on the performance of LMs when fine-tuned on token classification benchmarks.
• Technical Report: Impact of Position Bias on Language Models in Token Classification
  26 Apr 2023 2 repositories listed
  Therefore, we conduct an in-depth evaluation of the impact of position bias on the performance of LMs when fine-tuned on token classification benchmarks.
• Detecting Label Errors in Token Classification Data
  8 Oct 2022 2 repositories listed Syntology ran 0 of 12 samples · 12 unverified
  Mislabeled examples are a common issue in real-world data, particularly for tasks like token classification where many labels must be chosen on a fine-grained basis.
• WangchanBERTa: Pretraining transformer-based Thai Language Models
  24 Jan 2021 2 repositories listed
  However, for a relatively low-resource language such as Thai, the choices of models are limited to training a BERT-based model based on a much smaller dataset or finetuning multi-lingual models, both of which yield…
• WangchanBERTa: Pretraining transformer-based Thai Language Models
  24 Jan 2021 2 repositories listed
  However, for a relatively low-resource language such as Thai, the choices of models are limited to training a BERT-based model based on a much smaller dataset or finetuning multi-lingual models, both of which yield…
• The Devil Is in the Word Alignment Details: On Translation-Based Cross-Lingual Transfer for Token Classification Tasks
  15 May 2025 1 repository listed
  In this work, we revisit WAs for label projection, systematically investigating the effects of low-level design decisions on token-level XLT: (i) the algorithm for projecting labels between (multi-)token spans, (ii)…
• The Devil Is in the Word Alignment Details: On Translation-Based Cross-Lingual Transfer for Token Classification Tasks
  15 May 2025 1 repository listed
  In this work, we revisit WAs for label projection, systematically investigating the effects of low-level design decisions on token-level XLT: (i) the algorithm for projecting labels between (multi-)token spans, (ii)…
• Beyond Next-Token: Next-X Prediction for Autoregressive Visual Generation
  27 Feb 2025 1 repository listed
  In this paper, we propose xAR, a generalized AR framework that extends the notion of a token to an entity X, which can represent an individual patch token, a cell (a k×k grouping of neighboring patches), a subsample (a…
• Beyond Next-Token: Next-X Prediction for Autoregressive Visual Generation
  27 Feb 2025 1 repository listed
  In this paper, we propose xAR, a generalized AR framework that extends the notion of a token to an entity X, which can represent an individual patch token, a cell (a k×k grouping of neighboring patches), a subsample (a…
• AutoTrain: No-code training for state-of-the-art models
  21 Oct 2024 1 repository listed
  AutoTrain Advanced is an open-source library providing best practices for training models on custom datasets.
• AutoTrain: No-code training for state-of-the-art models
  21 Oct 2024 1 repository listed
  AutoTrain Advanced is an open-source library providing best practices for training models on custom datasets.
• ChuLo: Chunk-Level Key Information Representation for Long Document Processing
  14 Oct 2024 1 repository listed
  We evaluate our method on multiple long document classification tasks and long document token classification tasks, demonstrating its effectiveness through comprehensive qualitative and quantitative analyses.
• ChuLo: Chunk-Level Key Information Representation for Long Document Processing
  14 Oct 2024 1 repository listed
  We evaluate our method on multiple long document classification tasks and long document token classification tasks, demonstrating its effectiveness through comprehensive qualitative and quantitative analyses.
• GUS-Net: Social Bias Classification in Text with Generalizations, Unfairness, and Stereotypes
  10 Oct 2024 1 repository listed
  The detection of bias in natural language processing (NLP) is a critical challenge, particularly with the increasing use of large language models (LLMs) in various domains.
• GUS-Net: Social Bias Classification in Text with Generalizations, Unfairness, and Stereotypes
  10 Oct 2024 1 repository listed
  The detection of bias in natural language processing (NLP) is a critical challenge, particularly with the increasing use of large language models (LLMs) in various domains.
• Acquiring Bidirectionality via Large and Small Language Models
  19 Aug 2024 1 repository listed
  Using token representation from bidirectional language models (LMs) such as BERT is still a widely used approach for token-classification tasks.

Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.