Chunking

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

5 leaderboard tables shown for this task, 5 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

5 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 120 papers with code (447 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Bidirectional LSTM-CRF Models for Sequence Tagging
  9 Aug 2015 25 repositories listed Syntology ran 0 of 8 samples · 8 unverified
  It can also use sentence level tag information thanks to a CRF layer.
• Optimal Hyperparameters for Deep LSTM-Networks for Sequence Labeling Tasks
  21 Jul 2017 6 repositories listed
  Selecting optimal parameters for a neural network architecture can often make the difference between mediocre and state-of-the-art performance.
• Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning
  8 May 2021 3 repositories listed Syntology ran 0 of 4 samples · 4 unverified
  We find empirically that the contextual representations computed on the retrieval-based input view, constructed through the concatenation of a sentence and its external contexts, can achieve significantly improved…
• NCRF++: An Open-source Neural Sequence Labeling Toolkit
  14 Jun 2018 3 repositories listed Syntology ran 1 of 9 samples · 8 unverified
  This paper describes NCRF++, a toolkit for neural sequence labeling.
• Semi-supervised Multitask Learning for Sequence Labeling
  24 Apr 2017 3 repositories listed
  We propose a sequence labeling framework with a secondary training objective, learning to predict surrounding words for every word in the dataset.
• Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Sampling
  30 Aug 2024 2 repositories listed Syntology ran 7 of 14 samples · 7 unverified · 3 pointer-only (licence)
  Predicting and executing a sequence of actions without intermediate replanning, known as action chunking, is increasingly used in robot learning from human demonstrations.
• Def2Vec: Extensible Word Embeddings from Dictionary Definitions
  16 Dec 2023 2 repositories listed
  Def2Vec introduces a novel paradigm for word embeddings, leveraging dictionary definitions to learn semantic representations.
• Building Odia Shallow Parser
  19 Apr 2022 2 repositories listed
  Shallow parsing is an essential task for many NLP applications like machine translation, summarization, sentiment analysis, aspect identification and many more.
• BERTraffic: BERT-based Joint Speaker Role and Speaker Change Detection for Air Traffic Control Communications
  12 Oct 2021 2 repositories listed
  We propose a system that combines SAD and a BERT model to perform speaker change detection and speaker role detection (SRD) by chunking ASR transcripts, i.
• Automated Concatenation of Embeddings for Structured Prediction
  10 Oct 2020 2 repositories listed
  Pretrained contextualized embeddings are powerful word representations for structured prediction tasks.
• Capturing Global Informativeness in Open Domain Keyphrase Extraction
  28 Apr 2020 2 repositories listed
  Open-domain KeyPhrase Extraction (KPE) aims to extract keyphrases from documents without domain or quality restrictions, e.
• Design Challenges and Misconceptions in Neural Sequence Labeling
  12 Jun 2018 2 repositories listed
  We investigate the design challenges of constructing effective and efficient neural sequence labeling systems, by reproducing twelve neural sequence labeling models, which include most of the state-of-the-art…
• A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Tasks
  5 Nov 2016 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Transfer and multi-task learning have traditionally focused on either a single source-target pair or very few, similar tasks.
• Natural Language Processing (almost) from Scratch
  2 Mar 2011 2 repositories listed
  We propose a unified neural network architecture and learning algorithm that can be applied to various natural language processing tasks including: part-of-speech tagging, chunking, named entity recognition, and…
• cAST: Enhancing Code Retrieval-Augmented Generation with Structural Chunking via Abstract Syntax Tree
  18 Jun 2025 1 repository listed
  Retrieval-Augmented Generation (RAG) has become essential for large-scale code generation, grounding predictions in external code corpora to improve actuality.
• TableRAG: A Retrieval Augmented Generation Framework for Heterogeneous Document Reasoning
  12 Jun 2025 1 repository listed
  Retrieval-Augmented Generation (RAG) has demonstrated considerable effectiveness in open-domain question answering.
• Real-Time Execution of Action Chunking Flow Policies
  9 Jun 2025 1 repository listed Syntology ran 0 of 2 samples · 2 unverified
  Modern AI systems, especially those interacting with the physical world, increasingly require real-time performance.
• Dynamic Chunking and Selection for Reading Comprehension of Ultra-Long Context in Large Language Models
  1 Jun 2025 1 repository listed Syntology ran 9 of 9 samples · 0 unverified · 9 pointer-only (licence)
  To overcome this limitation, we propose a straightforward approach for dynamically separating and selecting chunks of long context, facilitating a more streamlined input for LLMs.
• Context is Gold to find the Gold Passage: Evaluating and Training Contextual Document Embeddings
  30 May 2025 1 repository listed
  A limitation of modern document retrieval embedding methods is that they typically encode passages (chunks) from the same documents independently, often overlooking crucial contextual information from the rest of the…
• Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysis
  27 May 2025 1 repository listed
  Our experiments, conducted on both short-form and long-form datasets, reveal that chunk size plays a critical role in retrieval effectiveness -- smaller chunks (64-128 tokens) are optimal for datasets with concise,…
• NeuSym-RAG: Hybrid Neural Symbolic Retrieval with Multiview Structuring for PDF Question Answering
  26 May 2025 1 repository listed
  The increasing number of academic papers poses significant challenges for researchers to efficiently acquire key details.
• ALTo: Adaptive-Length Tokenizer for Autoregressive Mask Generation
  22 May 2025 1 repository listed
  While humans effortlessly draw visual objects and shapes by adaptively allocating attention based on their complexity, existing multimodal large language models (MLLMs) remain constrained by rigid token representations.
• Reconstructing Context: Evaluating Advanced Chunking Strategies for Retrieval-Augmented Generation
  28 Apr 2025 1 repository listed
  In contrast, late chunking offers higher efficiency but tends to sacrifice relevance and completeness.
• FlexChunk: Enabling 100M×100M Out-of-Core SpMV (~1.8 min, ~1.7 GB RAM) with Near-Linear Scaling
  5 Apr 2025 1 repository listed
  Handling large-scale sparse matrices is a fundamental task in many scientific and engineering domains, yet standard in-memory approaches often hit the limitations of available RAM.
• Text Chunking for Document Classification for Urban System Management using Large Language Models
  31 Mar 2025 1 repository listed
  Urban systems are managed using complex textual documentation that need coding and analysis to set requirements and evaluate built environment performance.
• AIstorian lets AI be a historian: A KG-powered multi-agent system for accurate biography generation
  14 Mar 2025 1 repository listed
  Huawei has always been committed to exploring the AI application in historical research.
• MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation System
  12 Mar 2025 1 repository listed
  Retrieval-Augmented Generation (RAG), while serving as a viable complement to large language models (LLMs), often overlooks the crucial aspect of text chunking within its pipeline.
• TimeLoc: A Unified End-to-End Framework for Precise Timestamp Localization in Long Videos
  9 Mar 2025 1 repository listed
  Temporal localization in untrimmed videos, which aims to identify specific timestamps, is crucial for video understanding but remains challenging.
• KidneyTalk-open: No-code Deployment of a Private Large Language Model with Medical Documentation-Enhanced Knowledge Database for Kidney Disease
  6 Mar 2025 1 repository listed
  Privacy-preserving medical decision support for kidney disease requires localized deployment of large language models (LLMs) while maintaining clinical reasoning capabilities.
• Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
  27 Feb 2025 1 repository listed Syntology ran 4 of 4 samples · 0 unverified
  In real-world evaluations, our fine-tuning recipe enables OpenVLA to successfully execute dexterous, high-frequency control tasks on a bimanual ALOHA robot and outperform other VLAs (π₀ and RDT-1B) fine-tuned using…

Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.