text annotation

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

6 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 39 papers with code (127 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• A Bilingual, OpenWorld Video Text Dataset and End-to-end Video Text Spotter with Transformer
  9 Dec 2021 3 repositories listed Syntology ran 16 of 19 samples · 3 unverified · 19 pointer-only (licence)
  Most existing video text spotting benchmarks focus on evaluating a single language and scenario with limited data.
• Text-guided Foundation Model Adaptation for Pathological Image Classification
  27 Jul 2023 2 repositories listed
  In this paper, we propose to Connect Image and Text Embeddings (CITE) to enhance pathological image classification.
• How to use LLMs for Text Analysis
  24 Jul 2023 2 repositories listed
  This guide introduces Large Language Models (LLM) as a highly versatile text analysis method within the social sciences.
• Patent Sentiment Analysis to Highlight Patent Paragraphs
  6 Nov 2021 2 repositories listed
  The contributions of this work are: i) we developed a multi-class, novel dataset of size 150k samples by traversing USPTO patents over a decade, ii) articulated statistics and distributions of data using imperative…
• Open Images V5 Text Annotation and Yet Another Mask Text Spotter
  23 Jun 2021 2 repositories listed
  A large scale human-labeled dataset plays an important role in creating high quality deep learning models.
• Marvin: Semantic annotation using multiple knowledge sources
  1 Feb 2016 2 repositories listed
  People are producing more written material then anytime in the history.
• EduCoder: An Open-Source Annotation System for Education Transcript Data
  7 Jul 2025 1 repository listed
  We introduce EduCoder, a domain-specialized tool designed to support utterance-level annotation of educational dialogue.
• Probably Approximately Correct Labels
  12 Jun 2025 1 repository listed Syntology ran 1 of 4 samples · 3 unverified · 4 pointer-only (licence)
  Obtaining high-quality labeled datasets is often costly, requiring either extensive human annotation or expensive experiments.
• AvatarShield: Visual Reinforcement Learning for Human-Centric Video Forgery Detection
  21 May 2025 1 repository listed
  The rapid advancement of Artificial Intelligence Generated Content (AIGC) technologies, particularly in video generation, has led to unprecedented creative capabilities but also increased threats to information…
• Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data
  15 May 2025 1 repository listed
  In the era of increasingly sophisticated natural language processing (NLP) systems, large language models (LLMs) have demonstrated remarkable potential for diverse applications, including tasks requiring nuanced textual…
• It's a (Blind) Match! Towards Vision-Language Correspondence without Parallel Data
  31 Mar 2025 1 repository listed Syntology ran 0 of 5 samples · 5 unverified
  This suggests that as foundation models mature, it may become possible to match vision and language embeddings in a fully unsupervised fashion, i.
• GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Models
  2 Jan 2025 1 repository listed Syntology ran 1 of 8 samples · 7 unverified
  To address this, we introduce GPT4Scene, a novel visual prompting paradigm in VLM training and inference that helps build the global-local relationship, significantly improving the 3D spatial understanding of indoor…
• Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularity
  9 Dec 2024 1 repository listed Syntology ran 5 of 7 samples · 2 unverified
  For efficient anomaly detection in long videos, we propose the Anomaly-focused Temporal Sampler (ATS).
• VERIFIED: A Video Corpus Moment Retrieval Benchmark for Fine-Grained Video Understanding
  11 Oct 2024 1 repository listed
  In this paper, we propose a more challenging fine-grained VCMR benchmark requiring methods to localize the best-matched moment from the corpus with other partially matched candidates.
• COMMENTATOR: A Code-mixed Multilingual Text Annotation Framework
  6 Aug 2024 1 repository listed Syntology ran 2 of 14 samples · 12 unverified
  As the NLP community increasingly addresses challenges associated with multilingualism, robust annotation tools are essential to handle multilingual datasets efficiently.
• BUSClean: Open-source software for breast ultrasound image pre-processing and knowledge extraction for medical AI
  16 Jul 2024 1 repository listed
  Adaptation of the lesion caliper detection method to account for a type of caliper specific to the case study demonstrates the intended use of BUSClean in new data distributions and improved performance in lesion…
• Chatbots Are Not Reliable Text Annotators
  9 Nov 2023 1 repository listed
  Recent research highlights the significant potential of ChatGPT for text annotation in social science research.
• CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation
  24 Oct 2023 1 repository listed Syntology ran 3 of 5 samples · 2 unverified · 5 pointer-only (licence)
  Annotated data plays a critical role in Natural Language Processing (NLP) in training models and evaluating their performance.
• LLM-in-the-loop: Leveraging Large Language Model for Thematic Analysis
  23 Oct 2023 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Thematic analysis (TA) has been widely used for analyzing qualitative data in many disciplines and fields.
• Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset
  3 Jul 2023 1 repository listed
  In this paper, we present Motion-X, a large-scale 3D expressive whole-body motion dataset.
• High-Fidelity 3D Face Generation from Natural Language Descriptions
  5 May 2023 1 repository listed
  Synthesizing high-quality 3D face models from natural language descriptions is very valuable for many applications, including avatar creation, virtual reality, and telepresence.
• ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks
  27 Mar 2023 1 repository listed
  Many NLP applications require manual data annotations for a variety of tasks, notably to train classifiers or evaluate the performance of unsupervised models.
• POTATO: The Portable Text Annotation Tool
  16 Dec 2022 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  We present POTATO, the Portable text annotation tool, a free, fully open-sourced annotation system that 1) supports labeling many types of text and multimodal data; 2) offers easy-to-configure features to maximize the…
• Measuring Annotator Agreement Generally across Complex Structured, Multi-object, and Free-text Annotation Tasks
  15 Dec 2022 1 repository listed
  When annotators label data, a key metric for quality assurance is inter-annotator agreement (IAA): the extent to which annotators agree on their labels.
• FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversion
  27 Oct 2022 1 repository listed
  Voice conversion (VC) can be achieved by first extracting source content information and target speaker information, and then reconstructing waveform with these information.
• HumSet: Dataset of Multilingual Information Extraction and Classification for Humanitarian Crisis Response
  10 Oct 2022 1 repository listed
  Timely and effective response to humanitarian crises requires quick and accurate analysis of large amounts of text data - a process that can highly benefit from expert-assisted NLP systems trained on validated and…
• SciAnnotate: A Tool for Integrating Weak Labeling Sources for Sequence Labeling
  7 Aug 2022 1 repository listed
  Compared to frequently used text annotation tools, our annotation tool allows for the development of weak labels in addition to providing a manual annotation experience.
• LViT: Language meets Vision Transformer in Medical Image Segmentation
  29 Jun 2022 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  In our LViT model, medical text annotation is incorporated to compensate for the quality deficiency in image data.
• Fine-grained Image Captioning with CLIP Reward
  26 May 2022 1 repository listed
  Toward more descriptive and distinctive caption generation, we propose using CLIP, a multimodal encoder trained on huge image-text pairs from web, to calculate multimodal similarity and use it as a reward function.
• DoTAT: A Domain-oriented Text Annotation Tool
  1 May 2022 1 repository listed
  Secondly, the tool provides annotation of events, nested event and nested entity, which are frequently required in domain-related text structuring tasks.

Syntology lines on 10 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.