document understanding

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 140 papers with code (309 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
  29 Dec 2020 9 repositories listed
  Pre-training of text and layout has proved effective in a variety of visually-rich document understanding tasks due to its effective model architecture and the advantage of large-scale unlabeled scanned/digital-born…
• LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
  18 Apr 2021 6 repositories listed
  In this paper, we present LayoutXLM, a multimodal pre-trained model for multilingual document understanding, which aims to bridge the language barriers for visually-rich document understanding.
• ColPali: Efficient Document Retrieval with Vision Language Models
  27 Jun 2024 5 repositories listed Syntology ran 2 of 4 samples · 2 unverified
  Documents are visually rich structures that convey information through text, but also figures, page layouts, tables, or even fonts.
• Unifying Vision, Text, and Layout for Universal Document Processing
  5 Dec 2022 5 repositories listed Syntology ran 4 of 17 samples · 13 unverified · 3 pointer-only (licence)
  UDOP leverages the spatial correlation between textual content and document image to model image, text, and layout modalities with one uniform representation.
• LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding
  28 Feb 2022 5 repositories listed Syntology ran 2 of 3 samples · 1 unverified
  LiLT can be pre-trained on the structured documents of a single language and then directly fine-tuned on other languages with the corresponding off-the-shelf monolingual/multilingual pre-trained textual models.
• OCR-free Document Understanding Transformer
  30 Nov 2021 5 repositories listed Syntology ran 0 of 9 samples · 9 unverified
  Current Visual Document Understanding (VDU) methods outsource the task of reading text to off-the-shelf Optical Character Recognition (OCR) engines and focus on the understanding task with the OCR outputs.
• Chargrid: Towards Understanding 2D Documents
  24 Sep 2018 5 repositories listed
  We introduce a novel type of text representation that preserves the 2D layout of a document.
• Qwen2.5-VL Technical Report
  19 Feb 2025 4 repositories listed Syntology ran 2 of 3 samples · 1 unverified
  We introduce Qwen2.
• ICDAR 2021 Competition on Scientific Literature Parsing
  8 Jun 2021 3 repositories listed Syntology ran 3 of 8 samples · 5 unverified · 1 pointer-only (licence)
  Scientific literature contain important information related to cutting-edge innovations in diverse domains.
• Learned Compression for Compressed Learning
  12 Dec 2024 2 repositories listed
  Linear transform coding and end-to-end learned compression systems reduce bitrate, but do not uniformly reduce dimensionality; thus, they do not meaningfully increase efficiency.
• DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
  16 Oct 2024 2 repositories listed
  Pre-training on the resulting DocSynth-300K dataset significantly improves fine-tuning performance across various document types.
• LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understanding
  8 Apr 2024 2 repositories listed Syntology ran 1 of 2 samples · 1 unverified
  The core of LayoutLLM is a layout instruction tuning strategy, which is specially designed to enhance the comprehension and utilization of document layouts.
• On the Affinity, Rationality, and Diversity of Hierarchical Topic Modeling
  25 Jan 2024 2 repositories listed Syntology ran 7 of 10 samples · 3 unverified · 6 pointer-only (licence)
  Hierarchical topic modeling aims to discover latent topics from a corpus and organize them into a hierarchy to understand documents with desirable semantic granularity.
• PaLI-X: On Scaling up a Multilingual Vision and Language Model
  29 May 2023 2 repositories listed Syntology ran 6 of 7 samples · 1 unverified
  We present the training recipe and results of scaling up PaLI-X, a multilingual vision and language model, both in terms of size of the components and the breadth of its training task mixture.
• ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding
  12 Oct 2022 2 repositories listed Syntology ran 2 of 7 samples · 5 unverified
  Recent years have witnessed the rise and success of pre-training techniques in visually-rich document understanding.
• End-to-end Document Recognition and Understanding with Dessurt
  30 Mar 2022 2 repositories listed Syntology ran 0 of 11 samples · 11 unverified
  Dessurt is a more flexible model than prior methods and is able to handle a variety of document domains and tasks.
• MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
  16 Oct 2021 2 repositories listed
  Multimodal pre-training with text, layout, and image has made significant progress for Visually Rich Document Understanding (VRDU), especially the fixed-layout documents such as scanned document images.
• Message Passing Attention Networks for Document Understanding
  17 Aug 2019 2 repositories listed
  In this paper, we represent documents as word co-occurrence networks and propose an application of the message passing framework to NLP, the Message Passing Attention network for Document understanding (MPAD).
• PaddleOCR 3.0 Technical Report
  8 Jul 2025 1 repository listed
  This technical report introduces PaddleOCR 3.
• GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
  1 Jul 2025 1 repository listed Syntology ran 0 of 11 samples · 11 unverified
  In a comprehensive evaluation across 28 public benchmarks, our model outperforms Qwen2.
• Class-Agnostic Region-of-Interest Matching in Document Images
  26 Jun 2025 1 repository listed
  Document understanding and analysis have received a lot of attention due to their widespread application.
• DrishtiKon: Multi-Granular Visual Grounding for Text-Rich Document Images
  26 Jun 2025 1 repository listed
  Visual grounding in text-rich document images is a critical yet underexplored challenge for document intelligence and visual question answering (VQA) systems.
• PP-DocBee2: Improved Baselines with Efficient Data for Multimodal Document Understanding
  22 Jun 2025 1 repository listed
  This report introduces PP-DocBee2, an advanced version of the PP-DocBee, designed to enhance multimodal document understanding.
• SimpleDoc: Multi-Modal Document Understanding with Dual-Cue Page Retrieval and Iterative Refinement
  16 Jun 2025 1 repository listed Syntology ran 0 of 11 samples · 11 unverified · 11 pointer-only (licence)
  Document Visual Question Answering (DocVQA) is a practical yet challenging task, which is to ask questions based on documents while referring to multiple pages and different modalities of information, e.
• LEMONADE: A Large Multilingual Expert-Annotated Abstractive Event Dataset for the Real World
  1 Jun 2025 1 repository listed
  This paper presents LEMONADE, a large-scale conflict event dataset comprising 39, 786 events across 20 languages and 171 countries, with extensive coverage of region-specific entities.
• Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
  1 Jun 2025 1 repository listed
  Automated parsing of scanned documents into richly structured, machine-readable formats remains a critical bottleneck in Document AI, as traditional multi-stage pipelines suffer from error propagation and limited…
• ARB: A Comprehensive Arabic Multimodal Reasoning Benchmark
  22 May 2025 1 repository listed
  As Large Multimodal Models (LMMs) become more capable, there is growing interest in evaluating their reasoning processes alongside their final outputs.
• Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding
  8 May 2025 1 repository listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  This field poses significant challenges due to the need for effective integration of visual perception and textual comprehension, particularly across diverse document types with complex layouts.
• FRAG: Frame Selection Augmented Generation for Long Video and Long Document Understanding
  24 Apr 2025 1 repository listed
  However, the model size and performance of these long context models are still limited due to the computational cost in both training and inference.
• Evaluating Menu OCR and Translation: A Benchmark for Aligning Human and Automated Evaluations in Large Vision-Language Models
  16 Apr 2025 1 repository listed
  The rapid advancement of large vision-language models (LVLMs) has significantly propelled applications in document understanding, particularly in optical character recognition (OCR) and multilingual translation.

Syntology lines on 14 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.