Key Information Extraction

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

6 leaderboard tables shown for this task, 6 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

12 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 40 papers with code (74 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• LayoutLM: Pre-training of Text and Layout for Document Image Understanding
  31 Dec 2019 19 repositories listed Syntology ran 2 of 3 samples · 1 unverified · 1 pointer-only (licence)
  In this paper, we propose the \textbf{LayoutLM} to jointly model interactions between text and layout information across scanned document images, which is beneficial for a great number of real-world document image…
• LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
  29 Dec 2020 9 repositories listed
  Pre-training of text and layout has proved effective in a variety of visually-rich document understanding tasks due to its effective model architecture and the advantage of large-scale unlabeled scanned/digital-born…
• LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding
  28 Feb 2022 5 repositories listed Syntology ran 2 of 3 samples · 1 unverified
  LiLT can be pre-trained on the structured documents of a single language and then directly fine-tuned on other languages with the corresponding off-the-shelf monolingual/multilingual pre-trained textual models.
• LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
  18 Apr 2022 4 repositories listed
  In this paper, we propose \textbf{LayoutLMv3} to pre-train multimodal Transformers for Document AI with unified text and image masking.
• XFormParser: A Simple and Effective Multimodal Multilingual Semi-structured Form Parser
  27 May 2024 2 repositories listed
  In the domain of Document AI, parsing semi-structured image form is a crucial Key Information Extraction (KIE) task.
• Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction
  17 Oct 2023 2 repositories listed
  However, BIO-tagging scheme relies on the correct order of model inputs, which is not guaranteed in real-world NER on scanned VrDs where text are recognized and arranged by OCR systems.
• ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding
  12 Oct 2022 2 repositories listed Syntology ran 2 of 7 samples · 5 unverified
  Recent years have witnessed the rise and success of pre-training techniques in visually-rich document understanding.
• BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents
  10 Aug 2021 2 repositories listed Syntology ran 2 of 13 samples · 11 unverified
  On the other hand, this paper tackles the problem by going back to the basic: effective combination of text and layout.
• Automatic Metadata Extraction Incorporating Visual Features from Scanned Electronic Theses and Dissertations
  1 Jul 2021 2 repositories listed
  Our experiments show that CRF with visual features outperformed both a heuristic and a CRF model with only text-based features.
• Spatial Dual-Modality Graph Reasoning for Key Information Extraction
  26 Mar 2021 2 repositories listed
  In order to roundly evaluate our proposed method as well as boost the future research, we release a new dataset named WildReceipt, which is collected and annotated tailored for the evaluation of key information…
• PICK: Processing Key Information Extraction from Documents using Improved Graph Learning-Convolutional Networks
  16 Apr 2020 2 repositories listed Syntology ran 2 of 6 samples · 4 unverified
  Computer vision with state-of-the-art deep learning models has achieved huge success in the field of Optical Character Recognition (OCR) including text detection and recognition tasks recently.
• PaddleOCR 3.0 Technical Report
  8 Jul 2025 1 repository listed
  This technical report introduces PaddleOCR 3.
• Class-Agnostic Region-of-Interest Matching in Document Images
  26 Jun 2025 1 repository listed
  Document understanding and analysis have received a lot of attention due to their widespread application.
• OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Models
  22 Feb 2025 1 repository listed
  In this paper, we introduce OmniParser V2, a universal model that unifies VsTP typical tasks, including text spotting, key information extraction, table recognition, and layout analysis, into a unified framework.
• GraphRevisedIE: Multimodal Information Extraction with Graph-Revised Network
  2 Oct 2024 1 repository listed
  Key information extraction (KIE) from visually rich documents (VRD) has been a challenging task in document intelligence because of not only the complicated and diverse layouts of VRD that make the model hard to…
• Modeling Layout Reading Order as Ordering Relations for Visually-rich Document Understanding
  29 Sep 2024 1 repository listed
  However, we argue that this formulation does not adequately convey the complete reading order information in the layout, which may potentially lead to performance decline in downstream VrD tasks.
• Information Extraction from Visually Rich Documents Using Directed Weighted Graph Neural Network
  11 Sep 2024 1 repository listed
  This paper presents a novel approach to information extraction (IE) from visually rich documents (VRD) by employing a directed weighted graph representation to capture relationships among various VRD components.
• A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understanding
  2 Jul 2024 1 repository listed Syntology ran 7 of 7 samples · 0 unverified · 7 pointer-only (licence)
  However, existing methods that integrate spatial layouts with text have limitations, such as producing overly long text sequences or failing to fully leverage the autoregressive traits of LLMs.
• KVP10k : A Comprehensive Dataset for Key-Value Pair Extraction in Business Documents
  1 May 2024 1 repository listed
  In recent years, the challenge of extracting information from business documents has emerged as a critical task, finding applications across numerous domains.
• OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognition
  28 Mar 2024 1 repository listed Syntology ran 3 of 4 samples · 1 unverified
  Recently, visually-situated text parsing (VsTP) has experienced notable advancements, driven by the increasing demand for automated document understanding and the emergence of Generative Large Language Models (LLMs)…
• TextMonkey: An OCR-Free Large Multimodal Model for Understanding Document
  7 Mar 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  We present TextMonkey, a large multimodal model (LMM) tailored for text-centric tasks.
• Different Tastes of Entities: Investigating Human Label Variation in Named Entity Annotations
  2 Feb 2024 1 repository listed
  Named Entity Recognition (NER) is a key information extraction task with a long-standing tradition.
• PEneo: Unifying Line Extraction, Line Grouping, and Entity Linking for End-to-end Document Pair Extraction
  7 Jan 2024 1 repository listed
  However, simply concatenating SER and RE serially can lead to severe error propagation, and it fails to handle cases like multi-line entities in real scenarios.
• Multimodal weighted graph representation for information extraction from visually rich documents.
  5 Jan 2024 1 repository listed
  This paper introduces a novel system for information extraction from visually rich documents (VRD) using a weighted graph representation.
• OmniParser: A Unified Framework for Text Spotting Key Information Extraction and Table Recognition
  1 Jan 2024 1 repository listed
  Recently visually-situated text parsing (VsTP) has experienced notable advancements driven by the increasing demand for automated document understanding and the emergence of Generative Large Language Models (LLMs)…
• Exploring OCR Capabilities of GPT-4V(ision) : A Quantitative and In-depth Evaluation
  25 Oct 2023 1 repository listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  We assess the model's performance across a range of OCR tasks, including scene text recognition, handwritten text recognition, handwritten mathematical expression recognition, table structure recognition, and…
• GenKIE: Robust Generative Multimodal Document Key Information Extraction
  24 Oct 2023 1 repository listed
  Key information extraction (KIE) from scanned documents has gained increasing attention because of its applications in various domains.
• AMuRD: Annotated Arabic-English Receipt Dataset for Key Information Extraction and Classification
  18 Sep 2023 1 repository listed
  In this paper, we present AMuRD, a novel multilingual human-annotated dataset specifically designed for information extraction from receipts.
• OCRBench: On the Hidden Mystery of OCR in Large Multimodal Models
  13 May 2023 1 repository listed
  In this paper, we conducted a comprehensive evaluation of Large Multimodal Models, such as GPT4V and Gemini, in various text-related visual tasks including Text Recognition, Scene Text-Centric Visual Question Answering…
• Information Redundancy and Biases in Public Document Information Extraction Benchmarks
  28 Apr 2023 1 repository listed
  Advances in the Visually-rich Document Understanding (VrDU) field and particularly the Key-Information Extraction (KIE) task are marked with the emergence of efficient Transformer-based approaches such as the LayoutLM…

Syntology lines on 9 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.