Semantic entity labeling

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

12 shown of 12 papers with code (14 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
  29 Dec 2020 9 repositories listed
  Pre-training of text and layout has proved effective in a variety of visually-rich document understanding tasks due to its effective model architecture and the advantage of large-scale unlabeled scanned/digital-born…
• LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding
  28 Feb 2022 5 repositories listed Syntology ran 2 of 3 samples · 1 unverified
  LiLT can be pre-trained on the structured documents of a single language and then directly fine-tuned on other languages with the corresponding off-the-shelf monolingual/multilingual pre-trained textual models.
• LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
  18 Apr 2022 4 repositories listed
  In this paper, we propose \textbf{LayoutLMv3} to pre-train multimodal Transformers for Document AI with unified text and image masking.
• Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction
  17 Oct 2023 2 repositories listed
  However, BIO-tagging scheme relies on the correct order of model inputs, which is not guaranteed in real-world NER on scanned VrDs where text are recognized and arranged by OCR systems.
• ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding
  12 Oct 2022 2 repositories listed Syntology ran 2 of 7 samples · 5 unverified
  Recent years have witnessed the rise and success of pre-training techniques in visually-rich document understanding.
• Modeling Layout Reading Order as Ordering Relations for Visually-rich Document Understanding
  29 Sep 2024 1 repository listed
  However, we argue that this formulation does not adequately convey the complete reading order information in the layout, which may potentially lead to performance decline in downstream VrD tasks.
• Rethinking the Evaluation of Pre-trained Text-and-Layout Models from an Entity-Centric Perspective
  4 Feb 2024 1 repository listed
  Therefore, we claim the necessary standards for an ideal benchmark to evaluate the information extraction ability of PTLMs.
• PEneo: Unifying Line Extraction, Line Grouping, and Entity Linking for End-to-end Document Pair Extraction
  7 Jan 2024 1 repository listed
  However, simply concatenating SER and RE serially can lead to severe error propagation, and it fails to handle cases like multi-line entities in real scenarios.
• GeoLayoutLM: Geometric Pre-training for Visual Information Extraction
  21 Apr 2023 1 repository listed
  Additionally, novel relation heads, which are pre-trained by the geometric pre-training tasks and fine-tuned for RE, are elaborately designed to enrich and enhance the feature representation.
• StrucTexTv2: Masked Visual-Textual Prediction for Document Image Pre-training
  1 Mar 2023 1 repository listed
  Compared to the masked multi-modal modeling methods for document image understanding that rely on both the image and text modalities, StrucTexTv2 models image-only input and potentially deals with more application…
• XDoc: Unified Pre-training for Cross-Format Document Understanding
  6 Oct 2022 1 repository listed
  The surge of pre-training has witnessed the rapid development of document understanding recently.
• Doc2Graph: a Task Agnostic Document Understanding Framework based on Graph Neural Networks
  23 Aug 2022 1 repository listed
  Geometric Deep Learning has recently attracted significant interest in a wide range of machine learning fields, including document analysis.

Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.