Papers › A Neural Model for Text Localization, Transcription and Named Entity Recognition in Full Pages

A Neural Model for Text Localization, Transcription and Named Entity Recognition in Full Pages

20 Dec 2019arXiv:1912.10016archive 2025-07-28

Manuel Carbonell, Alicia Fornés, Mauricio Villegas, Josep Lladós

In the last years, the consolidation of deep neural network architectures for information extraction in document images has brought big improvements in the performance of each of the tasks involved in this process, consisting of text localization, transcription, and named entity recognition. However, this process is traditionally performed with separate methods for each task. In this work we propose an end-to-end model that combines a one stage object detection network with branches for the recognition of text and named entities respectively in a way that shared features can be learned simultaneously from the training error of each of the tasks. By doing so the model jointly performs handwritten text detection, transcription, and named entity recognition at page level with a single feed forward step. We exhaustively evaluate our approach on different datasets, discussing its advantages and limitations compared to sequential approaches. The results show that the model is capable of benefiting from shared features for simultaneously solving interdependent tasks.

PaperPDFCode

Code

omni-us/research-dataset-sGMB officialmentioned in papermentioned on GitHub report
omni-us/research-e2e-pagereader officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Named Entity RecognitionNamed Entity Recognition (NER)Object DetectionText Detectionnamed-entity-recognitionobject-detection

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections