Papers › Full Page Handwriting Recognition via Image to Sequence Extraction

Full Page Handwriting Recognition via Image to Sequence Extraction

11 Mar 2021arXiv:2103.06450archive 2025-07-28

Sumeet S. Singh, Sergey Karayev

We present a Neural Network based Handwritten Text Recognition (HTR) model architecture that can be trained to recognize full pages of handwritten or printed text without image segmentation. Being based on Image to Sequence architecture, it can extract text present in an image and then sequence it correctly without imposing any constraints regarding orientation, layout and size of text and non-text. Further, it can also be trained to generate auxiliary markup related to formatting, layout and content. We use character level vocabulary, thereby enabling language and terminology of any subject. The model achieves a new state-of-art in paragraph level recognition on the IAM dataset. When evaluated on scans of real world handwritten free form test answers - beset with curved and slanted lines, drawings, tables, math, chemistry and other symbols - it performs better than all commercially available HTR cloud APIs. It is deployed in production as part of a commercial web application.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

CT2001/image-to-latex mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Image-to-Markup Generation with Coarse-to-Fine Attention (arXiv:1609.04938; that paper's own run record: 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 8 unverified); nothing checks that they implement this paper's method. report
CT2001/image-to-latex-biology mentioned on GitHubpytorchMITSyntology: not harvested report
kingyiusuen/image-to-latex mentioned on GitHubpytorchMITSyntology: not harvested report
tobiasvanderwerff/MetaHTR mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognition (arXiv:1811.00751; that paper's own run record: 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
tobiasvanderwerff/full-page-handwriting-recognition mentioned on GitHubpytorchSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

HTRHandwriting RecognitionHandwritten Text RecognitionImage SegmentationMathSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Handwritten Text Recognition IAM FPHR+Aug Paragraph Level (~145 dpi) CER 6.3 #11 of 17 Archive leaderboard report
Handwritten Text Recognition IAM FPHR+Aug Line Level (~145 dpi) CER 6.5 #14 of 17 Archive leaderboard report
Handwritten Text Recognition IAM FPHR Paragraph Level (~145 dpi) CER 6.7 #16 of 17 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections