Papers › SRFormer: Text Detection Transformer with Incorporated Segmentation and Regression

SRFormer: Text Detection Transformer with Incorporated Segmentation and Regression

21 Aug 2023arXiv:2308.10531archive 2025-07-28

Qingwen Bu, Sungrae Park, Minsoo Khang, Yichuan Cheng

Existing techniques for text detection can be broadly classified into two primary groups: segmentation-based and regression-based methods. Segmentation models offer enhanced robustness to font variations but require intricate post-processing, leading to high computational overhead. Regression-based methods undertake instance-aware prediction but face limitations in robustness and data efficiency due to their reliance on high-level representations. In our academic pursuit, we propose SRFormer, a unified DETR-based model with amalgamated Segmentation and Regression, aiming at the synergistic harnessing of the inherent robustness in segmentation representations, along with the straightforward post-processing of instance-level regression. Our empirical analysis indicates that favorable segmentation predictions can be obtained at the initial decoder layers. In light of this, we constrain the incorporation of segmentation branches to the first few decoder layers and employ progressive regression refinement in subsequent layers, achieving performance gains while minimizing computational load from the mask.Furthermore, we propose a Mask-informed Query Enhancement module. We take the segmentation result as a natural soft-ROI to pool and extract robust pixel representations, which are then employed to enhance and diversify instance queries. Extensive experimentation across multiple benchmarks has yielded compelling findings, highlighting our method's exceptional robustness, superior training and data efficiency, as well as its state-of-the-art performance. Our code is available at https://github.com/retsuh-bqw/SRFormer-Text-Det.

PaperPDFCode

Syntology This paper's arXiv id is not in Syntology's Atlas id list (549,449 ids, as this build read them; the read time is in the build record), so this page links to no Syntology page for it. The list is not the whole graph; Syntology's feed shows papers as they enter the graph.

Code

retsuh-bqw/SRFormer-Text-Det officialmentioned in papermentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to AAAI id aaai_27844 (that paper's own run record: 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
opendrivelab/elm mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Embodied Understanding of Driving Scenarios (arXiv:2403.04593; that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DecoderScene Text DetectionSegmentationText Detectionregression

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Scene Text Detection IC19-Art SRFormer (ResNet-50) H-Mean 79.3 #2 of 4 Archive leaderboard report
Scene Text Detection SCUT-CTW1500 SRFormer (ResNet-50) F-Measure 89.6 #2 of 17 Archive leaderboard report
Scene Text Detection SCUT-CTW1500 SRFormer (ResNet-50) Precision 91.6 #2 of 17 Archive leaderboard report
Scene Text Detection SCUT-CTW1500 SRFormer (ResNet-50) Recall 87.7 #2 of 17 Archive leaderboard report
Scene Text Detection Total-Text SRFormer (ResNet-50) F-Measure 90.0% #2 of 27 Archive leaderboard report
Scene Text Detection Total-Text SRFormer (ResNet-50) Precision 92.2% #2 of 27 Archive leaderboard report
Scene Text Detection Total-Text SRFormer (ResNet-50) Recall 87.9% #2 of 27 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections