Papers › Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localization

Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localization

10 Sep 2021arXiv:2109.04753archive 2025-07-28

Sungho Yoon, Ayoung Kim

Along with feature points for image matching, line features provide additional constraints to solve visual geometric problems in robotics and computer vision (CV). Although recent convolutional neural network (CNN)-based line descriptors are promising for viewpoint changes or dynamic environments, we claim that the CNN architecture has innate disadvantages to abstract variable line length into the fixed-dimensional descriptor. In this paper, we effectively introduce Line-Transformers dealing with variable lines. Inspired by natural language processing (NLP) tasks where sentences can be understood and abstracted well in neural nets, we view a line segment as a sentence that contains points (words). By attending to well-describable points on aline dynamically, our descriptor performs excellently on variable line length. We also propose line signature networks sharing the line's geometric attributes to neighborhoods. Performing as group descriptors, the networks enhance line descriptors by understanding lines' relative geometries. Finally, we present the proposed line descriptor and matching in a Point and Line Localization (PL-Loc). We show that the visual localization with feature points can be improved using our line features. We validate the proposed method for homography estimation and visual localization.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

yosungho/LineTR officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Homography EstimationSentenceVisual Localization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Homography Estimation Oxford and Paris LT AUC@10px 52.1 #1 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris LT AUC@20px 69.4 #1 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris LT AUC@5px 29.5 #1 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris LT F 59.5 #1 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris LT P 57.7 #1 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris LT R 61.5 #1 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris SOLD2 AUC@10px 51.5 #2 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris SOLD2 AUC@20px 67.1 #2 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris SOLD2 AUC@5px 31.8 #2 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris SOLD2 F 43.3 #2 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris SOLD2 P 41.1 #2 of 2 Archive leaderboard report
Homography Estimation Oxford and Paris SOLD2 R 45.8 #2 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections