Papers › SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environments

SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environments

16 Apr 2024arXiv:2404.10527archive 2025-07-28

Niklas Gard, Anna Hilsmann, Peter Eisert

In this paper, we present SPVLoc, a global indoor localization method that accurately determines the six-dimensional (6D) camera pose of a query image and requires minimal scene-specific prior knowledge and no scene-specific training. Our approach employs a novel matching procedure to localize the perspective camera's viewport, given as an RGB image, within a set of panoramic semantic layout representations of the indoor environment. The panoramas are rendered from an untextured 3D reference model, which only comprises approximate structural information about room shapes, along with door and window annotations. We demonstrate that a straightforward convolutional network structure can successfully achieve image-to-panorama and ultimately image-to-model matching. Through a viewport classification score, we rank reference panoramas and select the best match for the query image. Then, a 6D relative pose is estimated between the chosen panorama and query image. Our experiments demonstrate that this approach not only efficiently bridges the domain gap but also generalizes well to previously unseen scenes that are not part of the training data. Moreover, it achieves superior localization accuracy compared to the state of the art methods and also estimates more degrees of freedom of the camera pose. Our source code is publicly available at https://fraunhoferhhi.github.io/spvloc .

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

fraunhoferhhi/spvloc officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

6D Pose EstimationCamera LocalizationIndoor LocalizationIndoor Localization (3-DoF Pose: X, Y, Yaw)Indoor Localization (6-DoF Pose)Visual Localization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, emtpy) SPVLoc <1m median rotation error (deg) 1.14 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, emtpy) SPVLoc <1m median translation error (cm) 11.7 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, emtpy) SPVLoc Recall 10cm (%) 35.99 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, emtpy) SPVLoc Recall 1m (%) 86.73 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, emtpy) SPVLoc Recall 1m 30 deg (%) 86.25 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, emtpy) SPVLoc Recall 50cm (%) 84.06 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, furnished) SPVLoc <1m median rotation error (deg) 1.26 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, furnished) SPVLoc <1m median translation error (cm) 12.86 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, furnished) SPVLoc Recall 10cm (%) 30.55 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, furnished) SPVLoc Recall 1m (%) 84.5 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, furnished) SPVLoc Recall 1m 30 deg (%) 84.2 #1 of 1 Archive leaderboard report
Indoor Localization (3-DoF Pose: X, Y, Yaw) Structured3D (perspective, furnished) SPVLoc Recall 50cm (%) 81.58 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, emtpy) SPVLoc <1m median rotation error (deg) 1.5 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, emtpy) SPVLoc <1m median translation error (cm) 13.09 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, emtpy) SPVLoc Recall 10cm (%) 28.77 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, emtpy) SPVLoc Recall 1m (%) 86.73 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, emtpy) SPVLoc Recall 1m 30 deg (%) 86.21 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, emtpy) SPVLoc Recall 50cm (%) 83.97 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, furnished) SPVLoc <1m median rotation error (deg) 1.62 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, furnished) SPVLoc <1m median translation error (cm) 14.3 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, furnished) SPVLoc Recall 10cm (%) 23.54 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, furnished) SPVLoc Recall 1m (%) 84.5 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, furnished) SPVLoc Recall 1m 30 deg (%) 84.18 #1 of 1 Archive leaderboard report
Indoor Localization (6-DoF Pose) Structured3D (perspective, furnished) SPVLoc Recall 50cm (%) 81.48 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

SET

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections