Papers › Pair-VPR: Place-Aware Pre-training and Contrastive Pair Classification for Visual...

Pair-VPR: Place-Aware Pre-training and Contrastive Pair Classification for Visual Place Recognition with Vision Transformers

9 Oct 2024arXiv:2410.06614archive 2025-07-28

Stephen Hausler, Peyman Moghadam

In this work we propose a novel joint training method for Visual Place Recognition (VPR), which simultaneously learns a global descriptor and a pair classifier for re-ranking. The pair classifier can predict whether a given pair of images are from the same place or not. The network only comprises Vision Transformer components for both the encoder and the pair classifier, and both components are trained using their respective class tokens. In existing VPR methods, typically the network is initialized using pre-trained weights from a generic image dataset such as ImageNet. In this work we propose an alternative pre-training strategy, by using Siamese Masked Image Modelling as a pre-training task. We propose a Place-aware image sampling procedure from a collection of large VPR datasets for pre-training our model, to learn visual features tuned specifically for VPR. By re-using the Mask Image Modelling encoder and decoder weights in the second stage of training, Pair-VPR can achieve state-of-the-art VPR performance across five benchmark datasets with a ViT-B encoder, along with further improvements in localization recall with larger encoders. The Pair-VPR website is: https://csiro-robotics.github.io/Pair-VPR.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

csiro-robotics/Pair-VPR officialmentioned on GitHubpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DecoderRe-RankingVisual Place Recognition

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Visual Place Recognition Mapillary test Pair-VPR-p Recall@1 81.7 #2 of 12 Archive leaderboard report
Visual Place Recognition Mapillary test Pair-VPR-p Recall@10 91.3 #2 of 12 Archive leaderboard report
Visual Place Recognition Mapillary test Pair-VPR-p Recall@5 90.2 #2 of 12 Archive leaderboard report
Visual Place Recognition Mapillary test Pair-VPR-s Recall@1 79.0 #6 of 12 Archive leaderboard report
Visual Place Recognition Mapillary test Pair-VPR-s Recall@10 88.3 #6 of 12 Archive leaderboard report
Visual Place Recognition Mapillary test Pair-VPR-s Recall@5 86.9 #6 of 12 Archive leaderboard report
Visual Place Recognition Mapillary val Pair-VPR-p Recall@1 95.4 #2 of 18 Archive leaderboard report
Visual Place Recognition Mapillary val Pair-VPR-p Recall@10 97.7 #2 of 18 Archive leaderboard report
Visual Place Recognition Mapillary val Pair-VPR-p Recall@5 97.3 #2 of 18 Archive leaderboard report
Visual Place Recognition Mapillary val Pair-VPR-s Recall@1 93.7 #4 of 18 Archive leaderboard report
Visual Place Recognition Mapillary val Pair-VPR-s Recall@10 97.3 #4 of 18 Archive leaderboard report
Visual Place Recognition Mapillary val Pair-VPR-s Recall@5 97.2 #4 of 18 Archive leaderboard report
Visual Place Recognition Pittsburgh-30k-test Pair-VPR-p Recall@1 95.4 #1 of 22 Archive leaderboard report
Visual Place Recognition Pittsburgh-30k-test Pair-VPR-p Recall@10 98.0 #1 of 22 Archive leaderboard report
Visual Place Recognition Pittsburgh-30k-test Pair-VPR-p Recall@5 97.5 #1 of 22 Archive leaderboard report
Visual Place Recognition Pittsburgh-30k-test Pair-VPR-s Recall@1 94.7 #2 of 22 Archive leaderboard report
Visual Place Recognition Pittsburgh-30k-test Pair-VPR-s Recall@10 97.8 #2 of 22 Archive leaderboard report
Visual Place Recognition Pittsburgh-30k-test Pair-VPR-s Recall@5 97.2 #2 of 22 Archive leaderboard report
Visual Place Recognition Tokyo247 Pair-VPR-p Recall@1 100 #1 of 14 Archive leaderboard report
Visual Place Recognition Tokyo247 Pair-VPR-p Recall@10 100 #1 of 14 Archive leaderboard report
Visual Place Recognition Tokyo247 Pair-VPR-p Recall@5 100 #1 of 14 Archive leaderboard report
Visual Place Recognition Tokyo247 Pair-VPR-s Recall@1 98.1 #5 of 14 Archive leaderboard report
Visual Place Recognition Tokyo247 Pair-VPR-s Recall@10 98.7 #5 of 14 Archive leaderboard report
Visual Place Recognition Tokyo247 Pair-VPR-s Recall@5 98.4 #5 of 14 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionBPEDense ConnectionsDropoutLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformerVision Transformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections