Papers › Addressing the generalization of 3D registration methods with a featureless baseline...

Addressing the generalization of 3D registration methods with a featureless baseline and an unbiased benchmark

23 Mar 2024Machine Vision and Applications 2024 3archive 2025-07-28

Bojanić, David; Bartol, Kristijan; Forest, Josep; Petković, Tomislav; Pribanić, Tomislav

Recent 3D registration methods are mostly learning-based that either find correspondences in feature space and match them, or directly estimate the registration transformation from the given point cloud features. Therefore, these feature-based methods have difficulties with generalizing onto point clouds that differ substantially from their training data. This issue is not so apparent because of the problematic benchmark definitions that cannot provide any in-depth analysis and contain a bias toward similar data. Therefore, we propose a methodology to create a 3D registration benchmark, given a point cloud dataset, that provides a more informative evaluation of a method w.r.t. other benchmarks. Using this methodology, we create a novel FAUST-partial (FP) benchmark, based on the FAUST dataset, with several difficulty levels. The FP benchmark addresses the limitations of the current benchmarks: lack of data and parameter range variability, and allows to evaluate the strengths and weaknesses of a 3D registration method w.r.t. a single registration parameter. Using the new FP benchmark, we provide a thorough analysis of the current state-of-the-art methods and observe that the current method still struggle to generalize onto severely different out-of-sample data. Therefore, we propose a simple featureless traditional 3D registration baseline method based on the weighted cross-correlation between two given point clouds. Our method achieves strong results on current benchmarking datasets, outperforming most deep learning methods. Our source code is available on github.com/DavidBoja/exhaustive-grid-search.

PaperPDFCode

Code

DavidBoja/exhaustive-grid-search mentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

BenchmarkingImage to Point Cloud RegistrationPoint Cloud Registration

Datasets

Introduced by this paper, per the archive.

FAUST-partial

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Point Cloud Registration 3DMatch (at least 30% overlapped - FCGF setting) Exhaustive Grid Search Recall (0.3m, 15 degrees) 84.11 #6 of 14 Archive leaderboard report
Point Cloud Registration ETH (trained on 3DMatch) Exhaustive Grid Search Recall (30cm, 5 degrees) 94.25 #12 of 20 Archive leaderboard report
Point Cloud Registration FP-O-E Exhaustive Grid Search RRE (degrees) 0.067 #3 of 6 Archive leaderboard report
Point Cloud Registration FP-O-E Exhaustive Grid Search RTE (cm) 0.035 #3 of 6 Archive leaderboard report
Point Cloud Registration FP-O-E Exhaustive Grid Search Recall (3cm, 10 degrees) 99.47 #3 of 6 Archive leaderboard report
Point Cloud Registration FP-O-H Exhaustive Grid Search RRE (degrees) 0.477 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-O-H Exhaustive Grid Search RTE (cm) 0.234 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-O-H Exhaustive Grid Search Recall (3cm, 10 degrees) 37.06 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-O-M Exhaustive Grid Search RRE (degrees) 0.030 #1 of 6 Archive leaderboard report
Point Cloud Registration FP-O-M Exhaustive Grid Search RTE (cm) 0.017 #1 of 6 Archive leaderboard report
Point Cloud Registration FP-O-M Exhaustive Grid Search Recall (3cm, 10 degrees) 88.06 #1 of 6 Archive leaderboard report
Point Cloud Registration FP-R-E Exhaustive Grid Search RRE (degrees) 0.005 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-R-E Exhaustive Grid Search RTE (cm) 0.002 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-R-E Exhaustive Grid Search Recall (3cm, 10 degrees) 99.64 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-R-H Exhaustive Grid Search RRE (degrees) 0.01 #3 of 6 Archive leaderboard report
Point Cloud Registration FP-R-H Exhaustive Grid Search RTE (cm) 0.007 #3 of 6 Archive leaderboard report
Point Cloud Registration FP-R-H Exhaustive Grid Search Recall (3cm, 10 degrees) 78.00 #3 of 6 Archive leaderboard report
Point Cloud Registration FP-R-M Exhaustive Grid Search RRE (degrees) 0.003 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-R-M Exhaustive Grid Search RTE (cm) 0.003 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-R-M Exhaustive Grid Search Recall (3cm, 10 degrees) 97.92 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-T-E Exhaustive Grid Search RRE (degrees) 0.005 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-T-E Exhaustive Grid Search RTE (cm) 0.002 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-T-E Exhaustive Grid Search Recall (3cm, 10 degrees) 99.70 #2 of 6 Archive leaderboard report
Point Cloud Registration FP-T-H Exhaustive Grid Search RRE (degrees) 0.005 #3 of 6 Archive leaderboard report
Point Cloud Registration FP-T-H Exhaustive Grid Search RTE (cm) 0.002 #3 of 6 Archive leaderboard report
Point Cloud Registration FP-T-H Exhaustive Grid Search Recall (3cm, 10 degrees) 98.81 #3 of 6 Archive leaderboard report
Point Cloud Registration FP-T-M Exhaustive Grid Search RRE (degrees) 0.005 #1 of 6 Archive leaderboard report
Point Cloud Registration FP-T-M Exhaustive Grid Search RTE (cm) 0.002 #1 of 6 Archive leaderboard report
Point Cloud Registration FP-T-M Exhaustive Grid Search Recall (3cm, 10 degrees) 99.82 #1 of 6 Archive leaderboard report
Point Cloud Registration KITTI (FCGF setting) Exhaustive Grid Search Recall (0.6m, 5 degrees) 94.59 #9 of 11 Archive leaderboard report
Point Cloud Registration KITTI (trained on 3DMatch) Exhaustive Grid Search Success Rate 94.95 #4 of 14 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections