Papers › Deep Learning of Partial Graph Matching via Differentiable Top-K

Deep Learning of Partial Graph Matching via Differentiable Top-K

1 Jan 2023CVPR 2023 1archive 2025-07-28

Runzhong Wang, Ziao Guo, Shaofei Jiang, Xiaokang Yang, Junchi Yan

Graph matching (GM) aims at discovering node matching between graphs, by maximizing the node- and edge-wise affinities between the matched elements. As an NP-hard problem, its challenge is further pronounced in the existence of outlier nodes in both graphs which is ubiquitous in practice, especially for vision problems. However, popular affinity-maximization-based paradigms often lack a principled scheme to suppress the false matching and resort to handcrafted thresholding to dismiss the outliers. This limitation is also inherited by the neural GM solvers though they have shown superior performance in the ideal no-outlier setting. In this paper, we propose to formulate the partial GM problem as the top-k selection task with a given/estimated number of inliers k. Specifically, we devise a differentiable top-k module that enables effective gradient descent over the optimal-transport layer, which can be readily plugged into SOTA deep GM pipelines including the quadratic matching network NGMv2 as well as the linear matching network GCAN. Meanwhile, the attention-fused aggregation layers are developed to estimate k to enable automatic outlier-robust matching in the wild. Last but not least, we remake and release a new benchmark called IMC-PT-SparseGM, originating from the IMC-PT stereo-matching dataset. The new benchmark involves more scale-varying graphs and partial matching instances from the real world. Experiments show that our methods outperform other partial matching schemes on popular benchmarks.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Deep LearningGraph MatchingStereo Matching

Datasets

Introduced by this paper, per the archive.

IMCPT-SparseGM-100IMCPT-SparseGM-50

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Graph Matching IMCPT-SparseGM-100 GCAN-AFAT-U F1 score 0.715 #1 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-100 GCAN-AFAT-I F1 score 0.709 #2 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-100 NGMv2-AFAT-U F1 score 0.703 #3 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-100 NGMv2-AFAT-I F1 score 0.701 #4 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-100 NGMv2 F1 score 0.676 #5 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-100 PCA-GM F1 score 0.575 #6 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-50 GCAN-AFAT-I F1 score 0.729 #1 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-50 NGMv2-AFAT-I F1 score 0.728 #2 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-50 NGMv2-AFAT-U F1 score 0.720 #3 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-50 GCAN-AFAT-U F1 score 0.711 #4 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-50 NGMv2 F1 score 0.703 #5 of 6 Archive leaderboard report
Graph Matching IMCPT-SparseGM-50 PCA-GM F1 score 0.631 #6 of 6 Archive leaderboard report
Graph Matching PASCAL VOC GCAN-AFAT-U F1 score 0.620 #3 of 31 Archive leaderboard report
Graph Matching PASCAL VOC GCAN-AFAT-I F1 score 0.616 #4 of 31 Archive leaderboard report
Graph Matching PASCAL VOC NGMv2-AFAT-U F1 score 0.602 #6 of 31 Archive leaderboard report
Graph Matching PASCAL VOC NGMv2-AFAT-I F1 score 0.599 #8 of 31 Archive leaderboard report
Graph Matching Willow Object Class GCAN-AFAT-I F1 score 0.837 #20 of 23 Archive leaderboard report
Graph Matching Willow Object Class NGMv2-AFAT-I F1 score 0.831 #21 of 23 Archive leaderboard report
Graph Matching Willow Object Class GCAN-AFAT-U F1 score 0.823 #22 of 23 Archive leaderboard report
Graph Matching Willow Object Class NGMv2-AFAT-U F1 score 0.817 #23 of 23 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections