Papers › An Open Challenge for Inductive Link Prediction on Knowledge Graphs

An Open Challenge for Inductive Link Prediction on Knowledge Graphs

3 Mar 2022arXiv:2203.01520archive 2025-07-28

Mikhail Galkin, Max Berrendorf, Charles Tapley Hoyt

An emerging trend in representation learning over knowledge graphs (KGs) moves beyond transductive link prediction tasks over a fixed set of known entities in favor of inductive tasks that imply training on one graph and performing inference over a new graph with unseen entities. In inductive setups, node features are often not available and training shallow entity embedding matrices is meaningless as they cannot be used at inference time with unseen entities. Despite the growing interest, there are not enough benchmarks for evaluating inductive representation learning methods. In this work, we introduce ILPC 2022, a novel open challenge on KG inductive link prediction. To this end, we constructed two new datasets based on Wikidata with various sizes of training and inference graphs that are much larger than existing inductive benchmarks. We also provide two strong baselines leveraging recently proposed inductive methods. We hope this challenge helps to streamline community efforts in the inductive graph representation learning area. ILPC 2022 follows best practices on evaluation fairness and reproducibility, and is available at https://github.com/pykeen/ilpc2022.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

pykeen/ilpc2022 officialmentioned in papermentioned on GitHubpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Graph Representation LearningInductive Link PredictionKnowledge GraphsLink PredictionRepresentation Learning

Datasets

Introduced by this paper, per the archive.

ILPC22-LargeILPC22-Small

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Inductive Link Prediction ILPC22-Large Inductive NodePiece + GNN AMRI 0.682 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece + GNN Hits@1 0.0319 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece + GNN Hits@10 0.1458 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece + GNN Hits@100 0.374 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece + GNN Hits@3 0.073 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece + GNN Hits@5 0.099 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece + GNN MRR 0.0705 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece AMRI 0.646 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece Hits@1 0.0373 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece Hits@10 0.1246 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece Hits@100 0.287 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece Hits@3 0.0542 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece Hits@5 0.0809 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Large Inductive NodePiece MRR 0.0651 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece + GNN AMRI 0.730 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece + GNN Hits@1 0.0763 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece + GNN Hits@10 0.2509 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece + GNN Hits@100 0.4705 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece + GNN Hits@3 0.1396 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece + GNN Hits@5 0.1899 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece + GNN MRR 0.1326 #1 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece AMRI 0.666 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece Hits@1 0.007 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece Hits@10 0.0917 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece Hits@100 0.4678 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece Hits@3 0.0219 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece Hits@5 0.0500 #2 of 2 Archive leaderboard report
Inductive Link Prediction ILPC22-Small Inductive NodePiece MRR 0.0381 #2 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections