Papers › Adapting Neural Link Predictors for Data-Efficient Complex Query Answering

Adapting Neural Link Predictors for Data-Efficient Complex Query Answering

29 Jan 2023NeurIPS 2023 11arXiv:2301.12313archive 2025-07-28

Answering complex queries on incomplete knowledge graphs is a challenging task where a model needs to answer complex logical queries in the presence of missing knowledge. Prior work in the literature has proposed to address this problem by designing architectures trained end-to-end for the complex query answering task with a reasoning process that is hard to interpret while requiring data and resource-intensive training. Other lines of research have proposed re-using simple neural link predictors to answer complex queries, reducing the amount of training data by orders of magnitude while providing interpretable answers. The neural link predictor used in such approaches is not explicitly optimised for the complex query answering task, implying that its scores are not calibrated to interact together. We propose to address these problems via CQD^𝒜, a parameter-efficient score \emph{adaptation} model optimised to re-calibrate neural link prediction scores for the complex query answering task. While the neural link predictor is frozen, the adaptation component -- which only increases the number of model parameters by 0.03% -- is trained on the downstream complex query answering task. Furthermore, the calibration component enables us to support reasoning over queries that include atomic negations, which was previously impossible with link predictors. In our experiments, CQD^𝒜 produces significantly more accurate results than current state-of-the-art methods, improving from $34.4$ to $35.1$ Mean Reciprocal Rank values averaged across all datasets and query types while using ≤30% of the available training query types. We further show that CQD^𝒜 is data-efficient, achieving competitive results with only 1% of the training complex queries, and robust in out-of-domain evaluations.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Complex Query AnsweringKnowledge GraphsLink Prediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Complex Query Answering FB15k CQDA MRR 1p 0.892 #3 of 9 Archive leaderboard report
Complex Query Answering FB15k CQDA MRR 2i 0.761 #3 of 9 Archive leaderboard report
Complex Query Answering FB15k CQDA MRR 2p 0.645 #3 of 9 Archive leaderboard report
Complex Query Answering FB15k CQDA MRR 2u 0.684 #3 of 9 Archive leaderboard report
Complex Query Answering FB15k CQDA MRR 3i 0.794 #3 of 9 Archive leaderboard report
Complex Query Answering FB15k CQDA MRR 3p 0.579 #3 of 9 Archive leaderboard report
Complex Query Answering FB15k CQDA MRR ip 0.706 #3 of 9 Archive leaderboard report
Complex Query Answering FB15k CQDA MRR pi 0.701 #3 of 9 Archive leaderboard report
Complex Query Answering FB15k CQDA MRR up 0.579 #3 of 9 Archive leaderboard report
Complex Query Answering FB15k-237 CQDA MRR 1p 0.467 #2 of 9 Archive leaderboard report
Complex Query Answering FB15k-237 CQDA MRR 2i 0.345 #2 of 9 Archive leaderboard report
Complex Query Answering FB15k-237 CQDA MRR 2p 0.136 #2 of 9 Archive leaderboard report
Complex Query Answering FB15k-237 CQDA MRR 2u 0.176 #2 of 9 Archive leaderboard report
Complex Query Answering FB15k-237 CQDA MRR 3i 0.483 #2 of 9 Archive leaderboard report
Complex Query Answering FB15k-237 CQDA MRR 3p 0.114 #2 of 9 Archive leaderboard report
Complex Query Answering FB15k-237 CQDA MRR ip 0.209 #2 of 9 Archive leaderboard report
Complex Query Answering FB15k-237 CQDA MRR pi 0.274 #2 of 9 Archive leaderboard report
Complex Query Answering FB15k-237 CQDA MRR up 0.114 #2 of 9 Archive leaderboard report
Complex Query Answering NELL-995 CQDA MRR 1p 0.604 #3 of 6 Archive leaderboard report
Complex Query Answering NELL-995 CQDA MRR 2i 0.434 #3 of 6 Archive leaderboard report
Complex Query Answering NELL-995 CQDA MRR 2p 0.229 #3 of 6 Archive leaderboard report
Complex Query Answering NELL-995 CQDA MRR 2u 0.200 #3 of 6 Archive leaderboard report
Complex Query Answering NELL-995 CQDA MRR 3i 0.526 #3 of 6 Archive leaderboard report
Complex Query Answering NELL-995 CQDA MRR 3p 0.167 #3 of 6 Archive leaderboard report
Complex Query Answering NELL-995 CQDA MRR ip 0.264 #3 of 6 Archive leaderboard report
Complex Query Answering NELL-995 CQDA MRR pi 0.321 #3 of 6 Archive leaderboard report
Complex Query Answering NELL-995 CQDA MRR up 0.170 #3 of 6 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections