Graph Question Answering

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 42 papers with code (78 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• TempoQR: Temporal Question Reasoning over Knowledge Graphs
  10 Dec 2021 3 repositories listed
  The first computes a textual representation of a given question, the second combines it with the entity embeddings for entities involved in the question, and the third generates question-specific time embeddings.
• G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering
  12 Feb 2024 2 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Given a graph with textual attributes, we enable users to `chat with their graph': that is, to ask questions about the graph using a conversational interface.
• Would You Ask it that Way? Measuring and Improving Question Naturalness for Knowledge Graph Question Answering
  25 May 2022 2 repositories listed
  The construction of this test collection also sheds light on the challenges of constructing large-scale KGQA datasets with genuinely NL questions.
• Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answering
  11 Jun 2025 1 repository listed
  In this work, we propose RAPL, a novel framework for efficient and effective graph retrieval in KGQA.
• Q-NL Verifier: Leveraging Synthetic Data for Robust Knowledge Graph Question Answering
  3 Mar 2025 1 repository listed
  Our approach relies on large language models (LLMs) to generate semantically precise natural language paraphrases of structured queries.
• RoToR: Towards More Reliable Responses for Order-Invariant Inputs
  10 Feb 2025 1 repository listed
  Mitigating positional bias of language models (LMs) for listwise inputs is a well-known and important problem (e.
• Ontology-Guided, Hybrid Prompt Learning for Generalization in Knowledge Graph Question Answering
  6 Feb 2025 1 repository listed
  Most existing Knowledge Graph Question Answering (KGQA) approaches are designed for a specific KG, such as Wikidata, DBpedia or Freebase.
• Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-Augmentation
  24 Dec 2024 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  The Amar framework comprises two key sub-components: 1) a self-alignment module that aligns commonalities among entities, relations, and subgraphs to enhance retrieved text, thereby reducing noise interference; 2) a…
• Enhancing SPARQL Generation by Triplet-order-sensitive Pre-training
  8 Oct 2024 1 repository listed
  Semantic parsing that translates natural language queries to SPARQL is of great importance for Knowledge Graph Question Answering (KGQA) systems.
• Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering
  2 Oct 2024 1 repository listed
  Knowledge graph question answering (KGQA) involves answering natural language questions by leveraging structured information stored in a knowledge graph.
• CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question Answering
  29 Sep 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Recent studies have explored the use of Large Language Models (LLMs) with Retrieval Augmented Generation (RAG) for Knowledge Graph Question Answering (KGQA).
• Konstruktor: A Strong Baseline for Simple Knowledge Graph Question Answering
  24 Sep 2024 1 repository listed
  While being one of the most popular question types, simple questions such as "Who is the author of Cinderella?
• Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Models
  5 Sep 2024 1 repository listed Syntology ran 1 of 2 samples · 1 unverified · 2 pointer-only (licence)
  Furthermore, the integration experiments with various LLMs on the mentioned datasets highlight the flexibility of DoG.
• MST5 -- Multilingual Question Answering over Knowledge Graphs
  8 Jul 2024 1 repository listed
  In this research, we propose a simplified approach to enhance multilingual KGQA systems by incorporating linguistic context and entity information directly into the processing pipeline of a language model.
• BioKGBench: A Knowledge Graph Checking Benchmark of AI Agent for Biomedical Science
  29 Jun 2024 1 repository listed
  On the widely used popular knowledge graph, we discover over 90 factual errors which provide scenarios for agents to make discoveries and demonstrate the effectiveness of our approach.
• TAGLAS: An atlas of text-attributed graph datasets in the era of large graph and language models
  20 Jun 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  In TAGLAS, we collect and integrate more than 23 TAG datasets with domains ranging from citation graphs to molecule graphs and tasks from node classification to graph question-answering.
• LinkQ: An LLM-Assisted Visual Interface for Knowledge Graph Question-Answering
  7 Jun 2024 1 repository listed
  We present LinkQ, a system that leverages a large language model (LLM) to facilitate knowledge graph (KG) query construction through natural language question-answering.
• GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning
  30 May 2024 1 repository listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  In our GNN-RAG framework, the GNN acts as a dense subgraph reasoner to extract useful graph information, while the LLM leverages its natural language processing ability for ultimate KGQA.
• Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answering
  23 Apr 2024 1 repository listed Syntology ran 9 of 11 samples · 2 unverified · 11 pointer-only (licence)
  To simulate these real-world scenarios and evaluate the ability of LLMs to integrate internal and external knowledge, we propose leveraging LLMs for QA under Incomplete Knowledge Graph (IKGQA), where the provided KG…
• CR-LT-KGQA: A Knowledge Graph Question Answering Dataset Requiring Commonsense Reasoning and Long-Tail Knowledge
  3 Mar 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  In this work, we seek a novel KGQA dataset that supports commonsense reasoning and focuses on long-tail entities (e.
• GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended Tasks
  11 Feb 2024 1 repository listed Syntology ran 8 of 9 samples · 1 unverified
  Large language models (LLMs) like ChatGPT, exhibit powerful zero-shot and instruction-following capabilities, have catalyzed a revolutionary transformation across diverse fields, especially for open-ended tasks.
• Leveraging LLMs in Scholarly Knowledge Graph Question Answering
  16 Nov 2023 1 repository listed
  This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner.
• NLQxform: A Language Model-based Question to SPARQL Transformer
  8 Nov 2023 1 repository listed
  In recent years, scholarly data has grown dramatically in terms of both scale and complexity.
• NuTrea: Neural Tree Search for Context-guided Multi-hop KGQA
  24 Oct 2023 1 repository listed Syntology ran 5 of 5 samples · 0 unverified
  Multi-hop Knowledge Graph Question Answering (KGQA) is a task that involves retrieving nodes from a knowledge graph (KG) to answer natural language questions.
• PSYCHIC: A Neuro-Symbolic Framework for Knowledge Graph Question-Answering Grounding
  19 Oct 2023 1 repository listed
  The Scholarly Question Answering over Linked Data (Scholarly QALD) at The International Semantic Web Conference (ISWC) 2023 challenge presents two sub-tasks to tackle question answering (QA) over knowledge graphs (KGs).
• Spider4SPARQL: A Complex Benchmark for Evaluating Knowledge Graph Question Answering Systems
  28 Sep 2023 1 repository listed
  With the recent spike in the number and availability of Large Language Models (LLMs), it has become increasingly important to provide large and realistic benchmarks for evaluating Knowledge Graph Question Answering…
• Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answering
  20 Sep 2023 1 repository listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  To this end, we propose an answer-sensitive KG-to-Text approach that can transform KG knowledge into well-textualized statements most informative for KGQA.
• The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing
  24 May 2023 1 repository listed
  In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing.
• GETT-QA: Graph Embedding based T2T Transformer for Knowledge Graph Question Answering
  23 Mar 2023 1 repository listed
  To further improve the results, we instruct the model to produce a truncated version of the KG embedding for each entity.
• An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answering
  18 Mar 2023 1 repository listed
  Large-scale pre-trained language models (PLMs) such as BERT have recently achieved great success and become a milestone in natural language processing (NLP).

Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.