Browse State-of-the-Art › Graph Question Answering
Graph Question Answering
42 papers with code · 1 benchmark · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| GQA (2 rows) | GraphVQA | GraghVQA: Language-Guided Graph Neural Networks for Graph-based... | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 78 · with a code link: 42 · where Syntology ran a sample: 12 (10 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (12 of 78 tagged: 10 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 78 of 78, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
10 Dec 2021 3 repositories listedThe first computes a textual representation of a given question, the second combines it with the entity embeddings for entities involved in the question, and the third generates question-specific time embeddings.
-
12 Feb 2024 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Given a graph with textual attributes, we enable users to `chat with their graph': that is, to ask questions about the graph using a conversational interface.
-
25 May 2022 2 repositories listedThe construction of this test collection also sheds light on the challenges of constructing large-scale KGQA datasets with genuinely NL questions.
-
11 Jun 2025 1 repository listedIn this work, we propose RAPL, a novel framework for efficient and effective graph retrieval in KGQA.
-
3 Mar 2025 1 repository listedOur approach relies on large language models (LLMs) to generate semantically precise natural language paraphrases of structured queries.
-
10 Feb 2025 1 repository listedMitigating positional bias of language models (LMs) for listwise inputs is a well-known and important problem (e. g., lost-in-the-middle).
-
6 Feb 2025 1 repository listedMost existing Knowledge Graph Question Answering (KGQA) approaches are designed for a specific KG, such as Wikidata, DBpedia or Freebase.
-
24 Dec 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)The Amar framework comprises two key sub-components: 1) a self-alignment module that aligns commonalities among entities, relations, and subgraphs to enhance retrieved text, thereby reducing noise interference; 2) a…
-
8 Oct 2024 1 repository listedSemantic parsing that translates natural language queries to SPARQL is of great importance for Knowledge Graph Question Answering (KGQA) systems.
-
2 Oct 2024 1 repository listedKnowledge graph question answering (KGQA) involves answering natural language questions by leveraging structured information stored in a knowledge graph.
-
29 Sep 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Recent studies have explored the use of Large Language Models (LLMs) with Retrieval Augmented Generation (RAG) for Knowledge Graph Question Answering (KGQA).
-
24 Sep 2024 1 repository listedWhile being one of the most popular question types, simple questions such as "Who is the author of Cinderella?
-
5 Sep 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Furthermore, the integration experiments with various LLMs on the mentioned datasets highlight the flexibility of DoG.
-
8 Jul 2024 1 repository listedIn this research, we propose a simplified approach to enhance multilingual KGQA systems by incorporating linguistic context and entity information directly into the processing pipeline of a language model.
-
29 Jun 2024 1 repository listedOn the widely used popular knowledge graph, we discover over 90 factual errors which provide scenarios for agents to make discoveries and demonstrate the effectiveness of our approach.
-
20 Jun 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)In TAGLAS, we collect and integrate more than 23 TAG datasets with domains ranging from citation graphs to molecule graphs and tasks from node classification to graph question-answering.
-
7 Jun 2024 1 repository listedWe present LinkQ, a system that leverages a large language model (LLM) to facilitate knowledge graph (KG) query construction through natural language question-answering.
-
30 May 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)In our GNN-RAG framework, the GNN acts as a dense subgraph reasoner to extract useful graph information, while the LLM leverages its natural language processing ability for ultimate KGQA.
-
23 Apr 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 2 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 11 pointer-only (licence)To simulate these real-world scenarios and evaluate the ability of LLMs to integrate internal and external knowledge, we propose leveraging LLMs for QA under Incomplete Knowledge Graph (IKGQA), where the provided KG…
-
3 Mar 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)In this work, we seek a novel KGQA dataset that supports commonsense reasoning and focuses on long-tail entities (e. g., non-mainstream and recent entities) where LLMs frequently hallucinate, and thus create the need…
-
11 Feb 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 1 pointer-only (licence)Large language models (LLMs) like ChatGPT, exhibit powerful zero-shot and instruction-following capabilities, have catalyzed a revolutionary transformation across diverse fields, especially for open-ended tasks.
-
16 Nov 2023 1 repository listedThis paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner.
-
8 Nov 2023 1 repository listedIn recent years, scholarly data has grown dramatically in terms of both scale and complexity.
-
24 Oct 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 4 pointer-only (licence)Multi-hop Knowledge Graph Question Answering (KGQA) is a task that involves retrieving nodes from a knowledge graph (KG) to answer natural language questions.
-
19 Oct 2023 1 repository listedThe Scholarly Question Answering over Linked Data (Scholarly QALD) at The International Semantic Web Conference (ISWC) 2023 challenge presents two sub-tasks to tackle question answering (QA) over knowledge graphs (KGs).
-
28 Sep 2023 1 repository listedWith the recent spike in the number and availability of Large Language Models (LLMs), it has become increasingly important to provide large and realistic benchmarks for evaluating Knowledge Graph Question Answering…
-
Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answering20 Sep 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)To this end, we propose an answer-sensitive KG-to-Text approach that can transform KG knowledge into well-textualized statements most informative for KGQA.
-
24 May 2023 1 repository listedIn this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing.
-
23 Mar 2023 1 repository listedTo further improve the results, we instruct the model to produce a truncated version of the KG embedding for each entity.
-
18 Mar 2023 1 repository listedLarge-scale pre-trained language models (PLMs) such as BERT have recently achieved great success and become a milestone in natural language processing (NLP).
-
7 Dec 2022 1 repository listed
-
24 Oct 2022 1 repository listed
-
23 Jul 2022 1 repository listed
-
30 May 2022 1 repository listed
-
13 May 2022 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
31 Jan 2022 1 repository listed
-
Knowledge Graph Question Answering Leaderboard: A Community Resource to Prevent a Replication Crisis20 Jan 2022 1 repository listed
-
25 Oct 2021 1 repository listed
-
22 Sep 2021 1 repository listed
-
20 Apr 2021 1 repository listed
-
11 Mar 2021 1 repository listed
-
25 Aug 2017 1 repository listed
-
Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarking29 May 2025 0 repositories listed
-
Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answering18 May 2025 0 repositories listed
-
CoLoTa: A Dataset for Entity-based Commonsense Reasoning over Long-Tail Knowledge20 Apr 2025 0 repositories listed
-
Human Cognition Inspired RAG with Knowledge Graph for Complex Problem Solving9 Mar 2025 0 repositories listed
-
EPERM: An Evidence Path Enhanced Reasoning Model for Knowledge Graph Question and Answering22 Feb 2025 0 repositories listed
-
Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answering17 Feb 2025 0 repositories listed
-
Visual Graph Question Answering with ASP and LLMs for Language Parsing13 Feb 2025 0 repositories listed
-
Comprehensive Evaluation for a Large Scale Knowledge Graph Question Answering Service28 Jan 2025 0 repositories listed
-
GraphSOS: Graph Sampling and Order Selection to Help LLMs Understand Graphs Better24 Jan 2025 0 repositories listed
-
A Method for Multi-Hop Question Answering on Persian Knowledge Graph18 Jan 2025 0 repositories listed
-
KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregation30 Dec 2024 0 repositories listed
-
NGQA: A Nutritional Graph Question Answering Benchmark for Personalized Health-aware Nutritional Reasoning20 Dec 2024 0 repositories listed
-
Graph Learning in the Era of LLMs: A Survey from the Perspective of Data, Models, and Tasks17 Dec 2024 0 repositories listed
-
LLM-based Discriminative Reasoning for Knowledge Graph Question Answering17 Dec 2024 0 repositories listed
-
KaLM: Knowledge-aligned Autoregressive Language Modeling via Dual-view Knowledge Graph Contrastive Learning6 Dec 2024 0 repositories listed
-
Integrating Multi-Head Convolutional Encoders with Cross-Attention for Improved SPARQL Query Translation24 Aug 2024 0 repositories listed
-
Dynamic Few-Shot Learning for Knowledge Graph Question Answering1 Jul 2024 0 repositories listed
-
Temporal Knowledge Graph Question Answering: A Survey20 Jun 2024 0 repositories listed
-
UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Models4 Jun 2024 0 repositories listed
-
FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answering22 May 2024 0 repositories listed
-
KG-RAG: Bridging the Gap Between Knowledge and Creativity20 May 2024 0 repositories listed
-
2 Apr 2024 0 repositories listed
-
Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering3 Mar 2024 0 repositories listed
-
26 Feb 2024 0 repositories listed
-
Question Answering Over Spatio-Temporal Knowledge Graph18 Feb 2024 0 repositories listed
-
Joint Multi-Facts Reasoning Network For Complex Temporal Question Answering Over Knowledge Graph4 Jan 2024 0 repositories listed
-
Answer Candidate Type Selection: Text-to-Text Language Model for Closed Book Question Answering Meets Knowledge Graphs10 Oct 2023 0 repositories listed
-
Knowledge Graph Question Answering for Materials Science (KGQA4MAT): Developing Natural Language Interface for Metal-Organic Frameworks Knowledge Graph (MOF-KG) Using LLM20 Sep 2023 0 repositories listed
-
Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering7 Jun 2023 0 repositories listed
-
24 Feb 2023 0 repositories listed
-
Medical Knowledge Graph QA for Drug-Drug Interaction Prediction based on Multi-hop Machine Reading Comprehension19 Dec 2022 0 repositories listed
-
Graph-augmented Learning to Rank for Querying Large-scale Knowledge Graph20 Nov 2021 0 repositories listed
-
A Neural Approach to KGQA via SPARQL Silhouette Generation16 Nov 2021 0 repositories listed
-
Knowledge Graph Question Answering via SPARQL Silhouette Generation6 Sep 2021 0 repositories listed
-
Question-Aware Memory Network for Multi-hop Question Answering in Human-Robot Interaction27 Apr 2021 0 repositories listed
-
Complex Factoid Question Answering with a Free-Text Knowledge Graph23 Mar 2021 0 repositories listed
Syntology lines on 12 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections