Browse State-of-the-Art › Knowledge Base Question Answering
Knowledge Base Question Answering
67 papers with code · 10 benchmarks · 15 datasets archive 2025-07-28
Knowledge Base Q&A is the task of answering questions from a knowledge base.
( Image credit: Modeling Semantics with Gated Graph Neural Networks for Knowledge Base Question Answering )
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
10 leaderboard tables shown for this task, 10 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 5 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): ComplexWebQuestions (1 judged, 0 placed), GrailQA (2 judged, 0 placed), WebQuestions (1 judged, 0 placed), WebQSP (3 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
15 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 136 · with a code link: 67 · where Syntology ran a sample: 16 (10 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (16 of 136 tagged: 10 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 136, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
16 Jul 2024 2 repositories listedSPINACH achieves a new state of the art on the QALD-7, QALD-9 Plus and QALD-10 datasets by 31.
-
14 Mar 2023 2 repositories listedChatGPT is a powerful large language model (LLM) that covers knowledge resources such as Wikipedia and supports natural language question answering using its own knowledge.
-
19 Dec 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)Most existing work for grounded language understanding uses LMs to directly generate plans that can be executed in the environment to achieve the desired effects.
-
1 Nov 2021 2 repositories listedThe high-level decoding generates an AQG as a constraint to prune the search space and reduce the locally ambiguous query graph.
-
4 Sep 2019 2 repositories listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples)Commonsense reasoning aims to empower machines with the human ability to make presumptions about ordinary situations in our daily life.
-
6 Mar 2019 2 repositories listed Syntology official (archive's flag): 1 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples)When answering natural language questions over knowledge bases (KBs), different question components and KB aspects play different roles.
-
6 Dec 2018 2 repositories listedSecond, these two tasks can benefit each other: answer selection can incorporate the external knowledge from knowledge base (KB), while KBQA can be improved by learning contextual information from answer selection.
-
18 Feb 2025 1 repository listedKnowledge base question answering (KBQA) aims to answer user questions in natural language using rich human knowledge stored in large KBs.
-
31 Jan 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 8 harvested samples)Moreover, it employs MCTS, a heuristic search method driven by policy and reward models, to balance agentic exploration's performance and search space.
-
24 Dec 2024 1 repository listedRetrieval from graph data is crucial for augmenting large language models (LLM) with both open-domain knowledge and private enterprise data, and it is also a key component in the recent GraphRAG system (edge et al.…
-
18 Oct 2024 1 repository listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 1 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 2 pointer-only (licence)In order to improve the efficiency, PoG prunes irrelevant information from the graph exploration first and introduces efficient three-step pruning techniques that incorporate graph structures, LLM prompting, and a…
-
1 Oct 2024 1 repository listedWe apply the grammar to knowledge base question answering, where the constraints by candidate expressions assist a semantic parser to generate valid KB elements.
-
5 Aug 2024 1 repository listedAdvancements in AI and natural language processing have revolutionized machine-human language interactions, with question answering (QA) systems playing a pivotal role.
-
29 Jun 2024 1 repository listedExisting KBQA methods have traditionally relied on multi-stage methodologies, involving tasks such as entity linking, subgraph retrieval and query structure generation.
-
26 Jun 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)Based on preference data, DPA-RAG accomplishes both external and internal preference alignment: 1) It jointly integrate pair-wise, point-wise, and contrastive preference alignment abilities into the reranker, achieving…
-
16 Mar 2024 1 repository listedAn essential requirement for a real-world Knowledge Base Question Answering (KBQA) system is the ability to detect the answerability of questions when generating logical forms.
-
23 Feb 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples) · 10 pointer-only (licence)To tackle these hurdles, we introduce Interactive-KBQA, a framework designed to generate logical forms through direct interaction with knowledge bases (KBs).
-
22 Feb 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)We evaluated the performance of our framework using three benchmark datasets, and the results show that our framework outperforms state-of-the-art systems on the LC-QuAD and YAGO-QA benchmarks, yielding F1 scores of 11.
-
24 Jan 2024 1 repository listedMost existing methods use a paradigm that treats the question as the objective, with relevant knowledge being incrementally retrieved from the knowledge graph.
-
19 Dec 2023 1 repository listedTo address this issue, we construct a dual relation graph where each node denotes a relation in the original KG (primal entity graph) and edges are constructed between relations sharing same head or tail entities.
-
15 Nov 2023 1 repository listedAdditional experiments show that FuSIC-KBQA also outperforms SoTA KBQA models in the in-domain setting when training data is limited.
-
6 Nov 2023 1 repository listedWe present the dataset GeoQuestions1089 for benchmarking geospatial question answering engines.
-
13 Oct 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 1 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples) · 4 pointer-only (licence)Knowledge Base Question Answering (KBQA) aims to answer natural language questions over large-scale knowledge bases (KBs), which can be summarized into two crucial steps: knowledge retrieval and semantic parsing.
-
15 Sep 2023 1 repository listedLanguage models (LMs) have already demonstrated remarkable abilities in understanding and generating both natural and formal language.
-
28 Aug 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 10 pointer-only (licence)Knowledge Base Question Answering (KBQA) aims to answer natural language questions with factual information such as entities and relations in KBs.
-
23 Aug 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)Knowledge base question answering (KBQA) is a critical yet challenging task due to the vast number of entities within knowledge bases and the diversity of natural language questions posed by users.
-
15 Aug 2023 1 repository listedThis paper explores GPT-3 for answering natural language questions over Linked Data.
-
13 Jun 2023 1 repository listedTo verify that QDT can enhance KBQA task, we design a decomposition-based KBQA system called QDTQA.
-
31 May 2023 1 repository listedIn this work we present a system, developed for the European Space Agency (ESA), that can answer complex natural language queries, to support engineers in accessing the information contained in a KB that models the…
-
23 May 2023 1 repository listedBy pairing our semantic parser with GPT-3, we combine verifiable results with qualified GPT-3 guesses to provide useful answers to 96% of the questions in dev.
-
6 May 2023 1 repository listed
-
2 May 2023 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 16 harvested samples)
-
23 Mar 2023 1 repository listed
-
1 Mar 2023 1 repository listed
-
26 Dec 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
1 Dec 2022 1 repository listed
-
1 Jul 2022 1 repository listed
-
17 Apr 2022 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
27 Feb 2022 1 repository listed
-
22 Feb 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
12 Dec 2021 1 repository listed
-
25 Oct 2021 1 repository listed
-
17 Sep 2021 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
8 Sep 2021 1 repository listed
-
15 Aug 2021 1 repository listed
-
1 Aug 2021 1 repository listed
-
1 Aug 2021 1 repository listed
-
1 Jun 2021 1 repository listed
-
11 Jan 2021 1 repository listed
-
29 Dec 2020 1 repository listed
-
3 Dec 2020 1 repository listed
-
1 Dec 2020 1 repository listed
-
16 Nov 2020 1 repository listed
-
29 Oct 2020 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
29 Oct 2020 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
21 May 2020 1 repository listed
-
24 Dec 2019 1 repository listed
-
16 Dec 2019 1 repository listed
-
17 Jul 2019 1 repository listed
-
1 Nov 2018 1 repository listed
-
1 Oct 2018 1 repository listed
-
13 Aug 2018 1 repository listed
-
27 Jun 2018 1 repository listed
-
23 Apr 2018 1 repository listed
-
26 Feb 2018 1 repository listed
-
25 Aug 2017 1 repository listed
-
1 Jul 2015 1 repository listed
-
iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering2 Jun 2025 0 repositories listed
-
Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answering20 May 2025 0 repositories listed
-
Private LoRA Fine-tuning of Open-Source LLMs with Homomorphic Encryption12 May 2025 0 repositories listed
-
MCTS-KBQA: Monte Carlo Tree Search for Knowledge Base Question Answering19 Feb 2025 0 repositories listed
-
TARGA: Targeted Synthetic Data Generation for Practical Reasoning over Structured Data27 Dec 2024 0 repositories listed
-
SAKA: An Intelligent Platform for Semi-automated Knowledge Graph Construction and Application10 Oct 2024 0 repositories listed
-
A Learn-Then-Reason Model Towards Generalization in Knowledge Base Question Answering20 Jun 2024 0 repositories listed
-
Robust Few-shot Transfer Learning for Knowledge Base Question Answering with Unanswerable Questions20 Jun 2024 0 repositories listed
-
Temporal Knowledge Graph Question Answering: A Survey20 Jun 2024 0 repositories listed
-
MASSIVE Multilingual Abstract Meaning Representation: A Dataset and Baselines for Hallucination Detection29 May 2024 0 repositories listed
-
How Proficient Are Large Language Models in Formal Languages? An In-Depth Insight for Knowledge Base Question Answering11 Jan 2024 0 repositories listed
-
In-Context Learning for Knowledge Base Question Answering for Unmanned Systems based on Large Language Models6 Nov 2023 0 repositories listed
-
Robust NL-to-Cypher Translation for KBQA: Harnessing Large Language Model with Chain of Prompts28 Oct 2023 0 repositories listed
-
An In-Context Schema Understanding Method for Knowledge Base Question Answering22 Oct 2023 0 repositories listed
-
ADMUS: A Progressive Question Answering Framework Adaptable to Multiple Knowledge Sources9 Aug 2023 0 repositories listed
-
VisKoP: Visual Knowledge oriented Programming for Interactive Knowledge Base Question Answering6 Jul 2023 0 repositories listed
-
FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base Question Answering26 Jun 2023 0 repositories listed
-
Make a Choice! Knowledge Base Question Answering with In-Context Learning23 May 2023 0 repositories listed
-
From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Base5 May 2023 0 repositories listed
-
Pay More Attention to Relation Exploration for Knowledge Base Question Answering3 May 2023 0 repositories listed
-
Knowledge Base Question Answering: A Semantic Parsing Perspective12 Sep 2022 0 repositories listed
-
Knowledge-enhanced Iterative Instruction Generation and Reasoning for Knowledge Base Question Answering7 Sep 2022 0 repositories listed
-
Generating Questions from Wikidata Triples1 Jun 2022 0 repositories listed
-
A Method of Query Graph Reranking for Knowledge Base Question Answering27 Apr 2022 0 repositories listed
-
Better Query Graph Selection for Knowledge Base Question Answering27 Apr 2022 0 repositories listed
-
CBR-iKB: A Case-Based Reasoning Approach for Question Answering over Incomplete Knowledge Bases18 Apr 2022 0 repositories listed
-
Targeted Extraction of Temporal Facts from Textual Resources for Improved Temporal Question Answering over Knowledge Bases21 Mar 2022 0 repositories listed
-
16 Jan 2022 0 repositories listed
-
Learning to Transpile AMR into SPARQL16 Jan 2022 0 repositories listed
-
15 Jan 2022 0 repositories listed
-
Learning to Transpile AMR into SPARQL15 Dec 2021 0 repositories listed
-
Few-shot Multi-hop Question Answering over Knowledge Base14 Dec 2021 0 repositories listed
-
Semantic Answer Type and Relation Prediction Task (SMART 2021)7 Dec 2021 0 repositories listed
Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections