Knowledge Base Question Answering

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

10 leaderboard tables shown for this task, 10 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

15 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 67 papers with code (136 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questions
  16 Jul 2024 2 repositories listed
  SPINACH achieves a new state of the art on the QALD-7, QALD-9 Plus and QALD-10 datasets by 31.
• Can ChatGPT Replace Traditional KBQA Models? An In-depth Analysis of the Question Answering Performance of the GPT LLM Family
  14 Mar 2023 2 repositories listed
  ChatGPT is a powerful large language model (LLM) that covers knowledge resources such as Wikipedia and supports natural language question answering using its own knowledge.
• Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments
  19 Dec 2022 2 repositories listed Syntology ran 1 of 3 samples · 2 unverified · 3 pointer-only (licence)
  Most existing work for grounded language understanding uses LMs to directly generate plans that can be executed in the environment to achieve the desired effects.
• Outlining and Filling: Hierarchical Query Graph Generation for Answering Complex Questions over Knowledge Graphs
  1 Nov 2021 2 repositories listed
  The high-level decoding generates an AQG as a constraint to prune the search space and reduce the locally ambiguous query graph.
• KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoning
  4 Sep 2019 2 repositories listed Syntology ran 1 of 12 samples · 11 unverified
  Commonsense reasoning aims to empower machines with the human ability to make presumptions about ordinary situations in our daily life.
• Bidirectional Attentive Memory Networks for Question Answering over Knowledge Bases
  6 Mar 2019 2 repositories listed Syntology ran 0 of 11 samples · 11 unverified
  When answering natural language questions over knowledge bases (KBs), different question components and KB aspects play different roles.
• Multi-Task Learning with Multi-View Attention for Answer Selection and Knowledge Base Question Answering
  6 Dec 2018 2 repositories listed
  Second, these two tasks can benefit each other: answer selection can incorporate the external knowledge from knowledge base (KB), while KBQA can be improved by learning contextual information from answer selection.
• Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generation
  18 Feb 2025 1 repository listed
  Knowledge base question answering (KBQA) aims to answer user questions in natural language using rich human knowledge stored in large KBs.
• KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search
  31 Jan 2025 1 repository listed Syntology ran 2 of 8 samples · 6 unverified
  Moreover, it employs MCTS, a heuristic search method driven by policy and reward models, to balance agentic exploration's performance and search space.
• CypherBench: Towards Precise Retrieval over Full-scale Modern Knowledge Graphs in the LLM Era
  24 Dec 2024 1 repository listed
  Retrieval from graph data is crucial for augmenting large language models (LLM) with both open-domain knowledge and private enterprise data, and it is also a key component in the recent GraphRAG system (edge et al.,…
• Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning
  18 Oct 2024 1 repository listed Syntology ran 1 of 12 samples · 11 unverified
  In order to improve the efficiency, PoG prunes irrelevant information from the graph exploration first and introduces efficient three-step pruning techniques that incorporate graph structures, LLM prompting, and a…
• Semantic Parsing with Candidate Expressions for Knowledge Base Question Answering
  1 Oct 2024 1 repository listed
  We apply the grammar to knowledge base question answering, where the constraints by candidate expressions assist a semantic parser to generate valid KB elements.
• Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Construction
  5 Aug 2024 1 repository listed
  Advancements in AI and natural language processing have revolutionized machine-human language interactions, with question answering (QA) systems playing a pivotal role.
• SPARKLE: Enhancing SPARQL Generation with Direct KG Integration in Decoding
  29 Jun 2024 1 repository listed
  Existing KBQA methods have traditionally relied on multi-stage methodologies, involving tasks such as entity linking, subgraph retrieval and query structure generation.
• Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation
  26 Jun 2024 1 repository listed Syntology ran 1 of 3 samples · 2 unverified · 3 pointer-only (licence)
  Based on preference data, DPA-RAG accomplishes both external and internal preference alignment: 1) It jointly integrate pair-wise, point-wise, and contrastive preference alignment abilities into the reranker, achieving…
• RetinaQA: A Robust Knowledge Base Question Answering Model for both Answerable and Unanswerable Questions
  16 Mar 2024 1 repository listed
  An essential requirement for a real-world Knowledge Base Question Answering (KBQA) system is the ability to detect the answerability of questions when generating logical forms.
• Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models
  23 Feb 2024 1 repository listed Syntology ran 7 of 10 samples · 3 unverified · 10 pointer-only (licence)
  To tackle these hurdles, we introduce Interactive-KBQA, a framework designed to generate logical forms through direct interaction with knowledge bases (KBs).
• Triad: A Framework Leveraging a Multi-Role LLM-based Agent to Solve Knowledge Base Question Answering
  22 Feb 2024 1 repository listed Syntology ran 5 of 5 samples · 0 unverified
  We evaluated the performance of our framework using three benchmark datasets, and the results show that our framework outperforms state-of-the-art systems on the LC-QuAD and YAGO-QA benchmarks, yielding F1 scores of 11.
• Fine-Grained Stateful Knowledge Exploration: A Novel Paradigm for Integrating Knowledge Graphs with Large Language Models
  24 Jan 2024 1 repository listed
  Most existing methods use a paradigm that treats the question as the objective, with relevant knowledge being incrementally retrieved from the knowledge graph.
• Relation-Aware Question Answering for Heterogeneous Knowledge Graphs
  19 Dec 2023 1 repository listed
  To address this issue, we construct a \textbf{dual relation graph} where each node denotes a relation in the original KG (\textbf{primal entity graph}) and edges are constructed between relations sharing same head or…
• Few-shot Transfer Learning for Knowledge Base Question Answering: Fusing Supervised Models with In-Context Learning
  15 Nov 2023 1 repository listed
  Additional experiments show that FuSIC-KBQA also outperforms SoTA KBQA models in the in-domain setting when training data is limited.
• Benchmarking Geospatial Question Answering Engines using the Dataset GeoQuestions1089
  6 Nov 2023 1 repository listed
  We present the dataset GeoQuestions1089 for benchmarking geospatial question answering engines.
• ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models
  13 Oct 2023 1 repository listed Syntology ran 8 of 16 samples · 8 unverified
  Knowledge Base Question Answering (KBQA) aims to answer natural language questions over large-scale knowledge bases (KBs), which can be summarized into two crucial steps: knowledge retrieval and semantic parsing.
• Data Distribution Bottlenecks in Grounding Language Models to Knowledge Bases
  15 Sep 2023 1 repository listed
  Language models (LMs) have already demonstrated remarkable abilities in understanding and generating both natural and formal language.
• Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQA
  28 Aug 2023 1 repository listed Syntology ran 10 of 10 samples · 0 unverified · 10 pointer-only (licence)
  Knowledge Base Question Answering (KBQA) aims to answer natural language questions with factual information such as entities and relations in KBs.
• FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering
  23 Aug 2023 1 repository listed Syntology ran 4 of 4 samples · 0 unverified
  Knowledge base question answering (KBQA) is a critical yet challenging task due to the vast number of entities within knowledge bases and the diversity of natural language questions posed by users.
• Question Answering over Linked Data with GPT-3
  15 Aug 2023 1 repository listed
  This paper explores GPT-3 for answering natural language questions over Linked Data.
• Question Decomposition Tree for Answering Complex Questions over Knowledge Bases
  13 Jun 2023 1 repository listed
  To verify that QDT can enhance KBQA task, we design a decomposition-based KBQA system called QDTQA.
• Knowledge Base Question Answering for Space Debris Queries
  31 May 2023 1 repository listed
  In this work we present a system, developed for the European Space Agency (ESA), that can answer complex natural language queries, to support engineers in accessing the information contained in a KB that models the…
• Fine-tuned LLMs Know More, Hallucinate Less with Few-Shot Sequence-to-Sequence Semantic Parsing over Wikidata
  23 May 2023 1 repository listed
  By pairing our semantic parser with GPT-3, we combine verifiable results with qualified GPT-3 guesses to provide useful answers to 96% of the questions in dev.

Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.