Datasets › WebQuestionsSP
WebQuestionsSP (WebQuestions Semantic Parses Dataset)
The WebQuestionsSP dataset is released as part of our ACL-2016 paper “The Value of Semantic Parse Labeling for Knowledge Base Question Answering” [Yih, Richardson, Meek, Chang & Suh, 2016], in which we evaluated the value of gathering semantic parses, vs. answers, for a set of questions that originally comes from WebQuestions [Berant et al., 2013]. The WebQuestionsSP dataset contains full semantic parses in SPARQL queries for 4,737 questions, and “partial” annotations for the remaining 1,073 questions for which a valid parse could not be formulated or where the question itself is bad or needs a descriptive answer. This release also includes an evaluation script and the output of the STAGG semantic parsing system when trained using the full semantic parses. More detail can be found in the document and labeling instructions included in this release, as well as the paper.
Benchmarks archive 2025-07-28
All 3 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.
| First row (archive order) | Paper | Code | ||||
|---|---|---|---|---|---|---|
| Knowledge Base Question Answering | WebQuestionsSP | ChatKBQA Hits@1 86.4 | ChatKBQA: A Generate-then-Retrieve Framework for... | lhrlab/chatkbqa | 8 | Compare |
| Semantic Parsing | WebQuestionsSP | ReaRev Accuracy 76.4 | ReaRev: Adaptive Reasoning for Question Answering over... | cmavro/rearev_kgqa | 5 | Compare |
| Question Answering | WebQuestionsSP | ChatGPT Accuracy 83.7 | Can ChatGPT Replace Traditional KBQA Models? An In-depth... | tan92hl/complex-question-answering-evaluation-of-gpt-family +1 | 1 | Compare |
Papers archive 2025-07-28
12 shown of 12 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 61. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.
Dataset loaders archive 2025-07-28
No loader listed in the archive.
Tasks archive 2025-07-28
License archive 2025-07-28
Unknown
Modalities archive 2025-07-28
Languages archive 2025-07-28
No language tagged.
Variants archive 2025-07-28
- WebQSP-WD
- WebQuestionsSP
2 variant names, as the archive lists them.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections