Datasets › StrategyQA
StrategyQA
StrategyQA is a question answering benchmark where the required reasoning steps are implicit in the question, and should be inferred using a strategy. It includes 2,780 examples, each consisting of a strategy question, its decomposition, and evidence paragraphs. Questions in StrategyQA are short, topic-diverse, and cover a wide range of strategies.
Benchmarks archive 2025-07-28
All 1 leaderboard whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.
| First row (archive order) | Paper | Code | ||||
|---|---|---|---|---|---|---|
| Question Answering | StrategyQA | PaLM 2 (few-shot, CoT, SC) Accuracy 90.4 | PaLM 2 Technical Report | eternityyw/tram-benchmark | 12 | Compare |
Papers archive 2025-07-28
6 shown of 6 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 291. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.
| Date | Samples run Syntology | |||
|---|---|---|---|---|
| Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models | 1 | 4 | 26 Mar 2024 | ran 8 of 10 samples (2 unverified) |
| PaLM 2 Technical Report | 1 | 1 | 17 May 2023 | not harvested |
| Search-in-the-Chain: Interactively Enhancing Large Language Models with Search for Knowledge-intensive Tasks | 1 | 1 | 28 Apr 2023 | not harvested |
| Rethinking with Retrieval: Faithful Large Language Model Inference | 1 | 1 | 31 Dec 2022 | not harvested |
| Transcending Scaling Laws with 0.1% Extra Compute | 0 | 3 | 20 Oct 2022 | not harvested |
| Least-to-Most Prompting Enables Complex Reasoning in Large Language Models | 1 | 1 | 21 May 2022 | not harvested |
Dataset loaders archive 2025-07-28
No loader listed in the archive.
Tasks archive 2025-07-28
License archive 2025-07-28
No licence recorded in the archive. Absence here is not a statement about the dataset's terms.
Modalities archive 2025-07-28
Languages archive 2025-07-28
Variants archive 2025-07-28
- StrategyQA
1 variant name, as the archive lists them.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections