Browse State-of-the-Art › Question Generation
Question Generation
264 papers with code · 11 benchmarks · 25 datasets archive 2025-07-28
The goal of Question Generation is to generate a valid and fluent question according to a given passage and the target answer. Question Generation can be used in many scenarios, such as automatic tutoring systems, improving the performance of Question Answering models and enabling chatbots to lead a conversation.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
11 leaderboard tables shown for this task, 11 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 11 until expanded.
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
25 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 664 · with a code link: 264 · where Syntology ran a sample: 47 (36 with a run with no instrument failure, 11 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (47 of 664 tagged: 36 with a run with no instrument failure, 11 where every run was a failure of Syntology's instrument)
Page 1 of 7: papers 1 to 100 of 664, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
23 Oct 2019 57 repositories listed Syntology 21 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 1 honoured, 0 violated, 19 with no contract checked; 1 where Syntology's instrument failed) · 10 unverified (of 31 harvested samples)Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP).
-
7 Oct 2016 25 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 7 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified (of 14 harvested samples) · 14 pointer-only (licence)We observe that our method consistently outperforms BS and previously proposed techniques for diverse decoding from neural sequence models.
-
29 Apr 2017 10 repositories listedWe study automatic question generation for sentences from text passages in reading comprehension.
-
8 May 2019 9 repositories listedThis paper presents a new Unified pre-trained Language Model (UniLM) that can be fine-tuned for both natural language understanding and generation tasks.
-
6 Apr 2017 6 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Automatic question generation aims to generate questions from a text passage where the generated questions can be answered by certain sub-spans of the given passage.
-
26 Jan 2020 5 repositories listedCurrent pre-training works in natural language generation pay little attention to the problem of exposure bias on downstream tasks.
-
13 Jan 2020 5 repositories listedThis paper presents a new sequence-to-sequence pre-training model called ProphetNet, which introduces a novel self-supervised objective named future n-gram prediction and the proposed n-stream self-attention mechanism.
-
24 Oct 2024 4 repositories listed Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)Despite the availability of several open-source multimodal datasets, limitations in the scale and quality of open-source instruction data hinder the performance of VLMs trained on these datasets, leading to a…
-
23 Dec 2020 4 repositories listedOpen-domain question answering can be reformulated as a phrase retrieval problem, without the need for processing documents on-demand during inference (Seo et al., 2019).
-
3 May 2020 4 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 1 pointer-only (licence)Question generation (QG) is a natural language generation task where a model is trained to ask questions corresponding to some input text.
-
12 Jun 2019 4 repositories listedWe introduce a novel method of generating synthetic question answering corpora by combining models of question generation and answer extraction, and by filtering the results to ensure roundtrip consistency.
-
4 May 2017 4 repositories listedWe propose a recurrent neural model that generates natural-language questions from documents, conditioned on answers.
-
7 Mar 2022 3 repositories listedWe introduce IT5, the first family of encoder-decoder transformer models pretrained specifically on Italian.
-
8 Sep 2021 3 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)We crafted questions that some humans would answer falsely due to a false belief or misconception.
-
16 Apr 2021 3 repositories listedProphetNet is a pre-training based natural language generation method which shows powerful performance on English text summarization and question generation tasks.
-
1 Nov 2020 3 repositories listedThis paper presents a new sequence-to-sequence pre-training model called ProphetNet, which introduces a novel self-supervised objective named future n-gram prediction and the proposed n-stream self-attention mechanism.
-
16 Jul 2020 3 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 2 pointer-only (licence)We show that the PLMs BART and T5 achieve new state-of-the-art results and that task-adaptive pretraining strategies improve their performance even further.
-
28 Feb 2020 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We propose to pre-train a unified language model for both autoencoding and partially autoregressive language modeling tasks using a novel training procedure, referred to as a pseudo-masked language model (PMLM).
-
8 May 2015 3 repositories listed Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)A suite of baseline results on this new dataset are also presented.
-
10 Jul 2023 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)In this paper, we propose QGA-EE, which enables a Question Generation (QG) model to generate questions that incorporate rich contextual information instead of using fixed templates.
-
15 May 2023 2 repositories listed Syntology official (archive's flag): 3 ran · 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 15 harvested samples)Diffusion models have emerged as a powerful paradigm for generation, obtaining strong performance in various continuous domains.
-
20 Dec 2022 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)Context is everything, even in commonsense moral reasoning.
-
28 Jun 2022 2 repositories listedGenerate-then-rank is a widely used mechanism for text generation, where a generator produces multiple text candidates and a ranker chooses the best one among the text candidates.
-
4 May 2022 2 repositories listed Syntology official: not harvested · 0 ran · 1 unverified (of 1 harvested sample)Visual Question Answering (VQA) has benefited from increasingly sophisticated models, but has not enjoyed the same level of engagement in terms of data creation.
-
11 Apr 2022 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)Grounded text generation systems often generate text that contains factual inconsistencies, hindering their real-world applicability.
-
5 Sep 2021 2 repositories listedCoherence is an important aspect of text quality and is crucial for ensuring its readability.
-
25 Jun 2021 2 repositories listedWhile pretrained encoders have achieved success in various natural language understanding (NLU) tasks, there is a gap between these pretrained encoders and natural language generation (NLG).
-
15 Apr 2021 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)QuestEval is a reference-less metric used in text-to-text tasks, that compares the generated summaries directly to the source text, by automatically asking and answering questions.
-
18 Feb 2021 2 repositories listedAs a first step towards measuring news informedness at a scale, we study the problem of quiz-style multiple-choice question generation, which may be used to survey users about their knowledge of recent news.
-
30 Oct 2020 2 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)Clinical question answering (QA) aims to automatically answer questions from medical professionals based on clinical texts.
-
14 Apr 2020 2 repositories listed
-
27 Jan 2020 2 repositories listed Syntology official (archive's flag): 6 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 2 pointer-only (licence)
-
13 Sep 2019 2 repositories listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 1 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 19 harvested samples) · 1 pointer-only (licence)
-
7 Jun 2019 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
19 Mar 2016 2 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
30 May 2025 1 repository listed
-
22 May 2025 1 repository listed
-
21 May 2025 1 repository listed
-
18 May 2025 1 repository listed
-
3 May 2025 1 repository listed
-
2 May 2025 1 repository listed
-
28 Apr 2025 1 repository listed
-
22 Dec 2024 1 repository listed
-
17 Dec 2024 1 repository listed
-
5 Dec 2024 1 repository listed
-
17 Oct 2024 1 repository listed
-
16 Oct 2024 1 repository listed
-
13 Oct 2024 1 repository listed
-
4 Oct 2024 1 repository listed
-
26 Sep 2024 1 repository listed
-
3 Sep 2024 1 repository listed
-
16 Aug 2024 1 repository listed
-
8 Aug 2024 1 repository listed
-
31 Jul 2024 1 repository listed
-
30 Jul 2024 1 repository listed
-
6 Jul 2024 1 repository listed
-
9 Jun 2024 1 repository listed
-
6 Jun 2024 1 repository listed
-
23 May 2024 1 repository listed
-
17 May 2024 1 repository listed
-
21 Apr 2024 1 repository listed
-
18 Apr 2024 1 repository listed
-
17 Apr 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
16 Apr 2024 1 repository listed
-
3 Apr 2024 1 repository listed
-
2 Apr 2024 1 repository listed
-
31 Mar 2024 1 repository listed
-
17 Mar 2024 1 repository listed
-
1 Mar 2024 1 repository listed
-
22 Feb 2024 1 repository listed
-
20 Feb 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
14 Feb 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
19 Jan 2024 1 repository listed
-
6 Dec 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
2 Dec 2023 1 repository listed
-
30 Oct 2023 1 repository listed
-
29 Oct 2023 1 repository listed
-
25 Oct 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
25 Oct 2023 1 repository listed
-
23 Oct 2023 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
23 Oct 2023 1 repository listed
-
23 Oct 2023 1 repository listed
-
23 Oct 2023 1 repository listed
-
23 Oct 2023 1 repository listed
-
23 Oct 2023 1 repository listed
-
21 Oct 2023 1 repository listed
-
20 Oct 2023 1 repository listed
-
20 Oct 2023 1 repository listed
-
12 Oct 2023 1 repository listed
-
9 Oct 2023 1 repository listed
-
8 Oct 2023 1 repository listed
-
28 Sep 2023 1 repository listed
-
28 Sep 2023 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 9 unverified (of 17 harvested samples)
-
7 Jul 2023 1 repository listed
-
21 Jun 2023 1 repository listed
-
17 Jun 2023 1 repository listed
-
Improving Reading Comprehension Question Generation with Data Augmentation and Overgenerate-and-rank15 Jun 2023 1 repository listed
-
12 Jun 2023 1 repository listed
-
26 May 2023 1 repository listed
-
23 May 2023 1 repository listed
Syntology lines on 27 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections