Browse State-of-the-Art › Generative Question Answering

Generative Question Answering

12 papers with code · 2 benchmarks · 6 datasets archive 2025-07-28

MiscellaneousNatural Language ProcessingReasoning

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology 1 newer paper was judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): CoQA (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).

DatasetBest model (first row in archive order)PaperCodeSyntologyCompare
CICERO (4 rows) T5-large pre-trained on GLUCOSE CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues code — Compare
CoQA (3 rows) ERNIE-GEN ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning... code — Compare

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

6 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Papers archive 2025-07-28

archive papers tagged: 45 · with a code link: 12 · where Syntology ran a sample: 2 (1 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (2 of 45 tagged: 1 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 45 of 45, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.

  • 8 May 2019 9 repositories listed
    This paper presents a new Unified pre-trained Language Model (UniLM) that can be fine-tuned for both natural language understanding and generation tasks.
  • 26 Jan 2020 5 repositories listed
    Current pre-training works in natural language generation pay little attention to the problem of exposure bias on downstream tasks.
  • Humans gather information by engaging in conversations involving a series of interconnected questions and answers.
  • 6 Sep 2021 2 repositories listed
    Despite the successes of pretrained language models, there are still few high-quality, general-purpose QA systems that are freely available.
  • 14 Apr 2020 2 repositories listed
    An extensive set of experiments show that PALM achieves new state-of-the-art results on a variety of language generation benchmarks covering generative question answering (Rank 1 on the official MARCO leaderboard)…
  • Reducing the `hallucination' problem of Large Language Models (LLMs) is crucial for their wide applications.
  • 27 Mar 2024 1 repository listed
    We propose a pipeline to extract information from free-text radiology reports, that fits with the items of the reference SR registry proposed by a national society of interventional and medical radiology, focusing on CT…
  • 9 Feb 2024 1 repository listed
    In this paper, we present the current progress of the project Verif. ai, an open-source scientific generative question-answering system with referenced and verified answers.
  • 20 Sep 2023 1 repository listed
    In recent years, significant advancements in pre-trained language models have driven the creation of numerous non-English language variants, with a particular emphasis on encoder-only and decoder-only architectures.
  • 14 Nov 2022 1 repository listed
    We propose a retrieval-augmented generative QA model (R-GQA) for event argument extraction.
  • 1 May 2020 1 repository listed
    To evaluate our metric, we create high-quality human judgments of correctness on two GenQA datasets.
  • 4 Dec 2015 1 repository listed
    Empirical study shows the proposed model can effectively deal with the variations of questions and answers, and generate right and natural answers by referring to the facts in the knowledge-base.
  • Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMs
    18 Feb 2025 0 repositories listed
    Previous approaches to persona simulation large language models (LLMs) have typically relied on learning basic biographical information, or using limited role-play dialogue datasets to capture a character's responses.
  • EvidenceMap: Learning Evidence Analysis to Unleash the Power of Small Language Models for Biomedical Question Answering
    22 Jan 2025 0 repositories listed
    When addressing professional questions in the biomedical domain, humans typically acquire multiple pieces of information as evidence and engage in multifaceted evidence analysis to provide high-quality answers.
  • Evidence-Enhanced Triplet Generation Framework for Hallucination Alleviation in Generative Question Answering
    27 Aug 2024 0 repositories listed
    To address the hallucination in generative question answering (GQA) where the answer can not be derived from the document, we propose a novel evidence-enhanced triplet generation framework, EATQA, encouraging the model…
  • Towards a Generative Approach for Emotion Detection and Reasoning
    9 Aug 2024 0 repositories listed
    Large language models (LLMs) have demonstrated impressive performance in mathematical and commonsense reasoning tasks using chain-of-thought (CoT) prompting techniques.
  • ChatSOS: Vector Database Augmented Generative Question Answering Assistant in Safety Engineering
    8 May 2024 0 repositories listed
    With the rapid advancement of natural language processing technologies, generative artificial intelligence techniques, represented by large language models (LLMs), are gaining increasing prominence and demonstrating…
  • Mitigating LLM Hallucinations via Conformal Abstention
    4 Apr 2024 0 repositories listed
    We develop a principled procedure for determining when a large language model (LLM) should abstain from responding (e.g., by saying "I don't know") in a general domain, instead of resorting to possibly "hallucinating" a…
  • 26 Feb 2024 0 repositories listed
    Temporal knowledge graph question answering (TKGQA) poses a significant challenge task, due to the temporal constraints hidden in questions and the answers sought from dynamic structured knowledge.
  • Does the Generator Mind its Contexts? An Analysis of Generative Model Faithfulness under Context Transfer
    22 Feb 2024 0 repositories listed
    The present study introduces the knowledge-augmented generator, which is specifically designed to produce information that remains grounded in contextual knowledge, regardless of alterations in the context.
  • A Search for Prompts: Generating Structured Answers from Contracts
    16 Oct 2023 0 repositories listed
    In many legal processes being able to action on the concrete implication of a legal question can be valuable to automating human review or signalling certain conditions (e.g., alerts around automatic renewal).
  • Training Generative Question-Answering on Synthetic Data Obtained from an Instruct-tuned Model
    12 Oct 2023 0 repositories listed
    This paper presents a simple and cost-effective method for synthesizing data to train question-answering systems.
  • Retrieving Supporting Evidence for Generative Question Answering
    20 Sep 2023 0 repositories listed
    Current large language models (LLMs) can exhibit near-human levels of performance on many natural language-based tasks, including open-domain question answering.
  • Benchmarks for Pirá 2.0, a Reading Comprehension Dataset about the Ocean, the Brazilian Coast, and Climate Change
    19 Sep 2023 0 repositories listed
    Pirá is a reading comprehension dataset focused on the ocean, the Brazilian coast, and climate change, built from a collection of scientific abstracts and reports on these topics.
  • Prompt Generate Train (PGT): Few-shot Domain Adaption of Retrieval Augmented Generation Models for Open Book Question-Answering
    12 Jul 2023 0 repositories listed
    We propose a framework - Prompt, Generate, Train (PGT) - to efficiently develop a generative question-answering model for open-book question-answering over a proprietary collection of text documents.
  • Evaluation of medium-large Language Models at zero-shot closed book generative question answering
    19 May 2023 0 repositories listed
    Large language models (LLMs) have garnered significant attention, but the definition of "large" lacks clarity.
  • Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering
    9 Oct 2022 0 repositories listed
    Generative question answering (QA) models generate answers to questions either solely based on the parameters of the model (the closed-book setting) or additionally retrieving relevant evidence (the open-book setting).
  • HIT&QMUL at SemEval-2022 Task 9: Label-Enclosed Generative Question Answering (LEG-QA)
    1 Jul 2022 0 repositories listed
    This paper presents the second place system for the R2VQ: competence-based multimodal question answering shared task.
  • Few-shot Question Generation for Personalized Feedback in Intelligent Tutoring Systems
    8 Jun 2022 0 repositories listed
    Existing work on generating hints in Intelligent Tutoring Systems (ITS) focuses mostly on manual and non-personalized feedback.
  • Modeling Multi-hop Question Answering as Single Sequence Prediction
    18 May 2022 0 repositories listed
    Fusion-in-decoder (Fid) (Izacard and Grave, 2020) is a generative question answering (QA) model that leverages passage retrieval with a pre-trained transformer and pushed the state of the art on single-hop QA.
  • Towards Answering Open-ended Ethical Quandary Questions
    12 May 2022 0 repositories listed
  • A Theoretically Grounded Benchmark for Evaluating Machine Commonsense
    23 Mar 2022 0 repositories listed
  • Survey of Hallucination in Natural Language Generation
    8 Feb 2022 0 repositories listed
  • A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answering
    14 Jan 2022 0 repositories listed
  • 1 Jan 2022 0 repositories listed
  • Automated Story Generation as Question-Answering
    7 Dec 2021 0 repositories listed
  • Modeling Multi-hop Question Answering as Single Sequence Prediction
    16 Nov 2021 0 repositories listed
  • Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation
    14 Oct 2021 0 repositories listed
  • Addressing Semantic Drift in Generative Question Answering with Auxiliary Extraction
    1 Aug 2021 0 repositories listed
  • Zero-shot Generalization in Dialog State Tracking through Generative Question Answering
    20 Jan 2021 0 repositories listed
  • PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation
    1 Nov 2020 0 repositories listed
  • Incorporating External Knowledge into Machine Reading for Generative Question Answering
    6 Sep 2019 0 repositories listed
  • Generative Question Answering: Learning to Answer the Whole Question
    1 May 2019 0 repositories listed
  • A Generative Approach to Question Answering
    16 Nov 2017 0 repositories listed
  • Flexible End-to-End Dialogue System for Knowledge Grounded Conversation
    13 Sep 2017 0 repositories listed

Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections