Answer Generation

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

4 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 111 papers with code (280 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
  23 Oct 2019 57 repositories listed Syntology ran 2 of 31 samples · 29 unverified
  Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP).
• RIRAG: Regulatory Information Retrieval and Answer Generation
  9 Sep 2024 4 repositories listed
  Regulatory documents, issued by governmental regulatory bodies, establish rules, guidelines, and standards that organizations must adhere to for legal compliance.
• ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering System
  30 May 2022 3 repositories listed
  This paper introduces our proposed system for the MIA Shared Task on Cross-lingual Open-retrieval Question Answering (COQA).
• VOGUE: Answer Verbalization through Multi-Task Learning
  24 Jun 2021 3 repositories listed
  The VOGUE framework attempts to generate a verbalized answer using a hybrid approach through a multi-task learning paradigm.
• LRTA: A Transparent Neural-Symbolic Reasoning Framework with Modular Supervision for Visual Question Answering
  21 Nov 2020 3 repositories listed
  We show that LRTA makes a step towards truly understanding the question while the state-of-the-art model tends to learn superficial correlations from the training data.
• Dataset and Neural Recurrent Sequence Labeling Model for Open-Domain Factoid Question Answering
  21 Jul 2016 3 repositories listed
  While question answering (QA) with neural network, i.
• MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment
  28 Jun 2024 2 repositories listed
  This paper introduces MM-Instruct, a large-scale dataset of diverse and high-quality visual instruction data designed to enhance the instruction-following capabilities of large multimodal models (LMMs).
• PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models
  12 Feb 2024 2 repositories listed Syntology ran 6 of 17 samples · 11 unverified
  Based on this attack surface, we propose PoisonedRAG, the first knowledge corruption attack to RAG, where an attacker could inject a few malicious texts into the knowledge database of a RAG system to induce an LLM to…
• Surgical-VQLA: Transformer with Gated Vision-Language Embedding for Visual Question Localized-Answering in Robotic Surgery
  19 May 2023 2 repositories listed Syntology ran 7 of 7 samples · 0 unverified
  In this paper, we propose Visual Question Localized-Answering in Robotic Surgery (Surgical-VQLA) to localize the specific surgical area during the answer prediction.
• QAMPARI: An Open-domain Question Answering Benchmark for Questions with Many Answers from Multiple Paragraphs
  25 May 2022 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  Our results highlight the need for developing ODQA models that handle a broad range of question types, including single and multi-answer questions.
• MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding
  20 Dec 2021 2 repositories listed
  Specifically, the task involves multi-hop questions that require reasoning over image-caption pairs to identify the grounded visual object being referred to and then predicting a span from the news body text to answer…
• It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books
  8 Sep 2021 2 repositories listed
  Existing question answering (QA) techniques are created mainly to answer questions asked by humans.
• End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering
  9 Jun 2021 2 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  We model retrieval decisions as latent variables over sets of relevant documents.
• Quiz-Style Question Generation for News Stories
  18 Feb 2021 2 repositories listed
  As a first step towards measuring news informedness at a scale, we study the problem of quiz-style multiple-choice question generation, which may be used to survey users about their knowledge of recent news.
• Asking Questions the Human Way: Scalable Question-Answer Generation from Text Corpus
  27 Jan 2020 2 repositories listed Syntology ran 1 of 8 samples · 7 unverified · 2 pointer-only (licence)
  In this paper, we propose Answer-Clue-Style-aware Question Generation (ACS-QG), which aims at automatically generating high-quality and diverse question-answer pairs from unlabeled text corpus at scale by imitating the…
• RMIT-ADM+S at the SIGIR 2025 LiveRAG Challenge
  17 Jun 2025 1 repository listed
  This paper presents the RMIT--ADM+S participation in the SIGIR 2025 LiveRAG Challenge.
• TableRAG: A Retrieval Augmented Generation Framework for Heterogeneous Document Reasoning
  12 Jun 2025 1 repository listed
  Retrieval-Augmented Generation (RAG) has demonstrated considerable effectiveness in open-domain question answering.
• ECoRAG: Evidentiality-guided Compression for Long Context RAG
  5 Jun 2025 1 repository listed
  ECoRAG improves LLM performance by compressing retrieved documents based on evidentiality, ensuring whether answer generation is supported by the correct evidence.
• O²-Searcher: A Searching-based Agent Model for Open-Domain Open-Ended Question Answering
  22 May 2025 1 repository listed Syntology ran 0 of 2 samples · 2 unverified
  Large Language Models (LLMs), despite their advancements, are fundamentally limited by their static parametric knowledge, hindering performance on tasks requiring open-domain up-to-date information.
• GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents
  21 May 2025 1 repository listed Syntology ran 1 of 10 samples · 9 unverified
  In this paper, we first conduct extensive analysis experiments of three key components of that training pipeline: input design, output evaluation, and policy update-each revealing distinct challenges arising from…
• The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval Augmentation
  21 May 2025 1 repository listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  Large language models are able to exploit in-context learning to access external knowledge beyond their training data through retrieval-augmentation.
• Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learning
  20 May 2025 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  To address these limitations, agentic RAG systems (e.
• KG-QAGen: A Knowledge-Graph-Based Framework for Systematic Question Generation and Long-Context LLM Evaluation
  18 May 2025 1 repository listed
  The increasing context length of modern language models has created a need for evaluating their ability to retrieve and process information across extensive documents.
• RAG-VR: Leveraging Retrieval-Augmented Generation for 3D Question Answering in VR Environments
  11 Apr 2025 1 repository listed
  Recent advances in large language models (LLMs) provide new opportunities for context understanding in virtual reality (VR).
• Localized Definitions and Distributed Reasoning: A Proof-of-Concept Mechanistic Interpretability Study via Activation Patching
  3 Apr 2025 1 repository listed
  The stronger clean logit difference for definitional questions further supports this localized representation.
• MetaLadder: Ascending Mathematical Solution Quality via Analogical-Problem Reasoning Transfer
  19 Mar 2025 1 repository listed
  Inspired by this cognitive process, we propose \textbf{MetaLadder}, a novel framework that explicitly prompts LLMs to recall and reflect on meta-problems, those structurally or semantically analogous problems, alongside…
• Conversational Gold: Evaluating Personalized Conversational Search System using Gold Nuggets
  12 Mar 2025 1 repository listed
  Built on this resource, we provide a framework for long-form answer generation evaluation, involving nuggets extraction and nuggets matching, linked to retrieval.
• Zero-Shot Complex Question-Answering on Long Scientific Documents
  4 Mar 2025 1 repository listed
  With the rapid development in Transformer-based language models, the reading comprehension tasks on short documents and simple questions have been largely addressed.
• EgoNormia: Benchmarking Physical Social Norm Understanding
  27 Feb 2025 1 repository listed Syntology ran 0 of 3 samples · 3 unverified
  To improve and evaluate the normative reasoning capability of vision-language models (VLMs), we present \dataset{} ϵ, consisting of 1, 853 challenging, multi-stage MCQ questions based on ego-centric videos of human…
• A Hybrid Approach to Information Retrieval and Answer Generation for Regulatory Texts
  24 Feb 2025 1 repository listed
  Regulatory texts are inherently long and complex, presenting significant challenges for information retrieval systems in supporting regulatory officers with compliance tasks.

Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.