Retrieval-augmented Generation

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 777 papers with code (2,196 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
  22 May 2020 18 repositories listed Syntology ran 4 of 6 samples · 2 unverified
  Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks.
• Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
  17 Oct 2023 6 repositories listed Syntology ran 8 of 14 samples · 6 unverified · 3 pointer-only (licence)
  Our framework trains a single arbitrary LM that adaptively retrieves passages on-demand, and generates and reflects on retrieved passages and its own generations using special tokens, called reflection tokens.
• ColPali: Efficient Document Retrieval with Vision Language Models
  27 Jun 2024 5 repositories listed Syntology ran 2 of 4 samples · 2 unverified
  Documents are visually rich structures that convey information through text, but also figures, page layouts, tables, or even fonts.
• BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack
  14 Jun 2024 4 repositories listed Syntology ran 7 of 8 samples · 1 unverified
  The BABILong benchmark is extendable to any length to support the evaluation of new upcoming models with increased capabilities, and we provide splits up to 10 million token lengths.
• Retrieval-Augmented Generation for Large Language Models: A Survey
  18 Dec 2023 4 repositories listed
  Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes.
• SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis
  22 May 2025 3 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval.
• R1-Searcher++: Incentivizing the Dynamic Knowledge Acquisition of LLMs via Reinforcement Learning
  22 May 2025 3 repositories listed Syntology ran 1 of 10 samples · 9 unverified
  In this paper, we introduce R1-Searcher++, a novel framework designed to train LLMs to adaptively leverage both internal and external knowledge sources.
• LRP4RAG: Detecting Hallucinations in Retrieval-Augmented Generation via Layer-wise Relevance Propagation
  28 Aug 2024 3 repositories listed
  Specifically, we first utilize LRP to compute the relevance between the input and output of the RAG generator.
• From Local to Global: A Graph RAG Approach to Query-Focused Summarization
  24 Apr 2024 3 repositories listed Syntology ran 0 of 5 samples · 5 unverified
  To combine the strengths of these contrasting methods, we propose a Graph RAG approach to question answering over private text corpora that scales with both the generality of user questions and the quantity of source…
• Retrieval-Augmented Generation for AI-Generated Content: A Survey
  29 Feb 2024 3 repositories listed
  We first classify RAG foundations according to how the retriever augments the generator, distilling the fundamental abstractions of the augmentation methodologies for various retrievers and generators.
• The Power of Noise: Redefining Retrieval for RAG Systems
  26 Jan 2024 3 repositories listed Syntology ran 5 of 5 samples · 0 unverified · 5 pointer-only (licence)
  Retrieval-Augmented Generation (RAG) has recently emerged as a method to extend beyond the pre-trained knowledge of Large Language Models by augmenting the original prompt with relevant passages or documents retrieved…
• RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models
  31 Dec 2023 3 repositories listed Syntology ran 3 of 5 samples · 2 unverified
  Retrieval-augmented generation (RAG) has become a main technique for alleviating hallucinations in large language models (LLMs).
• RAGAS: Automated Evaluation of Retrieval Augmented Generation
  26 Sep 2023 3 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  We introduce RAGAs (Retrieval Augmented Generation Assessment), a framework for reference-free evaluation of Retrieval Augmented Generation (RAG) pipelines.
• A Survey of LLM × DATA
  24 May 2025 2 repositories listed
  The integration of large language model (LLM) and data management (DATA) is rapidly redefining both domains.
• Relevance Isn't All You Need: Scaling RAG Systems With Inference-Time Compute Via Multi-Criteria Reranking
  14 Mar 2025 2 repositories listed
  In response, we show evaluations of existing RAG methods which account for both context relevance and answer quality.
• HuixiangDou2: A Robustly Optimized GraphRAG Approach
  9 Mar 2025 2 repositories listed
  Large Language Models (LLMs) perform well on familiar queries but struggle with specialized or emerging topics.
• Benchmarking Retrieval-Augmented Generation in Multi-Modal Contexts
  24 Feb 2025 2 repositories listed
  This paper introduces Multi-Modal Retrieval-Augmented Generation (M^2RAG), a benchmark designed to evaluate the effectiveness of Multi-modal Large Language Models (MLLMs) in leveraging knowledge from multi-modal…
• LettuceDetect: A Hallucination Detection Framework for RAG Applications
  24 Feb 2025 2 repositories listed
  Retrieval Augmented Generation (RAG) systems remain vulnerable to hallucinated answers despite incorporating external knowledge sources.
• RAS: Retrieval-And-Structuring for Knowledge-Intensive LLM Generation
  16 Feb 2025 2 repositories listed Syntology ran 1 of 13 samples · 12 unverified · 2 pointer-only (licence)
  Large language models (LLMs) have achieved impressive performance on knowledge-intensive tasks, yet they often struggle with multi-step reasoning due to the unstructured nature of retrieved context.
• AutoAgent: A Fully-Automated and Zero-Code Framework for LLM Agents
  9 Feb 2025 2 repositories listed
  To address this challenge, we introduce AutoAgent-a Fully-Automated and highly Self-Developing framework that enables users to create and deploy LLM agents through Natural Language Alone.
• WebWalker: Benchmarking LLMs in Web Traversal
  13 Jan 2025 2 repositories listed
  Extensive experimental results show that WebWalkerQA is challenging and demonstrates the effectiveness of RAG combined with WebWalker, through the horizontal and vertical integration in real-world scenarios.
• Search-o1: Agentic Search-Enhanced Large Reasoning Models
  9 Jan 2025 2 repositories listed
  To address this limitation, we introduce \textbf{Search-o1}, a framework that enhances LRMs with an agentic retrieval-augmented generation (RAG) mechanism and a Reason-in-Documents module for refining retrieved…
• Jasper and Stella: distillation of SOTA embedding models
  26 Dec 2024 2 repositories listed Syntology ran 1 of 4 samples · 3 unverified
  However, the embedding models that currently excel on text embedding benchmarks, like the Massive Text Embedding Benchmark (MTEB), often have numerous parameters and high vector dimensionality.
• ConQRet: Benchmarking Fine-Grained Evaluation of Retrieval Augmented Argumentation with LLM Judges
  6 Dec 2024 2 repositories listed
  To validate the proposed techniques, we introduce ConQRet, a new benchmark featuring long and complex human-authored arguments on debated topics, grounded in real-world websites, allowing an exhaustive evaluation across…
• Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework
  14 Nov 2024 2 repositories listed
  Within the TREC setup, we are able to calibrate our fully automatic process against a manual process whereby nuggets are created by human assessors semi-manually and then assigned manually to system answers.
• AutoRAG: Automated Framework for optimization of Retrieval Augmented Generation Pipeline
  28 Oct 2024 2 repositories listed
  Using LLMs (Large Language Models) in conjunction with external documents has made RAG (Retrieval-Augmented Generation) an essential technology.
• LoRANN: Low-Rank Matrix Factorization for Approximate Nearest Neighbor Search
  24 Oct 2024 2 repositories listed Syntology ran 0 of 20 samples · 20 unverified
  LoRANN is competitive with the leading graph-based algorithms and outperforms the state-of-the-art GPU ANN methods on high-dimensional data sets.
• FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMs
  17 Oct 2024 2 repositories listed
  Summarization is one of the most common tasks performed by large language models (LLMs), especially in applications like Retrieval-Augmented Generation (RAG).
• ColaCare: Enhancing Electronic Health Record Modeling through Large Language Model-Driven Multi-Agent Collaboration
  3 Oct 2024 2 repositories listed
  We introduce ColaCare, a framework that enhances Electronic Health Record (EHR) modeling through multi-agent collaboration driven by Large Language Models (LLMs).
• Data-Prep-Kit: getting your data ready for LLM application development
  26 Sep 2024 2 repositories listed
  We believe DPK is a valuable contribution to the AI community to easily prepare data to enhance the performance of their LLM models or to fine-tune models with Retrieval-Augmented Generation (RAG).

Syntology lines on 13 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.