Fact Verification

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

17 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 129 papers with code (216 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
  22 May 2020 18 repositories listed Syntology ran 4 of 6 samples · 2 unverified
  Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks.
• ReAct: Synergizing Reasoning and Acting in Language Models
  6 Oct 2022 9 repositories listed Syntology ran 15 of 34 samples · 19 unverified · 5 pointer-only (licence)
  While large language models (LLMs) have demonstrated impressive capabilities across tasks in language understanding and interactive decision making, their abilities for reasoning (e.
• Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
  17 Oct 2023 6 repositories listed Syntology ran 8 of 14 samples · 6 unverified · 3 pointer-only (licence)
  Our framework trains a single arbitrary LM that adaptively retrieves passages on-demand, and generates and reflects on retrieved passages and its own generations using special tokens, called reflection tokens.
• Precise Zero-Shot Dense Retrieval without Relevance Labels
  20 Dec 2022 3 repositories listed Syntology ran 1 of 6 samples · 5 unverified
  Given a query, HyDE first zero-shot instructs an instruction-following language model (e.
• Evidence-based Factual Error Correction
  31 Dec 2020 3 repositories listed
  This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence.
• KILT: a Benchmark for Knowledge Intensive Language Tasks
  4 Sep 2020 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  We test both task-specific and general baselines, evaluating downstream performance in addition to the ability of the models to provide provenance.
• Towards Debiasing Fact Verification Models
  14 Aug 2019 3 repositories listed
  Fact verification requires validating a claim in the context of evidence.
• Benchmarking Retrieval-Augmented Generation in Multi-Modal Contexts
  24 Feb 2025 2 repositories listed
  This paper introduces Multi-Modal Retrieval-Augmented Generation (M^2RAG), a benchmark designed to evaluate the effectiveness of Multi-modal Large Language Models (MLLMs) in leveraging knowledge from multi-modal…
• CFEVER: A Chinese Fact Extraction and VERification Dataset
  20 Feb 2024 2 repositories listed
  Similar to the FEVER dataset, claims in the "Supports" and "Refutes" categories are also annotated with corresponding evidence sentences sourced from single or multiple pages in Chinese Wikipedia.
• Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding
  9 Jan 2024 2 repositories listed Syntology ran 6 of 8 samples · 2 unverified
  We propose the Chain-of-Table framework, where tabular data is explicitly used in the reasoning chain as a proxy for intermediate thoughts.
• Learning to Filter Context for Retrieval-Augmented Generation
  14 Nov 2023 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  To alleviate these problems, we propose FILCO, a method that improves the quality of the context provided to the generator by (1) identifying useful context based on lexical and information-theoretic approaches, and (2)…
• AlignScore: Evaluating Factual Consistency with a Unified Alignment Function
  26 May 2023 2 repositories listed
  AlignScore is based on a general function of information alignment between two arbitrary text pieces.
• Optimization Techniques for Unsupervised Complex Table Reasoning via Self-Training Framework
  20 Dec 2022 2 repositories listed Syntology ran 0 of 20 samples · 20 unverified
  However, constructing labeled data for complex reasoning tasks is labor intensive, and the quantity of annotated data remains insufficient to support the intricate demands of real-world applications.
• Decorrelate Irrelevant, Purify Relevant: Overcome Textual Spurious Correlations from a Feature Perspective
  16 Feb 2022 2 repositories listed
  Most of the existing debiasing methods often identify and weaken these samples with biased features (i.
• CREAK: A Dataset for Commonsense Reasoning over Entity Knowledge
  3 Sep 2021 2 repositories listed
  We introduce CREAK, a testbed for commonsense reasoning about entity knowledge, bridging fact-checking about entities (Harry Potter is a wizard and is skilled at riding a broomstick) with commonsense inferences (if…
• FaVIQ: FAct Verification from Information-seeking Questions
  5 Jul 2021 2 repositories listed
  Claims in FAVIQ are verified to be natural, contain little lexical bias, and require a complete understanding of the evidence for verification.
• Multilingual Evidence Retrieval and Fact Verification to Combat Global Disinformation: The Power of Polyglotism
  16 Dec 2020 2 repositories listed
  This article investigates multilingual evidence retrieval and fact verification as a step to combat global disinformation, a first effort of this kind, to the best of our knowledge.
• Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake News
  7 Oct 2020 2 repositories listed Syntology ran 0 of 5 samples · 5 unverified
  The search can directly warn fake news posters and online users (e.
• Revealing the Importance of Semantic Retrieval for Machine Reading at Scale
  17 Sep 2019 2 repositories listed Syntology ran 6 of 17 samples · 11 unverified
  In this work, we give general guidelines on system design for MRS by proposing a simple yet effective pipeline system with special consideration on hierarchical semantic retrieval at both paragraph and sentence level,…
• End-to-End Bias Mitigation by Modelling Biases in Corpora
  13 Sep 2019 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  We experiment on large-scale natural language inference and fact verification benchmarks, evaluating on out-of-domain datasets that are specifically designed to assess the robustness of models against known biases in…
• GEAR: Graph-based Evidence Aggregating and Reasoning for Fact Verification
  22 Jul 2019 2 repositories listed
  Fact verification (FV) is a challenging task which requires to retrieve relevant evidence from plain text and use the evidence to verify given claims.
• Combining Fact Extraction and Verification with Neural Semantic Matching Networks
  16 Nov 2018 2 repositories listed Syntology ran 4 of 5 samples · 1 unverified
  The increasing concern with misinformation has stimulated research efforts on automatic fact checking.
• DS@GT at CheckThat! 2025: Evaluating Context and Tokenization Strategies for Numerical Fact Verification
  8 Jul 2025 1 repository listed
  Numerical claims, statements involving quantities, comparisons, and temporal references, pose unique challenges for automated fact-checking systems.
• Verifying the Verifiers: Unveiling Pitfalls and Potentials in Fact Verifiers
  16 Jun 2025 1 repository listed
  In this study, we evaluate 12 pre-trained LLMs and one specialized fact-verifier, including frontier LLMs and open-weight reasoning LLMs, using a collection of examples from 14 fact-checking benchmarks.
• ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts
  10 Jun 2025 1 repository listed
  Results show that current models struggle with chart-based reasoning: even the best systems, such as Gemini 2.
• Reasoning-Table: Exploring Reinforcement Learning for Table Reasoning
  2 Jun 2025 1 repository listed
  The approach also achieves excellent performance on text-to-SQL tasks, reaching 68.
• Table-R1: Inference-Time Scaling for Table Reasoning
  29 May 2025 1 repository listed
  We develop and evaluate two post-training strategies to enable inference-time scaling: distillation from frontier model reasoning traces and reinforcement learning with verifiable rewards (RLVR).
• SemViQA: A Semantic Question Answering System for Vietnamese Information Fact-Checking
  2 Mar 2025 1 repository listed
  The rise of misinformation, exacerbated by Large Language Models (LLMs) like GPT and Gemini, demands robust fact-checking solutions, especially for low-resource languages like Vietnamese.
• HIPPO: Enhancing the Table Understanding Capability of Large Language Models through Hybrid-Modal Preference Optimization
  24 Feb 2025 1 repository listed Syntology ran 0 of 3 samples · 3 unverified
  Tabular data contains rich structural semantics and plays a crucial role in organizing and manipulating information.
• Step-by-Step Fact Verification System for Medical Claims with Explainable Reasoning
  20 Feb 2025 1 repository listed
  Fact verification (FV) aims to assess the veracity of a claim based on relevant evidence.

Syntology lines on 13 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.