Claim Verification

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 73 papers with code (134 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• FEVER: a large-scale dataset for Fact Extraction and VERification
  14 Mar 2018 5 repositories listed Syntology ran 3 of 7 samples · 4 unverified
  Thus we believe that FEVER is a challenging testbed that will help stimulate progress on claim verification against textual sources.
• AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Web
  22 May 2023 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Existing datasets for automated fact-checking have substantial limitations, such as relying on artificial claims, lacking annotations for evidence and intermediate reasoning, or including evidence published after the…
• MultiVerS: Improving scientific claim verification with weak supervision and full-document context
  2 Dec 2021 3 repositories listed Syntology ran 1 of 13 samples · 12 unverified
  Our approach outperforms two competitive baselines on three scientific claim verification datasets, with particularly strong performance in zero / few-shot domain adaptation experiments.
• Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media
  15 Jul 2020 3 repositories listed
  The first four tasks compose the full pipeline of claim verification in social media: Task 1 on check-worthiness estimation, Task 2 on retrieving previously fact-checked claims, Task 3 on evidence retrieval, and Task 4…
• DialFact: A Benchmark for Fact-Checking in Dialogue
  15 Oct 2021 2 repositories listed Syntology ran 1 of 3 samples · 2 unverified
  Fact-checking is an essential tool to mitigate the spread of misinformation and disinformation.
• AmbiFC: Fact-Checking Ambiguous Claims with Evidence
  1 Apr 2021 2 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  Automated fact-checking systems verify claims against evidence to predict their veracity.
• Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrieval
  2 Jan 2021 2 repositories listed
  Multi-hop reasoning (i.
• Fact or Fiction: Verifying Scientific Claims
  30 Apr 2020 2 repositories listed
  We introduce scientific claim verification, a new task to select abstracts from the research literature containing evidence that SUPPORTS or REFUTES a given scientific claim, and to identify rationales justifying each…
• BERT for Evidence Retrieval and Claim Verification
  7 Oct 2019 2 repositories listed Syntology ran 4 of 6 samples · 2 unverified · 6 pointer-only (licence)
  Motivated by the promising performance of pre-trained language models, we investigate BERT in an evidence retrieval and claim verification pipeline for the FEVER fact extraction and verification challenge.
• Combining Fact Extraction and Verification with Neural Semantic Matching Networks
  16 Nov 2018 2 repositories listed Syntology ran 4 of 5 samples · 1 unverified
  The increasing concern with misinformation has stimulated research efforts on automatic fact checking.
• Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers
  12 Jun 2025 1 repository listed
  Scientific claim verification against tables typically requires predicting whether a claim is supported or refuted given a table.
• EMULATE: A Multi-Agent Framework for Determining the Veracity of Atomic Claims by Emulating Human Actions
  22 May 2025 1 repository listed
  Many approaches tackle this problem by first retrieving evidence by querying a search engine and then performing classification by providing the evidence set and atomic claim to a large language model, but this process…
• UrduFactCheck: An Agentic Fact-Checking Framework for Urdu with Evidence Boosting and Benchmarking
  21 May 2025 1 repository listed
  The rapid use of large language models (LLMs) has raised critical concerns regarding the factual reliability of their outputs, especially in low-resource languages such as Urdu.
• Reasoning-CV: Fine-tuning Powerful Reasoning LLMs for Knowledge-Assisted Claim Verification
  18 May 2025 1 repository listed
  Claim verification is essential in combating misinformation, and large language models (LLMs) have recently emerged in this area as powerful tools for assessing the veracity of claims using external knowledge.
• Detecting Manipulated Contents Using Knowledge-Grounded Inference
  29 Apr 2025 1 repository listed
  To validate the effectiveness of Manicod, we also propose a dataset comprising 4270 pieces of manipulated fake news derived from 2500 recent real-world news headlines.
• CRAVE: A Conflicting Reasoning Approach for Explainable Claim Verification Using LLMs
  21 Apr 2025 1 repository listed
  To address this, we propose CRAVE, a Conflicting Reasoning Approach for explainable claim VErification, that verify the complex claims based on the conflicting rationales reasoned by large language models (LLMs).
• Optimizing Decomposition for Optimal Claim Verification
  19 Mar 2025 1 repository listed
  Current research on the \textit{Decompose-Then-Verify} paradigm for evaluating the factuality of long-form text typically treats decomposition and verification in isolation, overlooking their interactions and potential…
• CLIPPER: Compression enables long-context synthetic data generation
  20 Feb 2025 1 repository listed
  We introduce CLIPPER, a compression-based approach for generating synthetic data tailored to narrative claim verification - a task that requires reasoning over a book to verify a given claim.
• A Reality Check on Context Utilisation for Retrieval-Augmented Generation
  22 Dec 2024 1 repository listed
  We compare DRUID to synthetic datasets (CounterFact, ConflictQA) and find that artificial datasets often fail to represent the complex and diverse real-world context settings.
• DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Experts
  13 Dec 2024 1 repository listed Syntology ran 0 of 2 samples · 2 unverified
  The proliferation of disinformation presents a growing threat to societal trust and democracy, necessitating robust and scalable Fact-Checking systems.
• WithdrarXiv: A Large-Scale Dataset for Retraction Study
  4 Dec 2024 1 repository listed
  Retractions play a vital role in maintaining scientific integrity, yet systematic studies of retractions in computer science and other STEM fields remain scarce.
• Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-Oasis
  29 Nov 2024 1 repository listed
  After the introduction of Large Language Models (LLMs), there have been substantial improvements in the performance of Natural Language Generation (NLG) tasks, including Text Summarization and Machine Translation.
• ICPR 2024 Competition on Multilingual Claim-Span Identification
  29 Nov 2024 1 repository listed
  A lot of claims are made in social media posts, which may contain misinformation or fake news.
• FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documents
  8 Nov 2024 1 repository listed
  We introduce FinDVer, a comprehensive benchmark specifically designed to evaluate the explainable claim verification capabilities of LLMs in the context of understanding and analyzing long, hybrid-content financial…
• FIRE: Fact-checking with Iterative Retrieval and Verification
  17 Oct 2024 1 repository listed Syntology ran 0 of 3 samples · 3 unverified · 3 pointer-only (licence)
  The typical approach to fact-checking these atomic claims involves retrieving a fixed number of pieces of evidence, followed by a verification step.
• A Comparative Study of Translation Bias and Accuracy in Multilingual Large Language Models for Cross-Language Claim Verification
  14 Oct 2024 1 repository listed
  The rise of digital misinformation has heightened interest in using multilingual Large Language Models (LLMs) for fact-checking.
• Loki: An Open-Source Tool for Fact Verification
  2 Oct 2024 1 repository listed
  We introduce Loki, an open-source tool designed to address the growing problem of misinformation.
• IAI Group at CheckThat! 2024: Transformer Models and Data Augmentation for Checkworthy Claim Detection
  2 Aug 2024 1 repository listed
  The task involves the automated detection of check-worthy claims in English, Dutch, and Arabic political debates and Twitter data.
• Robust Claim Verification Through Fact Detection
  25 Jul 2024 1 repository listed
  We also demonstrate that FactDetect can be augmented with claim and evidence for zero-shot prompting (AugFactDetect) in LLMs for verdict prediction.
• MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checking
  18 Jul 2024 1 repository listed
  Fact-checking real-world claims often requires reviewing multiple multimodal documents to assess a claim's truthfulness, which is a highly laborious and time-consuming task.

Syntology lines on 9 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.