Fact Checking

Benchmarks archive 2025-07-28

7 leaderboard tables shown for this task, 7 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

12 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

5 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 297 papers with code (669 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• "Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection
  1 May 2017 11 repositories listed
  In this paper, we present liar: a new, publicly available dataset for fake news detection.
• A simple but tough-to-beat baseline for the Fake News Challenge stance detection task
  11 Jul 2017 9 repositories listed
  Identifying public misinformation is a complicated and challenging task.
• Unsupervised Dense Information Retrieval with Contrastive Learning
  16 Dec 2021 6 repositories listed Syntology ran 1 of 5 samples · 4 unverified
  In this work, we explore the limits of contrastive learning as a way to train unsupervised dense retrievers and show that it leads to strong performance in various retrieval settings.
• Explainable Tsetlin Machine framework for fake news detection with credibility score assessment
  19 May 2021 6 repositories listed
  The proliferation of fake news, i.
• OpenFactCheck: Building, Benchmarking Customized Fact-Checking Systems and Evaluating the Factuality of Claims and LLMs
  9 May 2024 4 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  To mitigate these issues, we propose OpenFactCheck, a unified framework for building customized automatic fact-checking systems, benchmarking their accuracy, evaluating factuality of LLMs, and verifying claims in a…
• Evaluating the Factual Consistency of Abstractive Text Summarization
  28 Oct 2019 4 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  Currently used metrics for assessing summarization algorithms do not account for whether summaries are factually consistent with source documents.
• Fake News Detection on Social Media using Geometric Deep Learning
  10 Feb 2019 4 repositories listed Syntology ran 2 of 12 samples · 10 unverified · 1 pointer-only (licence)
  One of the main reasons is that often the interpretation of the news requires the knowledge of political or social context or 'common sense', which current NLP algorithms are still missing.
• FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios
  25 Jul 2023 3 repositories listed Syntology ran 4 of 14 samples · 10 unverified
  With the above challenges in mind, in this paper, we propose FacTool, a task and domain agnostic framework for detecting factual errors of texts generated by large language models (e.
• AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Web
  22 May 2023 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Existing datasets for automated fact-checking have substantial limitations, such as relying on artificial claims, lacking annotations for evidence and intermediate reasoning, or including evidence published after the…
• Scaling Language Models: Methods, Analysis & Insights from Training Gopher
  8 Dec 2021 3 repositories listed
  Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.
• MultiVerS: Improving scientific claim verification with weak supervision and full-document context
  2 Dec 2021 3 repositories listed Syntology ran 1 of 13 samples · 12 unverified
  Our approach outperforms two competitive baselines on three scientific claim verification datasets, with particularly strong performance in zero / few-shot domain adaptation experiments.
• BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models
  17 Apr 2021 3 repositories listed Syntology ran 3 of 4 samples · 1 unverified
  To address this, and to facilitate researchers to broadly evaluate the effectiveness of their models, we introduce Benchmarking-IR (BEIR), a robust and heterogeneous evaluation benchmark for information retrieval.
• Editing Factual Knowledge in Language Models
  16 Apr 2021 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  We present KnowledgeEditor, a method which can be used to edit this knowledge and, thus, fix 'bugs' or unexpected predictions without the need for expensive re-training or fine-tuning.
• Evidence-based Factual Error Correction
  31 Dec 2020 3 repositories listed
  This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence.
• Team Alex at CLEF CheckThat! 2020: Identifying Check-Worthy Tweets With Transformer Models
  7 Sep 2020 3 repositories listed
  While misinformation and disinformation have been thriving in social media for years, with the emergence of the COVID-19 pandemic, the political and the health misinformation merged, thus elevating the problem to a…
• KILT: a Benchmark for Knowledge Intensive Language Tasks
  4 Sep 2020 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  We test both task-specific and general baselines, evaluating downstream performance in addition to the ability of the models to provide provenance.
• COVID-19 on Social Media: Analyzing Misinformation in Twitter Conversations
  26 Mar 2020 3 repositories listed
  The analysis is presented and updated on a publically accessible dashboard (https://usc-melady.
• CheckThat! at CLEF 2020: Enabling the Automatic Identification and Verification of Claims in Social Media
  21 Jan 2020 3 repositories listed
  Finally, the lab offers a fifth task that asks to predict the check-worthiness of the claims made in English political debates and speeches.
• Automatic Fact-guided Sentence Modification
  30 Sep 2019 3 repositories listed
  This is a challenging constrained generation task, as the output must be consistent with the new information and fit into the rest of the existing document.
• Fact Checking in Community Forums
  8 Mar 2018 3 repositories listed
  Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information.
• COVE: COntext and VEracity prediction for out-of-context images
  3 Feb 2025 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  Debunking them requires (1) providing the true context of the image and (2) checking the veracity of the image's caption.
• OpenFactCheck: A Unified Framework for Factuality Evaluation of LLMs
  6 Aug 2024 2 repositories listed
  The increased use of large language models (LLMs) across a variety of real-world applications calls for automatic tools to check the factual accuracy of their outputs, as LLMs often hallucinate.
• Semantic Operators: A Declarative Model for Rich, AI-based Data Processing
  16 Jul 2024 2 repositories listed
  Our model specifies the expected behavior of each operator with a high-quality gold algorithm, and we develop an optimization framework that reduces cost, while providing accuracy guarantees with respect to a gold…
• Missci: Reconstructing Fallacies in Misrepresented Science
  5 Jun 2024 2 repositories listed
  Unlike previous fallacy detection datasets, Missci (i) focuses on implicit fallacies between the relevant content of the cited publication and the inaccurate claim, and (ii) requires models to verbalize the fallacious…
• MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents
  16 Apr 2024 2 repositories listed Syntology ran 2 of 8 samples · 6 unverified
  We release LLM-AggreFact, code for data synthesis, and models.
• Embedded Named Entity Recognition using Probing Classifiers
  18 Mar 2024 2 repositories listed Syntology ran 4 of 5 samples · 1 unverified · 5 pointer-only (licence)
  Streaming text generation has become a common way of increasing the responsiveness of language model powered applications, such as chat assistants.
• CFEVER: A Chinese Fact Extraction and VERification Dataset
  20 Feb 2024 2 repositories listed
  Similar to the FEVER dataset, claims in the "Supports" and "Refutes" categories are also annotated with corresponding evidence sentences sourced from single or multiple pages in Chinese Wikipedia.
• Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers
  15 Nov 2023 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs.
• bgGLUE: A Bulgarian General Language Understanding Evaluation Benchmark
  4 Jun 2023 2 repositories listed
  We run the first systematic evaluation of pre-trained language models for Bulgarian, comparing and contrasting results across the nine tasks in the benchmark.
• Fact-Checking Complex Claims with Program-Guided Reasoning
  22 May 2023 2 repositories listed Syntology ran 2 of 6 samples · 4 unverified
  Fact-checking real-world claims often requires collecting multiple pieces of evidence and applying complex multi-step reasoning.

Syntology lines on 15 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.