Misinformation

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

44 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 44 until expanded.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 457 papers with code (1,282 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• A simple but tough-to-beat baseline for the Fake News Challenge stance detection task
  11 Jul 2017 9 repositories listed
  Identifying public misinformation is a complicated and challenging task.
• Explainable Tsetlin Machine framework for fake news detection with credibility score assessment
  19 May 2021 6 repositories listed
  The proliferation of fake news, i.
• Exposing Influence Campaigns in the Age of LLMs: A Behavioral-Based AI Approach to Detecting State-Sponsored Trolls
  17 Oct 2022 3 repositories listed
  The detection of state-sponsored trolls operating in influence campaigns on social media is a critical and unsolved challenge for the research community, which has significant implications beyond the online realm.
• Misinfo Reaction Frames: Reasoning about Readers’ Reactions to News Headlines
  1 May 2022 3 repositories listed
  Even to a simple and short news headline, readers react in a multitude of ways: cognitively (e.
• MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Dataset
  23 Feb 2022 3 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Training these machine learning models require datasets of sufficient scale, diversity and quality.
• COSMOS: Catching Out-of-Context Misinformation with Self-Supervised Learning
  15 Jan 2021 3 repositories listed
  We propose a self-supervised training strategy where we only need a set of captioned images.
• Evidence-based Factual Error Correction
  31 Dec 2020 3 repositories listed
  This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence.
• Team Alex at CLEF CheckThat! 2020: Identifying Check-Worthy Tweets With Transformer Models
  7 Sep 2020 3 repositories listed
  While misinformation and disinformation have been thriving in social media for years, with the emergence of the COVID-19 pandemic, the political and the health misinformation merged, thus elevating the problem to a…
• COVID-19 on Social Media: Analyzing Misinformation in Twitter Conversations
  26 Mar 2020 3 repositories listed
  The analysis is presented and updated on a publically accessible dashboard (https://usc-melady.
• COVE: COntext and VEracity prediction for out-of-context images
  3 Feb 2025 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  Debunking them requires (1) providing the true context of the image and (2) checking the veracity of the image's caption.
• AD-LLM: Benchmarking Large Language Models for Anomaly Detection
  15 Dec 2024 2 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  Anomaly detection (AD) is an important machine learning task with many real-world uses, including fraud detection, medical diagnosis, and industrial monitoring.
• Efficient Annotator Reliability Assessment and Sample Weighting for Knowledge-Based Misinformation Detection on Social Media
  18 Oct 2024 2 repositories listed
  The EffiARA annotation framework is introduced, aiming to utilise inter- and intra-annotator agreement to understand the reliability of each annotator and influence the training of large language models for…
• Towards Effective Planning Strategies for Dynamic Opinion Networks
  18 Oct 2024 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  To address this, we first introduce a ranking algorithm to identify key nodes for disseminating accurate information, which facilitates the training of neural network classifiers that provide generalized solutions for…
• A LLM-Based Ranking Method for the Evaluation of Automatic Counter-Narrative Generation
  21 Jun 2024 2 repositories listed
  This paper proposes a novel approach to evaluate Counter Narrative (CN) generation using a Large Language Model (LLM) as an evaluator.
• Evolving from Single-modal to Multi-modal Facial Deepfake Detection: A Survey
  11 Jun 2024 2 repositories listed
  We provide comprehensive taxonomies of detection techniques, discuss the evolution of generative methods from auto-encoders and GANs to diffusion models, and categorize these technologies by their unique attributes.
• Missci: Reconstructing Fallacies in Misrepresented Science
  5 Jun 2024 2 repositories listed
  Unlike previous fallacy detection datasets, Missci (i) focuses on implicit fallacies between the relevant content of the cited publication and the inaccurate claim, and (ii) requires models to verbalize the fallacious…
• Competition Report: Finding Universal Jailbreak Backdoors in Aligned LLMs
  22 Apr 2024 2 repositories listed Syntology ran 3 of 4 samples · 1 unverified · 2 pointer-only (licence)
  Large language models are aligned to be safe, preventing users from generating harmful content like misinformation or instructions for illegal activities.
• Did the Neurons Read your Book? Document-level Membership Inference for Large Language Models
  23 Oct 2023 2 repositories listed Syntology ran 13 of 16 samples · 3 unverified
  First, we propose a procedure for the development and evaluation of document-level membership inference for LLMs by leveraging commonly used data sources for training and the model release date.
• Targeted Attack Improves Protection against Unauthorized Diffusion Customization
  7 Oct 2023 2 repositories listed Syntology ran 14 of 24 samples · 10 unverified · 14 pointer-only (licence)
  In this paper, we propose a simple yet effective improvement for the protection against unauthorized diffusion customization by introducing targeted attacks.
• J-Guard: Journalism Guided Adversarially Robust Detection of AI-generated News
  6 Sep 2023 2 repositories listed
  The rapid proliferation of AI-generated text online is profoundly reshaping the information landscape.
• Is ChatGPT Involved in Texts? Measure the Polish Ratio to Detect ChatGPT-Generated Text
  21 Jul 2023 2 repositories listed
  Despite this, most previous studies have been predominantly geared towards creating detectors that differentiate between purely ChatGPT-generated texts and human-authored texts.
• Machine-Made Media: Monitoring the Mobilization of Machine-Generated Articles on Misinformation and Mainstream News Websites
  16 May 2023 2 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  We find that between January 1, 2022, and May 1, 2023, the relative number of synthetic news articles increased by 57.
• From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models
  15 May 2023 2 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  We focus on hate speech and misinformation detection, aiming to empirically quantify the effects of political (social, economic) biases in pretraining data on the fairness of high-stakes social-oriented tasks.
• Interpretable Multimodal Misinformation Detection with Logic Reasoning
  10 May 2023 2 repositories listed
  Multimodal misinformation on online social platforms is becoming a critical concern due to increasing credibility and easier dissemination brought by multimedia content, compared to traditional text-only information.
• VERITE: A Robust Benchmark for Multimodal Misinformation Detection Accounting for Unimodal Bias
  27 Apr 2023 2 repositories listed Syntology ran 1 of 5 samples · 4 unverified
  Multimedia content has become ubiquitous on social media platforms, leading to the rise of multimodal misinformation (MM) and the urgent need for effective strategies to detect and prevent its spread.
• Combating Online Misinformation Videos: Characterization, Detection, and Future Directions
  7 Feb 2023 2 repositories listed
  With information consumption via online video streaming becoming increasingly popular, misinformation video poses a new threat to the health of the online information ecosystem.
• DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models
  26 Oct 2022 2 repositories listed Syntology ran 0 of 8 samples · 8 unverified
  With recent advancements in diffusion models, users can generate high-quality images by writing text prompts in natural language.
• MiDe22: An Annotated Multi-Event Tweet Dataset for Misinformation Detection
  11 Oct 2022 2 repositories listed
  The rapid dissemination of misinformation through online social networks poses a pressing issue with harmful consequences jeopardizing human health, public safety, democracy, and the economy; therefore, urgent action is…
• Contrastive Domain Adaptation for Early Misinformation Detection: A Case Study on COVID-19
  20 Aug 2022 2 repositories listed
  However, early misinformation often demonstrates both conditional and label shifts against existing misinformation data (e.
• Two-Stage Classifier for COVID-19 Misinformation Detection Using BERT: a Study on Indonesian Tweets
  30 Jun 2022 2 repositories listed
  Although there were already several studies related to the detection of misinformation in social media data, most studies focused on the English dataset.

Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.