Browse State-of-the-Art › Logical Fallacies
Logical Fallacies
14 papers with code · 1 benchmark · 2 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| BIG-bench (1 row) | Gopher-280B (few-shot, k=5) | Scaling Language Models: Methods, Analysis & Insights from Training Gopher | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 34 · with a code link: 14 · where Syntology ran a sample: 2 (2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2 of 34 tagged: 2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 34 of 34, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
8 Dec 2021 3 repositories listedLanguage modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.
-
28 Feb 2022 2 repositories listedIn this paper, we propose the task of logical fallacy detection, and provide a new dataset (Logic) of logical fallacies generally found in text, together with an additional challenge set for detecting logical fallacies…
-
21 Jul 2025 1 repository listedIn this paper, we present our submission to the MM-ArgFallacy2025 shared task, which aims to advance research in multimodal argument mining, focusing on logical fallacies in political debates.
-
9 Apr 2025 1 repository listedLarge Language Models (LLMs) have achieved significant progress in language understanding and reasoning.
-
30 Mar 2025 1 repository listedThe advancement of Large Language Models (LLMs) has greatly improved our ability to process complex language.
-
18 Feb 2025 1 repository listedRecent advances in large language models (LLMs) have shown that they can answer questions requiring complex reasoning.
-
15 Oct 2024 1 repository listedWe further develop two strategies to incorporate the logical structure tree into LLMs for fallacy reasoning.
-
23 Aug 2024 1 repository listedHealth-related misinformation claims often falsely cite a credible biomedical publication as evidence, which superficially appears to support the false claim.
-
7 Aug 2024 1 repository listedDespite the remarkable performance of Large Language Models (LLMs) in natural language processing tasks, they still struggle with generating logically sound arguments, resulting in potential risks such as spreading…
-
21 Feb 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)Notably, the best-performing model, GPT-4V, attains an average score of 17.
-
14 Nov 2023 1 repository listedIn this paper, we take a closer look at the self-verification abilities of LLMs in the context of logical reasoning, focusing on their ability to identify logical fallacies accurately.
-
18 Aug 2023 1 repository listedThen, it evaluates the debater's performance in logical reasoning by contrasting the scenario where the persuader employs logical fallacies against one where logical reasoning is used.
-
27 Jan 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)The ease and speed of spreading misinformation and propaganda on the Web motivate the need to develop trustworthy technology for detecting fallacies in natural language arguments.
-
12 Dec 2022 1 repository listedOur three-stage framework natively consolidates prior datasets and methods from existing tasks, like propaganda detection, serving as an overarching evaluation testbed.
-
Are Large Language Models Good at Detecting Propaganda?19 May 2025 0 repositories listedPropagandists use rhetorical devices that rely on logical fallacies and emotional appeals to advance their agendas.
-
SLURG: Investigating the Feasibility of Generating Synthetic Online Fallacious Discourse16 Apr 2025 0 repositories listedIn our paper we explore the definition, and extrapolation of fallacies as they pertain to the automatic detection of manipulation on social media.
-
A Survey on Automatic Credibility Assessment of Textual Credibility Signals in the Era of Large Language Models28 Oct 2024 0 repositories listedIn the current era of social media and generative AI, an ability to automatically assess the credibility of online social media content is of tremendous importance.
-
ConceptAgent: LLM-Driven Precondition Grounding and Tree Search for Robust Task Planning and Execution8 Oct 2024 0 repositories listedRobotic planning and execution in open-world environments is a complex problem due to the vast state spaces and high variability of task embodiment.
-
CoCoLoFa: A Dataset of News Comments with Common Logical Fallacies Written by LLM-Assisted Crowds4 Oct 2024 0 repositories listedDetecting logical fallacies in texts can help users spot argument flaws, but automating this detection is not easy.
-
Flee the Flaw: Annotating the Underlying Logic of Fallacious Arguments Through Templates and Slot-filling18 Jun 2024 0 repositories listedPrior research in computational argumentation has mainly focused on scoring the quality of arguments, with less attention on explicating logical errors.
-
Can a Hallucinating Model help in Reducing Human "Hallucination"?1 May 2024 0 repositories listedThe prevalence of unwarranted beliefs, spanning pseudoscience, logical fallacies, and conspiracy theories, presents substantial societal hurdles and the risk of disseminating misinformation.
-
Autoformalizing Natural Language to First-Order Logic: A Case Study in Logical Fallacy Detection18 Apr 2024 0 repositories listedTranslating natural language into formal language such as First-Order Logic (FOL) is a foundational challenge in NLP with wide-ranging applications in automated reasoning, misinformation tracking, and knowledge…
-
Evaluation of an LLM in Identifying Logical Fallacies: A Call for Rigor When Adopting LLMs in HCI Research8 Apr 2024 0 repositories listedThere is increasing interest in the adoption of LLMs in HCI research.
-
Reason from Fallacy: Enhancing Large Language Models' Logical Reasoning through Logical Fallacy Understanding4 Apr 2024 0 repositories listedLarge Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but they still struggle with some complicated reasoning tasks including logical reasoning.
-
Human Conditional Reasoning in Answer Set Programming8 Nov 2023 0 repositories listedGiven a conditional sentence "P=>Q" (if P then Q) and respective facts, four different types of inferences are observed in human reasoning.
-
A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models1 Nov 2023 0 repositories listedA central component of rational behavior is logical inference: the process of determining which conclusions follow from a set of premises.
-
Which Spurious Correlations Impact Reasoning in NLI Models? A Visual Interactive Diagnosis through Data-Constrained Counterfactuals21 Jun 2023 0 repositories listedWe present a human-in-the-loop dashboard tailored to diagnosing potential spurious features that NLI models rely on for predictions.
-
TWEETSPIN: Fine-grained Propaganda Detection in Social Media Using Multi-View Representations1 Jul 2022 0 repositories listedRecently, several studies on propaganda detection have involved document and fragment-level analyses of news articles.
-
The Search for Agreement on Logical Fallacy Annotation of an Infodemic1 Jun 2022 0 repositories listedWe evaluate an annotation schema for labeling logical fallacy types, originally developed for a crowd-sourcing annotation paradigm, now using an annotation paradigm of two trained linguist annotators.
-
“Don’t discuss”: Investigating Semantic and Argumentative Features for Supervised Propagandist Message Detection and Classification1 Sep 2021 0 repositories listedOne of the mechanisms through which disinformation is spreading online, in particular through social media, is by employing propaganda techniques.
-
Detection of Propaganda Using Logistic Regression1 Nov 2019 0 repositories listed
-
JUSTDeep at NLP4IF 2019 Task 1: Propaganda Detection using Ensemble Deep Learning Models1 Nov 2019 0 repositories listed
-
A robot's sense-making of fallacies and rhetorical tropes. Creating ontologies of what humans try to say24 Jun 2019 0 repositories listed
-
Unveiling the link between logical fallacies and web persuasion14 Apr 2013 0 repositories listed
Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections