Browse State-of-the-Art › Implicatures
Implicatures
7 papers with code · 1 benchmark · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| BIG-bench (2 rows) | Chinchilla-70B (few-shot, k=5) | Training Compute-Optimal Large Language Models | code | Syntology 8 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 29 · with a code link: 7 · where Syntology ran a sample: 3 (3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3 of 29 tagged: 3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 29 of 29, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.
-
8 Dec 2021 3 repositories listedLanguage modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.
-
29 Mar 2022 2 repositories listed Syntology 8 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 4 pointer-only (licence)We investigate the optimal model size and number of tokens for training a transformer language model under a given compute budget.
-
Do Large Language Models Understand Conversational Implicature -- A case study with a chinese sitcom30 Apr 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples) · 6 pointer-only (licence)While all models generate largely fluent and self-consistent text, their explanations score low on reasonability except for GPT-4, suggesting that most LLMs cannot produce satisfactory explanations of the implicatures…
-
Probing Large Language Models for Scalar Adjective Lexical Semantics and Scalar Diversity Pragmatics4 Apr 2024 1 repository listedIn this study, we probe different families of Large Language Models such as GPT-4 for their knowledge of the lexical semantics of scalar adjectives and one specific aspect of their pragmatics, namely scalar diversity.
-
5 May 2023 1 repository listedInteractive Task Learning (ITL) concerns learning about unforeseen domain concepts via natural interactions with human users.
-
1 May 2022 1 repository listedThis paper adopted psycholinguistic datasets to probe language models’ commonsense reasoning.
-
7 Apr 2020 1 repository listed Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples) · 5 pointer-only (licence)We use IMPPRES to evaluate whether BERT, InferSent, and BOW NLI models trained on MultiNLI (Williams et al., 2018) learn to make pragmatic inferences.
-
Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges17 Feb 2025 0 repositories listedUnderstanding pragmatics-the use of language in context-is crucial for developing NLP systems capable of interpreting nuanced language use.
-
Can Vision-Language Models Infer Speaker's Ignorance? The Role of Visual and Linguistic Cues13 Feb 2025 0 repositories listedThis study investigates whether vision-language models (VLMs) can perform pragmatic inference, focusing on ignorance implicatures, utterances that imply the speaker's lack of precise knowledge.
-
Neurosymbolic Graph Enrichment for Grounded World Models19 Nov 2024 0 repositories listedThe development of artificial intelligence systems capable of understanding and reasoning about complex real-world scenarios is a significant challenge.
-
Do language models capture implied discourse meanings? An investigation with exhaustivity implicatures of Korean morphology15 May 2024 0 repositories listedMarkedness in natural language is often associated with non-literal meanings in discourse.
-
Experimental Pragmatics with Machines: Testing LLM Predictions for the Inferences of Plain and Embedded Disjunctions9 May 2024 0 repositories listedHuman communication is based on a variety of inferences that we draw from sentences, often going beyond what is literally said.
-
Regularized Conventions: Equilibrium Computation as a Model of Pragmatic Reasoning16 Nov 2023 0 repositories listedWe present a model of pragmatic language understanding, where utterances are produced and understood by searching for regularized equilibria of signaling games.
-
"Is the Pope Catholic?" Applying Chain-of-Thought Reasoning to Understanding Conversational Implicatures23 May 2023 0 repositories listedConversational implicatures are pragmatic inferences that require listeners to deduce the intended meaning conveyed by a speaker from their explicit utterances.
-
Pragmatic competence of pre-trained language models through the lens of discourse connectives27 Sep 2021 0 repositories listedAs pre-trained language models (LMs) continue to dominate NLP, it is increasingly important that we understand the depth of language capabilities in these models.
-
Machine Semiotics24 Aug 2020 0 repositories listedRecognizing a basic difference between the semiotics of humans and machines presents a possibility to overcome the shortcomings of current speech assistive devices.
-
Conversational implicatures in English dialogue: Annotated dataset25 Nov 2019 0 repositories listedHuman dialogue often contains utterances having meanings entirely different from the sentences used and are clearly understood by the interlocutors.
-
Coverage of Information Extraction from Sentences and Paragraphs1 Nov 2019 0 repositories listedScalar implicatures are language features that imply the negation of stronger statements, e.g., “She was married twice” typically implicates that she was not married thrice.
-
Controlled Natural Languages and Default Reasoning11 May 2019 0 repositories listedControlled natural languages (CNLs) are effective languages for knowledge representation and reasoning.
-
Sensala: a Dynamic Semantics System for Natural Language Processing1 Aug 2018 0 repositories listedHere we describe Sensala , an open source framework for the semantic interpretation of natural language that provides the logical meaning of a given text.
-
Information structure, syntax, and pragmatics and other factors in resolving scope ambiguity1 Dec 2016 0 repositories listedThe paper is a corpus study of the factors involved in disambiguating potential scope ambiguity in sentences with negation and universal quantifier, such as “I don’t want talk to all these people”, which can…
-
Evaluating semantic models with word-sentence relatedness23 Mar 2016 0 repositories listedSemantic textual similarity (STS) systems are designed to encode and evaluate the semantic similarity between words, phrases, sentences, and documents.
-
Cognitive Compositional Semantics using Continuation Dependencies1 Aug 2014 0 repositories listed
-
A Conceptual Framework for Inferring Implicatures1 Jun 2014 0 repositories listed
-
An Investigation for Implicatures in Chinese : Implicatures in Chinese and in English are similar !1 Jun 2014 0 repositories listed
-
An Account of Opinion Implicatures23 Apr 2014 0 repositories listedWhile previous sentiment analysis research has concentrated on the interpretation of explicitly stated opinions and attitudes, this work initiates the computational study of a type of opinion implicature (i.e.…
-
Global Approach to Scalar Implicatures in Dynamic Semantics1 Nov 2013 0 repositories listed
-
Implicatures and Nested Beliefs in Approximate Decentralized-POMDPs1 Aug 2013 0 repositories listed
-
A Tool for Extracting Conversational Implicatures1 May 2012 0 repositories listedExplicitly conveyed knowledge represents only a portion of the information communicated by a text snippet.
Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections