Browse State-of-the-Art › Sentence Completion
Sentence Completion
49 papers with code · 1 benchmark · 2 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 29 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): HellaSwag (29 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| HellaSwag (89 rows) | CompassMTL 567M with Tailor | Task Compass: Scaling Multi-task Pre-training with Task Prefix | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 91 · with a code link: 49 · where Syntology ran a sample: 20 (19 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (20 of 91 tagged: 19 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 91 of 91, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
28 May 2020 67 repositories listed Syntology community repositories only · 45 ran (of which 0 constructed an object rather than computing a result; 37 with no instrument failure: 3 honoured, 2 violated, 32 with no contract checked; 8 where Syntology's instrument failed) · 20 unverified (of 65 harvested samples) · 7 pointer-only (licence)By contrast, humans can generally perform a new language task from only a few examples or from simple instructions - something which current NLP systems still largely struggle to do.
-
26 Jul 2019 67 repositories listed Syntology community repositories only · 37 ran (of which 11 constructed an object rather than computing a result; 36 with no instrument failure: 2 honoured, 0 violated, 34 with no contract checked; 1 where Syntology's instrument failed) · 11 unverified (of 48 harvested samples) · 24 pointer-only (licence)Language model pretraining has led to significant performance gains but careful comparison between different approaches is challenging.
-
27 Feb 2023 57 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 37 ran (of which 9 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 0 violated, 22 with no contract checked; 12 where Syntology's instrument failed) · 21 unverified (of 58 harvested samples) · 4 pointer-only (licence)We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters.
-
1 Dec 2023 35 repositories listed Syntology community repositories only · 28 ran (of which 7 constructed an object rather than computing a result; 20 with no instrument failure: 0 honoured, 0 violated, 20 with no contract checked; 8 where Syntology's instrument failed) · 34 unverified (of 62 harvested samples) · 29 pointer-only (licence)Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.
-
18 Jul 2023 19 repositories listed Syntology community repositories only · 33 ran (of which 7 constructed an object rather than computing a result; 20 with no instrument failure: 1 honoured, 1 violated, 18 with no contract checked; 13 where Syntology's instrument failed) · 19 unverified (of 52 harvested samples) · 20 pointer-only (licence)In this work, we develop and release Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters.
-
5 Jun 2020 14 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified (of 13 harvested samples) · 3 pointer-only (licence)Recent progress in pre-trained neural language models has significantly improved the performance of many natural language processing (NLP) tasks.
-
15 Mar 2023 11 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 2 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 1 pointer-only (licence)We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs.
-
3 Sep 2021 8 repositories listed Syntology official: harvested for another paper · 0 ran · 1 unverified (of 1 harvested sample)We show that instruction tuning -- finetuning language models on a collection of tasks described via instructions -- substantially improves zero-shot performance on unseen tasks.
-
5 Apr 2022 7 repositories listed Syntology 32 ran (of which 16 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 1 violated, 21 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified (of 37 harvested samples)To further our understanding of the impact of scale on few-shot learning, we trained a 540-billion parameter, densely activated, Transformer language model, which we call Pathways Language Model PaLM.
-
10 Oct 2023 6 repositories listed Syntology official (archive's flag): 9 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 2 pointer-only (licence)We introduce Mistral 7B v0.
-
9 Jun 2022 5 repositories listed Syntology official (archive's flag): 6 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 6 pointer-only (licence)In this work, we measure and improve the factual accuracy of large-scale LMs for open-ended text generation.
-
8 Dec 2021 3 repositories listedLanguage modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.
-
22 Apr 2024 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)We also propose a new high-throughput framework to alleviate the computation and memory bottlenecks during the training and inference of MOE models.
-
5 Jan 2024 2 repositories listedUsing PESC during instruction tuning, our best sparse model outperforms other sparse and dense models and exhibits superior general capabilities compared to GPT-3.
-
10 Oct 2023 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)In this work, we study structured pruning as an effective means to develop smaller LLMs from pre-trained, larger models.
-
16 Sep 2023 2 repositories listedLLMs are increasingly powerful and widely used to assist users in a variety of tasks.
-
23 May 2023 2 repositories listedFurthermore, we show that instruction tuning with CoT Collection allows LMs to possess stronger few-shot learning capabilities on 4 domain-specific tasks, resulting in an improvement of +2.
-
30 Mar 2023 2 repositories listedThe use of NLP in the realm of financial technology is broad and complex, with applications ranging from sentiment analysis and named entity recognition to question answering.
-
7 Feb 2023 2 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)Recently, Language Models (LMs) instruction-tuned on multiple tasks, also known as multitask-prompted fine-tuning (MT), have shown the capability to generalize to unseen tasks.
-
29 Mar 2022 2 repositories listed Syntology 8 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 4 pointer-only (licence)We investigate the optimal model size and number of tokens for training a transformer language model under a given compute budget.
-
28 Jan 2022 2 repositories listedNext, we detail the training process, the design of our training corpus, and our data curation techniques, which we believe is a key ingredient to the success of the model.
-
26 Jan 2021 2 repositories listedWe propose pre-finetuning, an additional large-scale learning stage between language model pre-training and fine-tuning.
-
19 May 2019 2 repositories listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 4 pointer-only (licence)In this paper, we show that commonsense inference still proves difficult for even state-of-the-art models, by presenting HellaSwag, a new challenge dataset.
-
8 Apr 2019 2 repositories listedTo produce a more difficult dataset, we introduce a novel procedure for question acquisition in which workers author questions designed to target weaknesses of state-of-the-art neural question answering systems.
-
6 Jan 2016 2 repositories listedIn this paper, we propose Recurrent Memory Network (RMN), a novel RNN architecture, that not only amplifies the power of RNN but also facilitates our understanding of its internal functioning and allows us to discover…
-
21 Oct 2024 1 repository listedEffective communication within universities is crucial for addressing the diverse information needs of students, alumni, and external stakeholders.
-
16 Jun 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)In this paper, we introduce a subspace-inspired Low-Rank Adaptation (LoRA) method, which is computationally efficient, easy to implement, and readily applicable to large language, multimodal, and diffusion models.
-
9 Feb 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)Controlled text generation (CTG) seeks to guide large language model (LLM) output to produce text that conforms to desired criteria.
-
5 Nov 2023 1 repository listedWe present mahaNLP, an open-source natural language processing (NLP) library specifically built for the Marathi language.
-
30 Oct 2023 1 repository listedAn essential task for tourists having a pleasant holiday is to have a well-planned itinerary with relevant recommendations, especially when visiting unfamiliar cities.
-
30 May 2023 1 repository listed
-
17 May 2023 1 repository listed
-
27 Apr 2023 1 repository listed
-
3 Nov 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
29 Oct 2022 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 7 harvested samples)
-
22 Oct 2022 1 repository listed
-
12 Oct 2022 1 repository listed
-
6 Oct 2022 1 repository listed
-
24 Jun 2022 1 repository listed
-
1 May 2022 1 repository listed
-
15 Jul 2021 1 repository listed
-
1 Jun 2021 1 repository listed
-
24 Mar 2021 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
29 Apr 2020 1 repository listed
-
1 Jun 2019 1 repository listed
-
8 Jun 2016 1 repository listed
-
26 Nov 2015 1 repository listed
-
31 Oct 2015 1 repository listed
-
5 Jul 2015 1 repository listed
-
Evaluating Gender Bias in Large Language Models14 Nov 2024 0 repositories listed
-
BiasAlert: A Plug-and-play Tool for Social Bias Detection in LLMs14 Jul 2024 0 repositories listed
-
Ranking LLMs by compression20 Jun 2024 0 repositories listed
-
Enhancing Bangla Language Next Word Prediction and Sentence Completion through Extended RNN with Bi-LSTM Model On N-gram Language3 May 2024 0 repositories listed
-
Illuminating the Black Box: A Psychometric Investigation into the Multifaceted Nature of Large Language Models21 Dec 2023 0 repositories listed
-
12 Dec 2023 0 repositories listed
-
28 Nov 2023 0 repositories listed
-
Exploiting Language Models as a Source of Knowledge for Cognitive Agents5 Sep 2023 0 repositories listed
-
I-WAS: a Data Augmentation Method with GPT-2 for Simile Detection8 Aug 2023 0 repositories listed
-
30 Jun 2023 0 repositories listed
-
Numeracy from Literacy: Data Science as an Emergent Skill from Large Language Models31 Jan 2023 0 repositories listed
-
POIBERT: A Transformer-based Model for the Tour Recommendation Problem16 Dec 2022 0 repositories listed
-
Implicit causality in GPT-2: a case study8 Dec 2022 0 repositories listed
-
28 Oct 2022 0 repositories listed
-
Effidit: Your AI Writing Assistant3 Aug 2022 0 repositories listed
-
14 Mar 2022 0 repositories listed
-
SeqPATE: Differentially Private Text Generation via Knowledge Distillation29 Sep 2021 0 repositories listed
-
Language Models as a Knowledge Source for Cognitive Agents17 Sep 2021 0 repositories listed
-
Differentially Private n-gram Extraction5 Aug 2021 0 repositories listed
-
Clause Final Verb Prediction in Hindi: Evidence for Noisy Channel Model of Communication1 Jun 2021 0 repositories listed
-
Learning Better Sentence Representation with Syntax Information9 Jan 2021 0 repositories listed
-
On-Device detection of sentence completion for voice assistants with low-memory footprint1 Dec 2020 0 repositories listed
-
A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks7 Oct 2020 0 repositories listed
-
Defining and Evaluating Fair Natural Language Generation28 Jul 2020 0 repositories listed
-
iCap: Interactive Image Captioning with Predictive Text31 Jan 2020 0 repositories listed
-
Filling Conversation Ellipsis for Better Social Dialog Understanding25 Nov 2019 0 repositories listed
-
30 Oct 2019 0 repositories listed
-
Improving Word Representations: A Sub-sampled Unigram Distribution for Negative Sampling21 Oct 2019 0 repositories listed
-
Second-order contexts from lexical substitutes for few-shot learning of word representations1 Jun 2019 0 repositories listed
-
Probabilistic Clustering Using Maximal Matrix Norm Couplings10 Oct 2018 0 repositories listed
-
Hybrid Model For Word Prediction Using Naive Bayes and Latent Information2 Mar 2018 0 repositories listed
-
Personalized word representations Carrying Personalized Semantics Learned from Social Network Posts29 Oct 2017 0 repositories listed
-
Expect the unexpected: Harnessing Sentence Completion for Sarcasm Detection19 Jul 2017 0 repositories listed
-
Exploiting Linguistic Features for Sentence Completion1 Aug 2016 0 repositories listed
-
Contextual LSTM (CLSTM) models for Large scale NLP tasks19 Feb 2016 0 repositories listed
-
Supervised Fine Tuning for Word Embedding with Integrated Knowledge29 May 2015 0 repositories listed
-
Learning Word Representations with Hierarchical Sparse Coding8 Jun 2014 0 repositories listed
-
Refinements to Interactive Translation Prediction Based on Search Graphs1 Jun 2014 0 repositories listed
-
Dependency Language Models for Sentence Completion1 Oct 2013 0 repositories listed
-
Regularization and nonlinearities for neural language models: when are they needed?23 Jan 2013 0 repositories listed
-
Computational Approaches to Sentence Completion1 Jul 2012 0 repositories listed
-
Improving Sentence Completion in Dialogues with Multi-Modal Features1 Jul 2012 0 repositories listed
Syntology lines on 21 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections