Browse State-of-the-Art › Cloze Test
Cloze Test
28 papers with code · 2 benchmarks · 2 datasets archive 2025-07-28
The cloze task refers to infilling individual words.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| CodeXGLUE - CT-all (1 row) | CodeBERT(MLM) | CodeXGLUE: A Machine Learning Benchmark Dataset for Code... | code | Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified | Compare |
| CodeXGLUE - CT-maxmin (1 row) | CodeBERT(MLM) | CodeXGLUE: A Machine Learning Benchmark Dataset for Code... | code | Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 71 · with a code link: 28 · where Syntology ran a sample: 6 (4 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (6 of 71 tagged: 4 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 71 of 71, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
5 Nov 2016 27 repositories listed Syntology official (archive's flag): 1 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 7 pointer-only (licence)Machine comprehension (MC), answering a query about a given context paragraph, requires modeling complex interactions between the context and the query.
-
19 Apr 2019 19 repositories listed Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration).
-
11 Jun 2018 13 repositories listedWe demonstrate that large gains on these tasks can be realized by generative pre-training of a language model on a diverse corpus of unlabeled text, followed by discriminative fine-tuning on each specific task.
-
1 Dec 2020 10 repositories listedHowever, applying GPT-3 to address Chinese NLP tasks is still challenging, as the training corpus of GPT-3 is primarily English, and the parameters are not publicly available.
-
9 Feb 2021 7 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Benchmark datasets have a significant impact on accelerating research in programming language tasks.
-
15 Mar 2024 1 repository listedManually designing cloze test consumes enormous time and efforts.
-
29 May 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Moreover, we present ContextDET, a unified multimodal model that is capable of end-to-end differentiable modeling of visual-language contexts, so as to locate, identify, and associate visual objects with language inputs…
-
11 Oct 2022 1 repository listedPretrained multilingual language models can help bridge the digital language divide, enabling high-quality NLP models for lower resourced languages.
-
Contextual embedding and model weighting by fusing domain knowledge on Biomedical Question Answering26 Jun 2022 1 repository listedBiomedical Question Answering aims to obtain an answer to the given question from the biomedical domain.
-
1 May 2022 1 repository listedStory comprehension that involves complex causal and temporal relations is a critical task in NLP, but previous studies have focused predominantly on English, leaving open the question of how the findings generalize to…
-
19 Apr 2022 1 repository listedAlthough adapters are known to facilitate adapting to many downstream tasks compared to fine-tuning the model that require retraining all of the models' parameters -- which owes to the adapters' plug and play nature and…
-
20 Oct 2021 1 repository listedAlthough language depends heavily on the geographical, temporal, and other social contexts of the speaker, these elements have not been incorporated into modern transformer-based language models.
-
5 Aug 2021 1 repository listedWith each patch and the patch sequence of a STC compared to a visual "word" and "sentence" respectively, we deliberately erase a certain "word" (patch) to yield a VCT.
-
19 Apr 2021 1 repository listedWe probe pre-trained transformer language models for bridging inference.
-
26 Nov 2020 1 repository listedTraditional symbolic reasoning engines, while attractive for their precision and explicability, have a few major drawbacks: the use of brittle inference procedures that rely on exact matching (unification) of logical…
-
4 Nov 2020 1 repository listedSpecifically, we first match the embedding of each candidate idiom with the hidden representation corresponding to the blank in the context.
-
16 Sep 2020 1 repository listedWe propose a suite of reasoning tasks on two types of relations between procedural events: goal-step relations ("learn poses" is a step in the larger goal of "doing yoga") and step-step temporal relations ("buy a yoga…
-
27 Aug 2020 1 repository listedTo build such a visual cloze test, a certain patch of STC is erased to yield an incomplete event (IE).
-
11 Jul 2020 1 repository listedOur results show that we are able to explain agent’s decisions in (1) and to reconstruct the most relevant sentences used by the network to select the story ending in (2).
-
10 Jun 2020 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)Pre-trained contextual representations (e. g., BERT) have become the foundation to achieve state-of-the-art results on many NLP tasks.
-
12 May 2020 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We conduct a thorough study to diagnose the behaviors of pre-trained language encoders (ELMo, BERT, and RoBERTa) when confronted with natural grammatical errors.
-
3 May 2020 1 repository listedSequence-to-sequence models for abstractive summarization have been studied extensively, yet the generated summaries commonly suffer from fabricated content, and are often found to be near-extractive.
-
1 May 2020 1 repository listedHowever, some studies show that customized self-supervised tasks for a particular type of downstream task can effectively help the pre-trained model to capture more corresponding knowledge and semantic information.
-
4 Jun 2019 1 repository listedCloze-style reading comprehension in Chinese is still limited due to the lack of various corpora.
-
2 Apr 2019 1 repository listedTo properly infer the narrator's intention, one needs to apply a certain degree of common sense and social intuition.
-
1 Jun 2018 1 repository listedWe present a neural recommendation model for Chengyu, which is a special type of Chinese idiom.
-
16 May 2018 1 repository listedStory comprehension requires a deep semantic understanding of the narrative, making it a challenging task.
-
1 Apr 2017 1 repository listedThe Story Cloze test is a recent effort in providing a common test scenario for text understanding systems.
-
NLP and Education: using semantic similarity to evaluate filled gaps in a large-scale Cloze test in the classroom2 Nov 2024 0 repositories listedThis study examines the applicability of the Cloze test, a widely used tool for assessing text comprehension proficiency, while highlighting its challenges in large-scale implementation.
-
Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models16 May 2024 0 repositories listedRecent advances in large language models (LLMs) have promoted generative error correction (GER) for automatic speech recognition (ASR), which aims to predict the ground-truth transcription from the decoded N-best…
-
Emojinize: Enriching Any Text with Emoji Translations6 Mar 2024 0 repositories listed
-
Controlling Cloze-test Question Item Difficulty with PLM-based Surrogate Models for IRT Assessment3 Mar 2024 0 repositories listed
-
Exploiting Contextual Target Attributes for Target Sentiment Classification21 Dec 2023 0 repositories listed
-
TURead: An eye movement dataset of Turkish reading2 Dec 2023 0 repositories listed
-
Storyfier: Exploring Vocabulary Learning Support with Text Generation Models7 Aug 2023 0 repositories listed
-
InDEX: Indonesian Idiom and Expression Dataset for Cloze Test24 Nov 2022 0 repositories listed
-
Challenging America: Modeling language in longer time scales1 Jul 2022 0 repositories listed
-
A Corpus for Commonsense Inference in Story Cloze Test1 Jun 2022 0 repositories listed
-
Modeling the Impact of Syntactic Distance and Surprisal on Cross-Slavic Text Comprehension1 Jun 2022 0 repositories listed
-
Decorate the Examples: A Simple Method of Prompt Design for Biomedical Relation Extraction21 Apr 2022 0 repositories listed
-
Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words24 Feb 2022 0 repositories listed
-
Are Pretrained Multilingual Models Equally Fair Across Languages?16 Jan 2022 0 repositories listed
-
Challenging America: Modeling language in longer time scales17 Dec 2021 0 repositories listed
-
Cloze Evaluation for Deeper Understanding of Commonsense Stories in Indonesian17 Dec 2021 0 repositories listed
-
EventBERT: A Pre-Trained Model for Event Correlation Reasoning13 Oct 2021 0 repositories listed
-
LMSOC: An approach for socially sensitive pretraining22 May 2021 0 repositories listed
-
Correcting the Misuse: A Method for the Chinese Idiom Cloze Test1 Nov 2020 0 repositories listed
-
Scene Restoring for Narrative Machine Reading Comprehension1 Nov 2020 0 repositories listed
-
Script Induction as Association Rule Mining1 Jul 2020 0 repositories listed
-
Discriminative Sentence Modeling for Story Ending Prediction19 Dec 2019 0 repositories listed
-
KnowSemLM: A Knowledge Infused Semantic Language Model1 Nov 2019 0 repositories listed
-
DEMN: Distilled-Exposition Enhanced Matching Network for Story Comprehension8 Jan 2019 0 repositories listed
-
Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?13 Dec 2018 0 repositories listed
-
Multi-Perspective Context Aggregation for Semi-supervised Cloze-style Reading Comprehension20 Aug 2018 0 repositories listed
-
Generating Reasonable and Diversified Story Ending Using Sequence to Sequence Model with Adversarial Training1 Aug 2018 0 repositories listed
-
Tackling the Story Ending Biases in The Story Cloze Test1 Jul 2018 0 repositories listed
-
15 Mar 2018 0 repositories listed
-
Large-scale Cloze Test Dataset Designed by Teachers1 Jan 2018 0 repositories listed
-
9 Nov 2017 0 repositories listed
-
A Joint Model for Semantic Sequences: Frames, Entities, Sentiments1 Aug 2017 0 repositories listed
-
An RNN-based Binary Classifier for the Story Cloze Test1 Apr 2017 0 repositories listed
-
Behind the Scenes of an Evolving Event Cloze Test1 Apr 2017 0 repositories listed
-
IIT (BHU): System Description for LSDSem'17 Shared Task1 Apr 2017 0 repositories listed
-
LSDSem 2017 Shared Task: The Story Cloze Test1 Apr 2017 0 repositories listed
-
Resource-Lean Modeling of Coherence in Commonsense Stories1 Apr 2017 0 repositories listed
-
Story Cloze Ending Selection Baselines and Data Examination13 Mar 2017 0 repositories listed
-
Two Discourse Driven Language Models for Semantics17 Jun 2016 0 repositories listed
-
A Rule-based Shallow-transfer Machine Translation System for Scots and English1 May 2016 0 repositories listed
-
6 Apr 2016 0 repositories listed
-
Improving Cloze Test Performance of Language Learners Using Web N-Grams1 Aug 2014 0 repositories listed
-
A System for Generating Cloze Test Items from Russian-Language Text1 Sep 2013 0 repositories listed
Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections