Cloze Test

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

28 shown of 28 papers with code (71 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Bidirectional Attention Flow for Machine Comprehension
  5 Nov 2016 27 repositories listed Syntology ran 8 of 11 samples · 3 unverified · 7 pointer-only (licence)
  Machine comprehension (MC), answering a query about a given context paragraph, requires modeling complex interactions between the context and the query.
• ERNIE: Enhanced Representation through Knowledge Integration
  19 Apr 2019 19 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration).
• Improving Language Understanding by Generative Pre-Training
  11 Jun 2018 13 repositories listed
  We demonstrate that large gains on these tasks can be realized by generative pre-training of a language model on a diverse corpus of unlabeled text, followed by discriminative fine-tuning on each specific task.
• CPM: A Large-scale Generative Chinese Pre-trained Language Model
  1 Dec 2020 10 repositories listed
  However, applying GPT-3 to address Chinese NLP tasks is still challenging, as the training corpus of GPT-3 is primarily English, and the parameters are not publicly available.
• CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation
  9 Feb 2021 7 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  Benchmark datasets have a significant impact on accelerating research in programming language tasks.
• CDGP: Automatic Cloze Distractor Generation based on Pre-trained Language Model
  15 Mar 2024 1 repository listed
  Manually designing cloze test consumes enormous time and efforts.
• Contextual Object Detection with Multimodal Large Language Models
  29 May 2023 1 repository listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Moreover, we present ContextDET, a unified multimodal model that is capable of end-to-end differentiable modeling of visual-language contexts, so as to locate, identify, and associate visual objects with language inputs…
• Are Pretrained Multilingual Models Equally Fair Across Languages?
  11 Oct 2022 1 repository listed
  Pretrained multilingual language models can help bridge the digital language divide, enabling high-quality NLP models for lower resourced languages.
• Contextual embedding and model weighting by fusing domain knowledge on Biomedical Question Answering
  26 Jun 2022 1 repository listed
  Biomedical Question Answering aims to obtain an answer to the given question from the biomedical domain.
• Cloze Evaluation for Deeper Understanding of Commonsense Stories in Indonesian
  1 May 2022 1 repository listed
  Story comprehension that involves complex causal and temporal relations is a critical task in NLP, but previous studies have focused predominantly on English, leaving open the question of how the findings generalize to…
• On The Cross-Modal Transfer from Natural Language to Code through Adapter Modules
  19 Apr 2022 1 repository listed
  Although adapters are known to facilitate adapting to many downstream tasks compared to fine-tuning the model that require retraining all of the models' parameters -- which owes to the adapters' plug and play nature and…
• LMSOC: An Approach for Socially Sensitive Pretraining
  20 Oct 2021 1 repository listed
  Although language depends heavily on the geographical, temporal, and other social contexts of the speaker, these elements have not been incorporated into modern transformer-based language models.
• Video Abnormal Event Detection by Learning to Complete Visual Cloze Tests
  5 Aug 2021 1 repository listed
  With each patch and the patch sequence of a STC compared to a visual "word" and "sentence" respectively, we deliberately erase a certain "word" (patch) to yield a VCT.
• Probing for Bridging Inference in Transformer Language Models
  19 Apr 2021 1 repository listed
  We probe pre-trained transformer language models for bridging inference.
• Braid: Weaving Symbolic and Neural Knowledge into Coherent Logical Explanations
  26 Nov 2020 1 repository listed
  Traditional symbolic reasoning engines, while attractive for their precision and explicability, have a few major drawbacks: the use of brittle inference procedures that rely on exact matching (unification) of logical…
• A BERT-based Dual Embedding Model for Chinese Idiom Prediction
  4 Nov 2020 1 repository listed
  Specifically, we first match the embedding of each candidate idiom with the hidden representation corresponding to the blank in the context.
• Reasoning about Goals, Steps, and Temporal Ordering with WikiHow
  16 Sep 2020 1 repository listed
  We propose a suite of reasoning tasks on two types of relations between procedural events: goal-step relations ("learn poses" is a step in the larger goal of "doing yoga") and step-step temporal relations ("buy a yoga…
• Cloze Test Helps: Effective Video Anomaly Detection via Learning to Complete Video Events
  27 Aug 2020 1 repository listed
  To build such a visual cloze test, a certain patch of STC is erased to yield an incomplete event (IE).
• Explainable Inference on Sequential Data via Memory-Tracking
  11 Jul 2020 1 repository listed
  Our results show that we are able to explain agent’s decisions in (1) and to reconstruct the most relevant sentences used by the network to select the story ending in (2).
• MC-BERT: Efficient Language Pre-Training via a Meta Controller
  10 Jun 2020 1 repository listed Syntology ran 1 of 4 samples · 3 unverified · 4 pointer-only (licence)
  Pre-trained contextual representations (e.
• On the Robustness of Language Encoders against Grammatical Errors
  12 May 2020 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  We conduct a thorough study to diagnose the behaviors of pre-trained language encoders (ELMo, BERT, and RoBERTa) when confronted with natural grammatical errors.
• Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Reward
  3 May 2020 1 repository listed
  Sequence-to-sequence models for abstractive summarization have been studied extensively, yet the generated summaries commonly suffer from fabricated content, and are often found to be near-extractive.
• SiBert: Enhanced Chinese Pre-trained Language Model with Sentence Insertion
  1 May 2020 1 repository listed
  However, some studies show that customized self-supervised tasks for a particular type of downstream task can effectively help the pre-trained model to capture more corresponding knowledge and semantic information.
• ChID: A Large-scale Chinese IDiom Dataset for Cloze Test
  4 Jun 2019 1 repository listed
  Cloze-style reading comprehension in Chinese is still limited due to the lack of various corpora.
• Asking the Right Question: Inferring Advice-Seeking Intentions from Personal Narratives
  2 Apr 2019 1 repository listed
  To properly infer the narrator's intention, one needs to apply a certain degree of common sense and social intuition.
• Chengyu Cloze Test
  1 Jun 2018 1 repository listed
  We present a neural recommendation model for Chengyu, which is a special type of Chinese idiom.
• Narrative Modeling with Memory Chains and Semantic Supervision
  16 May 2018 1 repository listed
  Story comprehension requires a deep semantic understanding of the narrative, making it a challenging task.
• LSDSem 2017: Exploring Data Generation Methods for the Story Cloze Test
  1 Apr 2017 1 repository listed
  The Story Cloze test is a recent effort in providing a common test scenario for text understanding systems.

Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.