Papers › Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference

Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference

1 Apr 2021EACL 2021 2archive 2025-07-28

Timo Schick, Hinrich Sch{\"u}tze

Some NLP tasks can be solved in a fully unsupervised fashion by providing a pretrained language model with {``}task descriptions{''} in natural language (e.g., Radford et al., 2019). While this approach underperforms its supervised counterpart, we show in this work that the two ideas can be combined: We introduce Pattern-Exploiting Training (PET), a semi-supervised training procedure that reformulates input examples as cloze-style phrases to help language models understand a given task. These phrases are then used to assign soft labels to a large set of unlabeled examples. Finally, standard supervised training is performed on the resulting training set. For several tasks and languages, PET outperforms supervised training and strong semi-supervised approaches in low-resource settings by a large margin.

PaperPDFCode

Code

timoschick/pet officialmentioned in paperpytorchApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Few-Shot Text ClassificationLanguage ModelingLanguage ModellingNatural Language InferenceText Classificationtext-classification

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Pattern-Exploiting Training

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections