Datasets › QNLI

QNLI (Question-answering NLI)

Introduced by Alex Wang et al. in GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding1 Jan 2019 archive 2025-07-28

The QNLI (Question-answering NLI) dataset is a Natural Language Inference dataset automatically derived from the Stanford Question Answering Dataset v1.1 (SQuAD). SQuAD v1.1 consists of question-paragraph pairs, where one of the sentences in the paragraph (drawn from Wikipedia) contains the answer to the corresponding question (written by an annotator). The dataset was converted into sentence pair classification by forming a pair between each question and each sentence in the corresponding context, and filtering out pairs with low lexical overlap between the question and the context sentence. The task is to determine whether the context sentence contains the answer to the question. This modified version of the original task removes the requirement that the model select the exact answer, but also removes the simplifying assumptions that the answer is always present in the input and that lexical overlap is a reliable cue. The QNLI dataset is part of GLUE benchmark.

Source: https://arxiv.org/pdf/1804.07461.pdf

Benchmarks archive 2025-07-28

All 3 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Natural Language Inference QNLI ALBERT Accuracy 99.2% ALBERT: A Lite BERT for Self-supervised Learning of... huggingface/transformers +47 43 Compare
Data-free Knowledge Distillation QNLI GOLD (T5-base) Accuracy 91.7 GOLD: Generalized Knowledge Distillation via... — 4 Compare
Model Compression QNLI MobileBERT + 2bit-1dim model compression using DKM Accuracy 82.13 R2 Loss: Range Restriction Loss for Model Compression... — 2 Compare

Papers archive 2025-07-28

30 shown of 37 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 1,234. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation 0 1 28 Mar 2024 not harvested
Prompt2Model: Generating Deployable Models from Natural Language Instructions 1 1 23 Aug 2023 not harvested
LM-CPPF: Paraphrasing-Guided Data Augmentation for Contrastive Prompt-Based Few-Shot Fine-Tuning 1 1 29 May 2023 not harvested
R2 Loss: Range Restriction Loss for Model Compression and Quantization 0 2 14 Mar 2023 not harvested
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback 2 1 22 Oct 2022 not harvested
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale 4 1 15 Aug 2022 ran 2 of 5 samples (3 unverified)
Adversarial Self-Attention for Language Understanding 1 2 25 Jun 2022 not harvested
ZeroGen: Efficient Zero-shot Learning via Dataset Generation 3 1 16 Feb 2022 ran 3 of 7 samples (4 unverified; 7 pointer-only for licence)
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language 12 1 7 Feb 2022 ran 0 of 6 samples (6 unverified)
DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing 3 1 18 Nov 2021 ran 0 of 7 samples (7 unverified)
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization 2 1 23 Jun 2021 ran 7 of 10 samples (3 unverified)
FNet: Mixing Tokens with Fourier Transforms 12 1 9 May 2021 ran 2 of 2 samples (0 unverified; 1 pointer-only for licence)
Entailment as Few-Shot Learner 3 1 29 Apr 2021 ran 1 of 3 samples (2 unverified)
How to Train BERT with an Academic Budget 4 1 15 Apr 2021 not harvested
Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention 10 1 7 Feb 2021 ran 1 of 2 samples (1 unverified; 1 pointer-only for licence)
CLEAR: Contrastive Learning for Sentence Representation 0 1 31 Dec 2020 not harvested
RealFormer: Transformer Likes Residual Attention 5 1 21 Dec 2020 not harvested
A Statistical Framework for Low-bitwidth Training of Deep Neural Networks 2 1 27 Oct 2020 ran 1 of 4 samples (3 unverified; 1 pointer-only for licence)
Big Bird: Transformers for Longer Sequences 14 1 28 Jul 2020 ran 10 of 15 samples (5 unverified; 11 pointer-only for licence)
SqueezeBERT: What can computer vision teach NLP about efficient neural networks? 6 1 19 Jun 2020 ran 0 of 1 samples (1 unverified)
DeBERTa: Decoding-enhanced BERT with Disentangled Attention 14 1 5 Jun 2020 ran 4 of 13 samples (9 unverified; 3 pointer-only for licence)
TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding 0 1 16 Mar 2020 not harvested
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization 6 4 8 Nov 2019 ran 6 of 8 samples (2 unverified; 1 pointer-only for licence)
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer 57 5 23 Oct 2019 ran 2 of 31 samples (29 unverified)
Q8BERT: Quantized 8Bit BERT 5 1 14 Oct 2019 ran 3 of 11 samples (8 unverified; 3 pointer-only for licence)
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter 37 1 2 Oct 2019 ran 19 of 27 samples (8 unverified)
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations 48 1 26 Sep 2019 ran 46 of 126 samples (80 unverified; 22 pointer-only for licence)
TinyBERT: Distilling BERT for Natural Language Understanding 10 2 23 Sep 2019 ran 0 of 4 samples (4 unverified; 4 pointer-only for licence)
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT 0 1 12 Sep 2019 not harvested
SenseBERT: Driving Some Sense into BERT 0 1 15 Aug 2019 not harvested

The full list of 37 is in the JSON twin.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

CC BY-SA 4.0

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • QNLI
  • QNLI (8 training examples per class)
  • QNLI Dev

3 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections