Natural Language Inference

Description from the archive archive 2025-07-28; Papers-with-Code links inside it are rewritten to this site.

Benchmarks archive 2025-07-28

37 leaderboard tables shown for this task, 33 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 37 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

81 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 81 until expanded.

Subtasks archive 2025-07-28

3 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 821 papers with code (1,961 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  11 Oct 2018 534 repositories listed Syntology ran 204 of 659 samples · 455 unverified · 149 pointer-only (licence)
  We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers.
• Language Models are Few-Shot Learners
  28 May 2020 67 repositories listed Syntology ran 15 of 65 samples · 50 unverified · 4 pointer-only (licence)
  By contrast, humans can generally perform a new language task from only a few examples or from simple instructions - something which current NLP systems still largely struggle to do.
• RoBERTa: A Robustly Optimized BERT Pretraining Approach
  26 Jul 2019 67 repositories listed Syntology ran 22 of 48 samples · 26 unverified · 23 pointer-only (licence)
  Language model pretraining has led to significant performance gains but careful comparison between different approaches is challenging.
• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
  23 Oct 2019 57 repositories listed Syntology ran 2 of 31 samples · 29 unverified
  Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP).
• A Structured Self-attentive Sentence Embedding
  9 Mar 2017 52 repositories listed Syntology ran 4 of 10 samples · 6 unverified · 2 pointer-only (licence)
  This paper proposes a new model for extracting an interpretable sentence embedding by introducing self-attention.
• ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
  26 Sep 2019 48 repositories listed Syntology ran 46 of 126 samples · 80 unverified · 22 pointer-only (licence)
  Increasing model size when pretraining natural language representations often results in improved performance on downstream tasks.
• BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
  29 Oct 2019 47 repositories listed Syntology ran 22 of 53 samples · 31 unverified · 7 pointer-only (licence)
  We evaluate a number of noising approaches, finding the best performance by both randomly shuffling the order of the original sentences and using a novel in-filling scheme, where spans of text are replaced with a single…
• Deep contextualized word representations
  15 Feb 2018 46 repositories listed Syntology ran 23 of 58 samples · 35 unverified · 25 pointer-only (licence)
  We introduce a new type of deep contextualized word representation that models both (1) complex characteristics of word use (e.
• DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
  2 Oct 2019 37 repositories listed Syntology ran 19 of 27 samples · 8 unverified
  As Transfer Learning from large-scale pre-trained models becomes more prevalent in Natural Language Processing (NLP), operating these large models in on-the-edge and/or under constrained computational training or…
• XLNet: Generalized Autoregressive Pretraining for Language Understanding
  19 Jun 2019 27 repositories listed Syntology ran 10 of 24 samples · 14 unverified · 3 pointer-only (licence)
  With the capability of modeling bidirectional contexts, denoising autoencoding based pretraining like BERT achieves better performance than pretraining approaches based on autoregressive language modeling.
• SimCSE: Simple Contrastive Learning of Sentence Embeddings
  18 Apr 2021 23 repositories listed Syntology ran 17 of 30 samples · 13 unverified · 19 pointer-only (licence)
  This paper presents SimCSE, a simple contrastive learning framework that greatly advances state-of-the-art sentence embeddings.
• Supervised Learning of Universal Sentence Representations from Natural Language Inference Data
  5 May 2017 23 repositories listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  Many modern NLP systems rely on word embeddings, previously trained in an unsupervised manner on large corpora, as base features.
• Pay Attention to MLPs
  17 May 2021 20 repositories listed Syntology ran 34 of 44 samples · 10 unverified · 11 pointer-only (licence)
  Transformers have become one of the most important architectural innovations in deep learning and have enabled many breakthroughs over the past few years.
• ERNIE: Enhanced Representation through Knowledge Integration
  19 Apr 2019 19 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration).
• RWKV: Reinventing RNNs for the Transformer Era
  22 May 2023 14 repositories listed Syntology ran 3 of 11 samples · 8 unverified
  This work presents a significant step towards reconciling trade-offs between computational efficiency and model performance in sequence processing tasks.
• Big Bird: Transformers for Longer Sequences
  28 Jul 2020 14 repositories listed Syntology ran 10 of 15 samples · 5 unverified · 11 pointer-only (licence)
  To remedy this, we propose, BigBird, a sparse attention mechanism that reduces this quadratic dependency to linear.
• DeBERTa: Decoding-enhanced BERT with Disentangled Attention
  5 Jun 2020 14 repositories listed Syntology ran 4 of 13 samples · 9 unverified · 3 pointer-only (licence)
  Recent progress in pre-trained neural language models has significantly improved the performance of many natural language processing (NLP) tasks.
• Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
  26 Dec 2018 13 repositories listed Syntology ran 4 of 10 samples · 6 unverified · 4 pointer-only (licence)
  We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts.
• Improving Language Understanding by Generative Pre-Training
  11 Jun 2018 13 repositories listed
  We demonstrate that large gains on these tasks can be realized by generative pre-training of a language model on a diverse corpus of unlabeled text, followed by discriminative fine-tuning on each specific task.
• data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language
  7 Feb 2022 12 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  While the general idea of self-supervised learning is identical across modalities, the actual algorithms and objectives differ widely because they were developed with a single modality in mind.
• FNet: Mixing Tokens with Fourier Transforms
  9 May 2021 12 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 1 pointer-only (licence)
  At longer input lengths, our FNet model is significantly faster: when compared to the "efficient" Transformers on the Long Range Arena benchmark, FNet matches the accuracy of the most accurate models, while outpacing…
• Enhanced LSTM for Natural Language Inference
  20 Sep 2016 12 repositories listed
  Reasoning and inference are central to human and artificial intelligence.
• GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
  20 Apr 2018 11 repositories listed Syntology ran 5 of 14 samples · 9 unverified · 1 pointer-only (licence)
  For natural language understanding (NLU) technology to be maximally useful, both practically and as a scientific object of study, it must be general: it must be able to process language in a way that is not exclusively…
• SentEval: An Evaluation Toolkit for Universal Sentence Representations
  14 Mar 2018 11 repositories listed Syntology ran 6 of 8 samples · 2 unverified · 6 pointer-only (licence)
  We introduce SentEval, a toolkit for evaluating the quality of universal sentence representations.
• From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification
  5 Feb 2016 11 repositories listed Syntology ran 8 of 8 samples · 0 unverified · 2 pointer-only (licence)
  We propose sparsemax, a new activation function similar to the traditional softmax, but able to output sparse probabilities.
• New Datasets for Automatic Detection of Textual Entailment and of Contradictions between Sentences in French
  23 May 2024 10 repositories listed
  DACCORD consists of 1034 pairs of sentences and is the first dataset exclusively dedicated to this task and covering among others the topic of the Russian invasion in Ukraine.
• Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention
  7 Feb 2021 10 repositories listed Syntology ran 1 of 2 samples · 1 unverified · 1 pointer-only (licence)
  The scalability of Nystr\"{o}mformer enables application to longer sequences with thousands of tokens.
• TinyBERT: Distilling BERT for Natural Language Understanding
  23 Sep 2019 10 repositories listed Syntology ran 0 of 4 samples · 4 unverified · 4 pointer-only (licence)
  To accelerate inference and reduce model size while maintaining accuracy, we first propose a novel Transformer distillation method that is specially designed for knowledge distillation (KD) of the Transformer-based…
• NEZHA: Neural Contextualized Representation for Chinese Language Understanding
  31 Aug 2019 10 repositories listed
  The pre-trained language models have achieved great successes in various natural language understanding (NLU) tasks due to its capacity to capture the deep contextualized information in text by pre-training on…
• Bilateral Multi-Perspective Matching for Natural Language Sentences
  13 Feb 2017 10 repositories listed Syntology ran 1 of 4 samples · 3 unverified · 1 pointer-only (licence)
  Natural language sentence matching is a fundamental technology for a variety of tasks.

Syntology lines on 26 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.