Methods › Natural Language Processing › Language Model Pre-Training

Language Model Pre-Training

4 methods 20 papers tagged archive 2025-07-28

Language Models are models for predicting the next word or character in a document. Below you can find a continuously updating list of language models.

Methods

All 4 methods in this collection, most-tagged first. Year is the archive's introduced_year; the archive stores 2000 when it has none, shown here as “–”. Papers counts distinct papers the archive tags with the method. Click a heading to sort.

MPNet – 17
ERNIE-GEN – 1
K3M – 1
ReasonBERT – 1