Home › Datasets › task › Language Modelling
Language Modelling datasets
archive 2025-07-28
166 datasets carry the task tag "Language Modelling" (the task itself: Language Modelling), ordered by the archive's paper count. Page 4 of 4: 22 shown of 166. Facet routes are this site's own (the archive records the tag string, not a page).
The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.
Filter 50 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets
Language Modelling datasets 145–166 of 166
Expertly-curated benchmark dataset for fake news detection in Filipino.
1 paper · 0 benchmarks
Free Law Project is a leading nonprofit organization that aims to make the legal ecosystem more equitable and competitive through technology, data, and advocacy.
1 paper · 1 benchmark
A dataset of natural language data collected by putting together more than 150 existing mono-lingual and multilingual datasets together and crawling known multilingual websites.
1 paper · 0 benchmarks
Collection of news websites in low-resource languages.
1 paper · 0 benchmarks
StoryBooks for 174 unique languages.
1 paper · 0 benchmarks
HALvest is a textual dataset comprising 17 billion tokens in 56 languages and 13 domains.
1 paper · 0 benchmarks
For testing refusal behavior in a language-specific setting, we introduce HiXSTest — a set of manually curated prompts in the Hindi language designed to measure exaggerated safety.
1 paper · 0 benchmarks
InstructOpenWiki is a substantial instruction tuning dataset for Open-world IE enriched with a comprehensive corpus, extensive annotations, and diverse instructions.
1 paper · 0 benchmarks
The Kite database is a multi-modal dataset for the control of unmanned aerial vehicles (UAVs).
1 paper · 0 benchmarks
The Lenta Short Sentences dataset is a text dataset for language modelling for the Russian language.
1 paper · 0 benchmarks
This is a dataset of 3 English books which do not contain the letter "e" in them.
1 paper · 1 benchmark
NText is an eight million words dataset extracted and preprocessed from nuclear research papers and thesis.
1 paper · 0 benchmarks
Pentachromatic Cultural Palette Dataset is characterized by unique cultural semantics and values.
1 paper · 0 benchmarks
PIE stands for Performance Improving Code Edits.
1 paper · 0 benchmarks
PhilPapers is a remarkable resource for the philosophical community.
1 paper · 1 benchmark
PolyNews is a multilingual dataset containing news titles in 77 languages and 19 scripts.
1 paper · 0 benchmarks
For testing refusal behavior in a cultural setting, we introduce SGXSTest — a set of manually curated prompts designed to measure exaggerated safety within the context of Singaporean culture.
1 paper · 0 benchmarks
SVLD (Social Vision and Language Dataset)
The social vision and language dataset is a large-scale multimodal dataset designed for research into social contextual learning.
1 paper · 0 benchmarks
The USPTO Backgrounds dataset provides valuable information related to patents and trademarks.
1 paper · 1 benchmark
Verified Smart Contracts is a dataset of real Ethereum smart contracts, containing both Solidity and Vyper source code.
1 paper · 0 benchmarks
blbooks (The British Library Books)
This dataset consists of books digitised by the British Library in partnership with Microsoft.
1 paper · 0 benchmarks
This is the Big-Bench version of our language-based movie recommendation dataset https://github.com/google/BIG-bench/tree/main/bigbench/benchmarktasks/movierecommendation GPT-2 has a 48.8% accuracy, chance is 25%.
1 paper · 1 benchmark
Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.