</> Code with Papers by Syntology

Home › Datasets › task › Multilingual NLP

Multilingual NLP datasets

archive 2025-07-28

8 datasets carry the task tag "Multilingual NLP" (the task itself: Multilingual NLP), ordered by the archive's paper count. Page 1 of 1: 8 shown of 8. Facet routes are this site's own (the archive records the tag string, not a page).

The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.

Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets

All 12,172 Question Answering 413Semantic Segmentation 347Object Detection 332Image Classification 283Classification 222Text Classification 167Language Modelling 166Text Generation 162Visual Question Answering (VQA) 144Named Entity Recognition (NER) 130Pose Estimation 124Anomaly Detection 119Action Recognition 115Instance Segmentation 111Sentiment Analysis 104Text Summarization 98Domain Adaptation 96Speech Recognition 96Reading Comprehension 95Information Retrieval 932D Object Detection 92Image Retrieval 87Machine Translation 82Relation Extraction 822D Semantic Segmentation 81Natural Language Inference 81Image Captioning 79Image Generation 79Depth Estimation 77Node Classification 75Natural Language Understanding 72Autonomous Driving 70Code Generation 70Object Tracking 693D Object Detection 67Face Recognition 67Link Prediction 67Person Re-Identification 65Data Augmentation 63Multi-Task Learning 593D Reconstruction 58Common Sense Reasoning 56Recommendation Systems 56Video Understanding 56Optical Character Recognition (OCR) 55Graph Classification 54Abstractive Text Summarization 52Emotion Recognition 52Medical Image Segmentation 52Word Embeddings 52Multilingual NLP 8

Multilingual NLP datasets 1–8 of 8

Belebele
Belebele is a multiple-choice machine reading comprehension (MRC) dataset spanning 122 language variants.
TextsParallelQuestion AnsweringReading ComprehensionChinese Reading ComprehensionNatural Language UnderstandingMachine Reading ComprehensionReading Comprehension (Zero-Shot)+10 tasks
68 papers · 0 benchmarks
Duolingo STAPLE Shared Task
This is the dataset for the 2020 Duolingo shared task on Simultaneous Translation And Paraphrase for Language Education (STAPLE).
TextsMachine TranslationParaphrase GenerationTranslationMultilingual NLP
10 papers · 0 benchmarks
HumSet
Timely and effective response to humanitarian crises requires quick and accurate analysis of large amounts of text data, a process that can highly benefit from expert-assisted NLP systems trained on validated and annotated data in the…
TextsTabularText SummarizationMultilabel Text ClassificationHumanitarianMultilingual NLP
2 papers · 0 benchmarks
M2QA (Multi-domain Multilingual Question Answering)
M2QA (Multi-domain Multilingual Question Answering) is an extractive question answering benchmark for evaluating joint language and domain transfer.
TextsQuestion AnsweringTransfer LearningMultilingual NLPExtractive Question-Answering
2 papers · 0 benchmarks
GLARE (Guided LexRank for Advanced Retrieval in Legal Analysis)
The Guided Lexrank algorithm is applied to dataset specialappeal.csv to summarize the texts of legal documents.
TextsInformation RetrievalMultilingual NLPHybrid Machine Learning
1 paper · 0 benchmarks
MAKED (MultiModal MultiLingual Summarization and Keyword Extraction Dataset)
Keyword extraction is an integral task for many downstream problems like clustering, recommendation, search and classification.
ImagesTextsKeyword ExtractionMultilingual NLP
1 paper · 0 benchmarks
mBBC dataset (Multilingual BBC news)
To construct our multilingual dataset - mBBC - we gathered news articles from various BBC news websites in 43 different languages.
Multilingual NLP
1 paper · 0 benchmarks
English-Pashto Language Dataset (EPLD)
The English-Pashto Language Dataset (EPLD) is a comprehensive resource aimed to provide linguistic insights into the Pashto language.
TextsTabularLanguage IdentificationMultilingual NLP
0 papers · 0 benchmarks

Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.