Datasets › MTEB
MTEB (Massive Text Embedding Benchmark)
MTEB is a benchmark that spans 8 embedding tasks covering a total of 56 datasets and 112 languages. The 8 task types are Bitext mining, Classification, Clustering, Pair Classification, Reranking, Retrieval, Semantic Textual Similarity and Summarisation. The 56 datasets contain varying text lengths and they are grouped into three categories: Sentence to sentence, Paragraph to paragraph, and Sentence to paragraph.
Check the latest leaderboards at HuggingFace.
Benchmarks archive 2025-07-28
All 6 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.
| First row (archive order) | Paper | Code | ||||
|---|---|---|---|---|---|---|
| Text Classification | MTEB | ST5-XXL Accuracy 73.42 | MTEB: Massive Text Embedding Benchmark | embeddings-benchmark/mteb +4 | 31 | Compare |
| Text Clustering | MTEB | ST5-XXL V-Measure 43.71 | MTEB: Massive Text Embedding Benchmark | embeddings-benchmark/mteb +4 | 31 | Compare |
| Semantic Textual Similarity | MTEB | AnglE-UAE Spearman Correlation 84.54 | AnglE-optimized Text Embeddings | SeanLee97/AnglE +1 | 30 | Compare |
| Text Retrieval | MTEB | SGPT-5.8B-msmarco nDCG@10 50.25 | MTEB: Massive Text Embedding Benchmark | embeddings-benchmark/mteb +4 | 30 | Compare |
| Text Summarization | MTEB | MPNet-multilingual Spearman Correlation 31.57 | MTEB: Massive Text Embedding Benchmark | embeddings-benchmark/mteb +4 | 26 | Compare |
| Information Retrieval | MTEB | SGPT-5.8B-msmarco nDCG@10 50.25 | MTEB: Massive Text Embedding Benchmark | embeddings-benchmark/mteb +4 | 1 | Compare |
Papers archive 2025-07-28
2 shown of 2 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 155. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.
| Date | Samples run Syntology | |||
|---|---|---|---|---|
| AnglE-optimized Text Embeddings | 2 | 1 | 22 Sep 2023 | not harvested |
| MTEB: Massive Text Embedding Benchmark | 5 | 148 | 13 Oct 2022 | ran 3 of 13 samples (10 unverified) |
Dataset loaders archive 2025-07-28
No loader listed in the archive.
Tasks archive 2025-07-28
License archive 2025-07-28
Modalities archive 2025-07-28
Languages archive 2025-07-28
No language tagged.
Variants archive 2025-07-28
- MTEB
1 variant name, as the archive lists them.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections