Datasets › SLUE
SLUE (Spoken Language Understanding Evaluation)
Spoken Language Understanding Evaluation (SLUE) is a suite of benchmark tasks for spoken language understanding evaluation. It consists of limited-size labeled training sets and corresponding evaluation sets. This resource would allow the research community to track progress, evaluate pre-trained representations for higher-level tasks, and study open questions such as the utility of pipeline versus end-to-end approaches. The first phase of the SLUE benchmark suite consists of named entity recognition (NER), sentiment analysis (SA), and ASR on the corresponding datasets.
Corpus includes:
- SLUE-VoxPopuli: consists of ASR and NER tasks - CC0 license
- SLUE-VoxCeleb: consists of ASR and SA tasks - CCBY 4.0 license
Benchmarks archive 2025-07-28
All 3 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.
| First row (archive order) | Paper | Code | ||||
|---|---|---|---|---|---|---|
| Named Entity Recognition (NER) | SLUE | W2V2-L-LL60K (pipeline approach, uses LM) F1 (%) 69.6 | SLUE: New Benchmark Tasks for Spoken Language... | asappresearch/slue-toolkit | 13 | Compare |
| Sentiment Analysis | SLUE | W2V2-L-LL60K (pipeline approach, uses LM) Recall (%) 60.4 | SLUE: New Benchmark Tasks for Spoken Language... | asappresearch/slue-toolkit | 8 | Compare |
| Speech Recognition | SLUE | W2V2-L-LL60K (+ TED-LIUM 3 LM) VoxPopuli (Dev) 9.1 | SLUE: New Benchmark Tasks for Spoken Language... | asappresearch/slue-toolkit | 8 | Compare |
Papers archive 2025-07-28
2 shown of 2 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 22. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.
| Date | Samples run Syntology | |||
|---|---|---|---|---|
| Wav2Seq: Pre-training Speech-to-Text Encoder-Decoder Models Using Pseudo Languages | 1 | 1 | 2 May 2022 | not harvested |
| SLUE: New Benchmark Tasks for Spoken Language Understanding Evaluation on Natural Speech | 1 | 28 | 19 Nov 2021 | ran 0 of 12 samples (12 unverified) |
Dataset loaders archive 2025-07-28
1 loader as listed in the archive; links are outbound and not re-checked here.
Tasks archive 2025-07-28
License archive 2025-07-28
Custom
Modalities archive 2025-07-28
Languages archive 2025-07-28
No language tagged.
Variants archive 2025-07-28
- SLUE
1 variant name, as the archive lists them.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections