</> Code with Papers by Syntology

Home › Datasets › task › Audio-Visual Speech Recognition

Audio-Visual Speech Recognition datasets

archive 2025-07-28

7 datasets carry the task tag "Audio-Visual Speech Recognition" (the task itself: Audio-Visual Speech Recognition), ordered by the archive's paper count. Page 1 of 1: 7 shown of 7. Facet routes are this site's own (the archive records the tag string, not a page).

The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.

Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets

All 12,172 Question Answering 413Semantic Segmentation 347Object Detection 332Image Classification 283Classification 222Text Classification 167Language Modelling 166Text Generation 162Visual Question Answering (VQA) 144Named Entity Recognition (NER) 130Pose Estimation 124Anomaly Detection 119Action Recognition 115Instance Segmentation 111Sentiment Analysis 104Text Summarization 98Domain Adaptation 96Speech Recognition 96Reading Comprehension 95Information Retrieval 932D Object Detection 92Image Retrieval 87Machine Translation 82Relation Extraction 822D Semantic Segmentation 81Natural Language Inference 81Image Captioning 79Image Generation 79Depth Estimation 77Node Classification 75Natural Language Understanding 72Autonomous Driving 70Code Generation 70Object Tracking 693D Object Detection 67Face Recognition 67Link Prediction 67Person Re-Identification 65Data Augmentation 63Multi-Task Learning 593D Reconstruction 58Common Sense Reasoning 56Recommendation Systems 56Video Understanding 56Optical Character Recognition (OCR) 55Graph Classification 54Abstractive Text Summarization 52Emotion Recognition 52Medical Image Segmentation 52Word Embeddings 52Audio-Visual Speech Recognition 7

Audio-Visual Speech Recognition datasets 1–7 of 7

LRW (Lip Reading in the Wild)
The Lip Reading in the Wild (LRW) dataset a large-scale audio-visual database that contains 500 different words from over 1,000 speakers.
VideosTextsAudioLipreadingLip to Speech SynthesisAudio-Visual Speech RecognitionLip ReadingUnconstrained Lip-synchronizationVisual Keyword Spotting+2 tasks
188 papers · 8 benchmarks
LRS2 (Lip Reading Sentences 2)
The Oxford-BBC Lip Reading Sentences 2 (LRS2) dataset is one of the largest publicly available datasets for lip reading sentences in-the-wild.
VideosTextsAudioSpeech RecognitionSpeech SeparationAutomatic Speech Recognition (ASR)Visual Speech RecognitionLipreadingAudio-Visual Speech Recognition+4 tasks
115 papers · 10 benchmarks
How2
The How2 dataset contains 13,500 videos, or 300 hours of speech, and is split into 185,187 training, 2022 development (dev), and 2361 test utterances.
VideosTextsAudioText SummarizationAudio-Visual Speech RecognitionMultimodal Abstractive Text Summarization
84 papers · 2 benchmarks
LRS3-TED
LRS3-TED is a multi-modal dataset for visual and audio-visual speech recognition.
VideosSpeech RecognitionAutomatic Speech Recognition (ASR)Active Speaker DetectionVisual Speech RecognitionLipreadingAudio-Visual Speech Recognition+2 tasks
63 papers · 7 benchmarks
CAS-VSR-W1k (LRW-1000)
LRW-1000 has been renamed as CAS-VSR-W1k.
VideosTextsAudioVisual Speech RecognitionLipreadingAudio-Visual Speech RecognitionLip Reading
9 papers · 1 benchmark
MISP2021 (Multimodal Information Based Speech Processing 2021)
The MISP2021 challenge dataset is a collection of audio-visual conversational data recorded in a home TV scenario using distant multi-microphones.
VideosAudioAudio-Visual Speech Recognition
3 papers · 0 benchmarks
CAS-VSR-S101
A new large-scale, in-thewild Mandarin dataset, CAS-VSR-S101 with 101.1 hours of data.
VideosTextsAudioSpeechSpeech RecognitionSpeech EnhancementLipreadingAudio-Visual Speech RecognitionLip Reading
1 paper · 3 benchmarks

Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.