Datasets › iVQA

iVQA (Instructional Video Question Answering)

Introduced by Antoine Yang et al. in Just Ask: Learning to Answer Questions from Millions of Narrated Videos1 Dec 2020 archive 2025-07-28

An open-ended VideoQA benchmark that aims to: i) provide a well-defined evaluation by including five correct answer annotations per question and ii) avoid questions which can be answered without the video.

iVQA contains 10,000 video clips with one question and five corresponding answers per clip. Moreover, we manually reduce the language bias by excluding questions that could be answered without watching the video.

Source: Just Ask: Learning to Answer Questions from Millions of Narrated Videos

Benchmarks archive 2025-07-28

All 2 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Video Question Answering iVQA Text + Text (no Multimodal Pretext Training) Accuracy 40.2 Towards Fast Adaptation of Pretrained Contrastive Models... xudonglinthu/upgradable-multimodal-intelligence 7 Compare
Zero-Shot Learning iVQA FrozenBiLM Accuracy 0.268 Zero-Shot Video Question Answering via Frozen... antoyang/FrozenBiLM +2 1 Compare

Papers archive 2025-07-28

5 shown of 5 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 22. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners 0 1 9 Dec 2022 not harvested
Video Question Answering with Iterative Video-Text Co-Tokenization 0 1 1 Aug 2022 not harvested
Zero-Shot Video Question Answering via Frozen Bidirectional Language Models 3 3 16 Jun 2022 ran 14 of 34 samples (20 unverified; 1 pointer-only for licence)
Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval 1 1 5 Jun 2022 ran 1 of 1 samples (0 unverified)
Just Ask: Learning to Answer Questions from Millions of Narrated Videos 1 2 1 Dec 2020 not harvested

Dataset loaders archive 2025-07-28

1 loader as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • iVQA

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections