Datasets › InfoSeek
InfoSeek (Visual Information Seeking)
In this project, we introduce InfoSeek, a visual question answering dataset tailored for information-seeking questions that cannot be answered with only common sense knowledge. Using InfoSeek, we analyze various pre-trained visual question answering models and gain insights into their characteristics. Our findings reveal that state-of-the-art pre-trained multi-modal models (e.g., PaLI-X, BLIP2, etc.) face challenges in answering visual information-seeking questions, but fine-tuning on the InfoSeek dataset elicits models to use fine-grained knowledge that was learned during their pre-training.
Benchmarks archive 2025-07-28
All 2 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.
| First row (archive order) | Paper | Code | ||||
|---|---|---|---|---|---|---|
| Visual Question Answering (VQA) | InfoSeek | RA-VQAv2 w/ PreFLMR Accuracy 30.65 | PreFLMR: Scaling Up Fine-Grained Late-Interaction... | linweizhedragon/retrieval-augmented-visual-question-answering | 7 | Compare |
| Retrieval | InfoSeek | PreFLMR Recall@5 62.1 | PreFLMR: Scaling Up Fine-Grained Late-Interaction... | linweizhedragon/retrieval-augmented-visual-question-answering | 1 | Compare |
Papers archive 2025-07-28
4 shown of 4 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 36. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.
| Date | Samples run Syntology | |||
|---|---|---|---|---|
| PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrievers | 1 | 2 | 13 Feb 2024 | not harvested |
| PaLI-X: On Scaling up a Multilingual Vision and Language Model | 2 | 1 | 29 May 2023 | ran 6 of 7 samples (1 unverified) |
| Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions? | 2 | 3 | 23 Feb 2023 | ran 0 of 6 samples (6 unverified) |
| BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models | 17 | 1 | 30 Jan 2023 | ran 4 of 8 samples (4 unverified; 1 pointer-only for licence) |
Dataset loaders archive 2025-07-28
No loader listed in the archive.
Tasks archive 2025-07-28
License archive 2025-07-28
Modalities archive 2025-07-28
Languages archive 2025-07-28
Variants archive 2025-07-28
- InfoSeek
1 variant name, as the archive lists them.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections