Visual Question Answering (VQA)

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

76 leaderboard tables shown for this task, 76 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 76 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

144 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 144 until expanded.

Subtasks archive 2025-07-28

9 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 1,039 papers with code (2,167 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
  7 Oct 2016 126 repositories listed Syntology ran 79 of 141 samples · 62 unverified · 68 pointer-only (licence)
  For captioning and VQA, we show that even non-attention based models can localize inputs.
• Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
  25 Jul 2017 65 repositories listed Syntology ran 9 of 9 samples · 0 unverified · 6 pointer-only (licence)
  Top-down visual attention mechanisms have been used extensively in image captioning and visual question answering (VQA) to enable deeper image understanding through fine-grained analysis and even multiple steps of…
• ParlAI: A Dialog Research Software Platform
  18 May 2017 23 repositories listed
  We introduce ParlAI (pronounced "par-lay"), an open-source software platform for dialog research implemented in Python, available at http://parl.
• VQA: Visual Question Answering
  3 May 2015 21 repositories listed Syntology ran 6 of 7 samples · 1 unverified · 6 pointer-only (licence)
  Given an image and a natural language question about the image, the task is to provide an accurate natural language answer.
• A simple neural network module for relational reasoning
  5 Jun 2017 20 repositories listed Syntology ran 3 of 7 samples · 4 unverified · 1 pointer-only (licence)
  Relational reasoning is a central component of generally intelligent behavior, but has proven difficult for neural networks to learn.
• BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
  30 Jan 2023 17 repositories listed Syntology ran 4 of 8 samples · 4 unverified · 1 pointer-only (licence)
  The cost of vision-and-language pre-training has become increasingly prohibitive due to end-to-end training of large-scale models.
• Stacked Attention Networks for Image Question Answering
  7 Nov 2015 16 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  Thus, we develop a multiple-layer SAN in which we query an image multiple times to infer the answer progressively.
• ECG Heartbeat Classification: A Deep Transferable Representation
  19 Apr 2018 13 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Electrocardiogram (ECG) can be reliably used as a measure to monitor the functionality of the cardiovascular system.
• Show, Ask, Attend, and Answer: A Strong Baseline For Visual Question Answering
  11 Apr 2017 13 repositories listed Syntology ran 9 of 9 samples · 0 unverified · 9 pointer-only (licence)
  This paper presents a new baseline for visual question answering task.
• GPT-4 Technical Report
  15 Mar 2023 11 repositories listed Syntology ran 2 of 5 samples · 3 unverified · 1 pointer-only (licence)
  We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs.
• ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
  6 Aug 2019 11 repositories listed Syntology ran 10 of 34 samples · 24 unverified · 34 pointer-only (licence)
  We present ViLBERT (short for Vision-and-Language BERT), a model for learning task-agnostic joint representations of image content and natural language.
• Hadamard Product for Low-rank Bilinear Pooling
  14 Oct 2016 11 repositories listed
  Bilinear models provide rich representations compared with linear models.
• VisualBERT: A Simple and Performant Baseline for Vision and Language
  9 Aug 2019 10 repositories listed Syntology ran 4 of 9 samples · 5 unverified · 6 pointer-only (licence)
  We propose VisualBERT, a simple and flexible framework for modeling a broad range of vision-and-language tasks.
• Compositional Attention Networks for Machine Reasoning
  8 Mar 2018 10 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  We present the MAC network, a novel fully differentiable neural network architecture, designed to facilitate explicit and expressive reasoning.
• Tips and Tricks for Visual Question Answering: Learnings from the 2017 Challenge
  9 Aug 2017 10 repositories listed
  This paper presents a state-of-the-art model for visual question answering (VQA), which won the first place in the 2017 VQA Challenge.
• Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
  6 Jun 2016 10 repositories listed
  Approaches to multimodal pooling include element-wise product or sum, as well as concatenation of the visual and textual representations.
• Dynamic Memory Networks for Visual and Textual Question Answering
  4 Mar 2016 10 repositories listed Syntology ran 7 of 7 samples · 0 unverified · 7 pointer-only (licence)
  Neural network architectures with memory and attention mechanisms exhibit certain reasoning capabilities required for question answering.
• HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models
  23 Oct 2023 9 repositories listed Syntology ran 2 of 8 samples · 6 unverified · 1 pointer-only (licence)
  Our comprehensive case studies within HallusionBench shed light on the challenges of hallucination and illusion in LVLMs.
• Improved Baselines with Visual Instruction Tuning
  5 Oct 2023 9 repositories listed Syntology ran 6 of 9 samples · 3 unverified · 8 pointer-only (licence)
  Large multimodal models (LMM) have recently shown encouraging progress with visual instruction tuning.
• BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  28 Jan 2022 9 repositories listed
  Furthermore, performance improvement has been largely achieved by scaling up the dataset with noisy image-text pairs collected from the web, which is a suboptimal source of supervision.
• LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
  29 Dec 2020 9 repositories listed
  Pre-training of text and layout has proved effective in a variety of visually-rich document understanding tasks due to its effective model architecture and the advantage of large-scale unlabeled scanned/digital-born…
• LXMERT: Learning Cross-Modality Encoder Representations from Transformers
  20 Aug 2019 9 repositories listed Syntology ran 4 of 15 samples · 11 unverified · 3 pointer-only (licence)
  In LXMERT, we build a large-scale Transformer model that consists of three encoders: an object relationship encoder, a language encoder, and a cross-modality encoder.
• Pythia v0.1: the Winning Entry to the VQA Challenge 2018
  26 Jul 2018 9 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  We demonstrate that by making subtle but important changes to the model architecture and the learning rate schedule, fine-tuning image features, and adding data augmentation, we can significantly improve the performance…
• Hierarchical Question-Image Co-Attention for Visual Question Answering
  31 May 2016 9 repositories listed Syntology ran 1 of 7 samples · 6 unverified · 1 pointer-only (licence)
  In addition, our model reasons about the question (and consequently the image via the co-attention mechanism) in a hierarchical fashion via a novel 1-dimensional convolution neural networks (CNN).
• Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
  18 Sep 2024 8 repositories listed Syntology ran 8 of 12 samples · 4 unverified
  We present the Qwen2-VL Series, an advanced upgrade of the previous Qwen-VL models that redefines the conventional predetermined-resolution approach in visual processing.
• Bilinear Attention Networks
  21 May 2018 8 repositories listed Syntology ran 4 of 13 samples · 9 unverified
  In this paper, we propose bilinear attention networks (BAN) that find bilinear attention distributions to utilize given vision-language information seamlessly.
• Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environments
  20 Nov 2017 8 repositories listed
  This is significant because a robot interpreting a natural-language navigation instruction on the basis of what it sees is carrying out a vision and language process that is similar to Visual Question Answering.
• LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention
  28 Mar 2023 7 repositories listed
  We present LLaMA-Adapter, a lightweight adaption method to efficiently fine-tune LLaMA into an instruction-following model.
• FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understanding
  5 Dec 2020 7 repositories listed
  This dataset demonstrates the post flooded damages of the affected areas.
• UNITER: UNiversal Image-TExt Representation Learning
  25 Sep 2019 7 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 2 pointer-only (licence)
  Different from previous work that applies joint random masking to both modalities, we use conditional masking on pre-training tasks (i.

Syntology lines on 21 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.