Visual Dialog

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

8 leaderboard tables shown for this task, 8 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

9 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 56 papers with code (118 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Visual Dialog
  26 Nov 2016 11 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  We introduce the task of Visual Dialog, which requires an AI agent to hold a meaningful dialog with humans in natural, conversational language about visual content.
• Hierarchical Question-Image Co-Attention for Visual Question Answering
  31 May 2016 9 repositories listed Syntology ran 1 of 7 samples · 6 unverified · 1 pointer-only (licence)
  In addition, our model reasons about the question (and consequently the image via the co-attention mechanism) in a hierarchical fashion via a novel 1-dimensional convolution neural networks (CNN).
• Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning
  20 Mar 2017 7 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 1 pointer-only (licence)
  Specifically, we pose a cooperative 'image guessing' game between two agents -- Qbot and Abot -- who communicate in natural language dialog so that Qbot can select an unseen image from a lineup of images.
• Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7
  1 Jun 2018 4 repositories listed
  Scene-aware dialog systems will be able to have conversations with users about the objects and events around them.
• Perceptual Score: What Data Modalities Does Your Model Perceive?
  27 Oct 2021 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  To study and quantify this concern, we introduce the perceptual score, a metric that assesses the degree to which a model relies on the different subsets of the input features, i.
• Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
  27 Mar 2024 2 repositories listed Syntology ran 7 of 8 samples · 1 unverified
  We try to narrow the gap by mining the potential of VLMs for better performance and any-to-any workflow from three aspects, i.
• The Dialog Must Go On: Improving Visual Dialog via Generative Self-Training
  25 May 2022 2 repositories listed
  As a result, GST scales the amount of training data up to an order of magnitude that of VisDial (1.
• Where Are You? Localization from Embodied Dialog
  16 Nov 2020 2 repositories listed
  In this paper, we focus on the LED task -- providing a strong baseline model with detailed ablations characterizing both dataset biases and the importance of various modeling choices.
• History for Visual Dialog: Do we really need it?
  8 May 2020 2 repositories listed
  Visual Dialog involves "understanding" the dialog history (what has been discussed previously) and the current question (what is asked), in addition to grounding information in the image, to generate the correct…
• Large-scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline
  5 Dec 2019 2 repositories listed Syntology ran 3 of 6 samples · 3 unverified
  Next, we find that additional finetuning using "dense" annotations in VisDial leads to even higher NDCG -- more than 10% over our base model -- but hurts MRR -- more than 17% below our base model!
• Dual Attention Networks for Visual Reference Resolution in Visual Dialog
  25 Feb 2019 2 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  Specifically, REFER module learns latent relationships between a given question and a dialog history by employing a self-attention mechanism.
• Visual Dialogue without Vision or Dialogue
  16 Dec 2018 2 repositories listed
  We characterise some of the quirks and shortcomings in the exploration of Visual Dialogue - a sequential question-answering task where the questions and corresponding answers are related through given visual stimuli.
• Hawk: Learning to Understand Open-World Video Anomalies
  27 May 2024 1 repository listed Syntology ran 7 of 9 samples · 2 unverified · 9 pointer-only (licence)
  Video Anomaly Detection (VAD) systems can autonomously monitor and identify disturbances, reducing the need for manual labor and associated costs.
• Collecting Visually-Grounded Dialogue with A Game Of Sorts
  10 Sep 2023 1 repository listed
  We address these concerns by introducing a collaborative image ranking task, a grounded agreement game we call "A Game Of Sorts".
• PaCE: Unified Multi-modal Dialogue Pre-training with Progressive and Compositional Experts
  24 May 2023 1 repository listed Syntology ran 0 of 1 samples · 1 unverified
  It utilizes a combination of several fundamental experts to accommodate multiple dialogue-related tasks and can be pre-trained using limited dialogue and extensive non-dialogue multi-modal data.
• Unified Multimodal Model with Unlikelihood Training for Visual Dialog
  23 Nov 2022 1 repository listed
  Prior work performs the standard likelihood training for answer generation on the positive instances (involving correct answers).
• LAVIS: A Library for Language-Vision Intelligence
  15 Sep 2022 1 repository listed
  We introduce LAVIS, an open-source deep learning library for LAnguage-VISion research and applications.
• Video Dialog as Conversation about Objects Living in Space-Time
  8 Jul 2022 1 repository listed
  To tackle these challenges we present a new object-centric framework for video dialog that supports neural reasoning dubbed COST - which stands for Conversation about Objects in Space-Time.
• VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolution
  29 May 2022 1 repository listed
  In this paper, we propose VD-PCR, a novel framework to improve Visual Dialog understanding with Pronoun Coreference Resolution in both implicit and explicit ways.
• Spot the Difference: A Cooperative Object-Referring Game in Non-Perfectly Co-Observable Scene
  16 Mar 2022 1 repository listed
  Visual dialog has witnessed great progress after introducing various vision-oriented goals into the conversation, especially such as GuessWhich and GuessWhat, where the only image is visible by either and both of the…
• UNITER-Based Situated Coreference Resolution with Rich Multimodal Input
  7 Dec 2021 1 repository listed
  Our model ranks second in the official evaluation on the object coreference resolution task with an F1 score of 73.
• Enhancing Visual Dialog Questioner with Entity-based Strategy Learning and Augmented Guesser
  6 Sep 2021 1 repository listed
  To enhance VD Questioner: 1) we propose a Related entity enhanced Questioner (ReeQ) that generates questions under the guidance of related entities and learns entity-based questioning strategy from human dialogs; 2) we…
• SeqDialN: Sequential Visual Dialog Network in Joint Visual-Linguistic Representation Space
  1 Aug 2021 1 repository listed
  In this work, we formulate a visual dialog as an information flow in which each piece of information is encoded with the joint visual-linguistic representation of a single dialog round.
• Learning Better Visual Dialog Agents with Pretrained Visual-Linguistic Representation
  24 May 2021 1 repository listed
  Most existing work for Guesser encode the dialog history as a whole and train the Guesser models from scratch on the GuessWhat?!
• Ensemble of MRR and NDCG models for Visual Dialog
  15 Apr 2021 1 repository listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  However, the NDCG metric favors the usually applicable uncertain answers such as `I don't know.
• Answer-Driven Visual State Estimator for Goal-Oriented Visual Dialogue
  1 Oct 2020 1 repository listed
  In this paper, we propose an Answer-Driven Visual State Estimator (ADVSE) to impose the effects of different answers on visual states.
• SeqDialN: Sequential Visual Dialog Networks in Joint Visual-Linguistic Representation Space
  2 Aug 2020 1 repository listed
  IP based SeqDialN is our baseline with a simple 2-layer LSTM design that achieves decent performance.
• Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data
  24 Jul 2020 1 repository listed
  Can we develop visually grounded dialog agents that can efficiently adapt to new tasks without forgetting how to talk to people?
• Multi-View Attention Network for Visual Dialog
  29 Apr 2020 1 repository listed
  To resolve the visual dialog task, a high-level understanding of various multimodal inputs (e.
• VD-BERT: A Unified Vision and Dialog Transformer with BERT
  28 Apr 2020 1 repository listed Syntology ran 2 of 11 samples · 9 unverified
  By contrast, in this work, we propose VD-BERT, a simple yet effective framework of unified vision-dialog Transformer that leverages the pretrained BERT language models for Visual Dialog tasks.

Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.