Papers › Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering

Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering

29 Mar 2018CVPR 2018 6arXiv:1803.11186archive 2025-07-28

Unnat Jain, Svetlana Lazebnik, Alexander Schwing

Human conversation is a complex mechanism with subtle nuances. It is hence an ambitious goal to develop artificial intelligence agents that can participate fluently in a conversation. While we are still far from achieving this goal, recent progress in visual question answering, image captioning, and visual question generation shows that dialog systems may be realizable in the not too distant future. To this end, a novel dataset was introduced recently and encouraging results were demonstrated, particularly for question answering. In this paper, we demonstrate a simple symmetric discriminative baseline, that can be applied to both predicting an answer as well as predicting a question. We show that this method performs on par with the state of the art, even memory net based methods. In addition, for the first time on the visual dialog dataset, we assess the performance of a system asking questions, and demonstrate how visual dialog can be generated from discriminative question generation and question answering.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image CaptioningQuestion AnsweringQuestion GenerationQuestion-GenerationVisual DialogVisual Question AnsweringVisual Question Answering (VQA)

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Visual Dialog VisDial v0.9 val SF-QIH-se-2 MRR 62.42 #7 of 18 Archive leaderboard report
Visual Dialog VisDial v0.9 val SF-QIH-se-2 Mean Rank 4.70 #7 of 18 Archive leaderboard report
Visual Dialog VisDial v0.9 val SF-QIH-se-2 R@1 48.55 #7 of 18 Archive leaderboard report
Visual Dialog VisDial v0.9 val SF-QIH-se-2 R@10 87.75 #7 of 18 Archive leaderboard report
Visual Dialog VisDial v0.9 val SF-QIH-se-2 R@5 78.96 #7 of 18 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections