Audio-Visual Question Answering (AVQA)

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

15 shown of 15 papers with code (20 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
  18 May 2023 2 repositories listed Syntology ran 2 of 7 samples · 5 unverified
  In this work, we explore a scalable way for building a general representation model toward unlimited modalities.
• FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal Reasoning
  1 Apr 2025 1 repository listed
  The first stage expands the test space with greater diversity, while the second enables a refined robustness evaluation across rare, frequent, and overall question distributions.
• Question-Aware Gaussian Experts for Audio-Visual Question Answering
  6 Mar 2025 1 repository listed
  However, existing methods mainly use question information implicitly, limiting focus on question-specific details.
• Boosting Audio Visual Question Answering via Key Semantic-Aware Cues
  30 Jul 2024 1 repository listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  The Audio Visual Question Answering (AVQA) task aims to answer questions related to various visual objects, sounds, and their interactions in videos.
• Learning Trimodal Relation for AVQA with Missing Modality
  23 Jul 2024 1 repository listed Syntology ran 20 of 24 samples · 4 unverified · 3 pointer-only (licence)
  Recent Audio-Visual Question Answering (AVQA) methods rely on complete visual and audio input to answer questions accurately.
• Towards Multilingual Audio-Visual Question Answering
  13 Jun 2024 1 repository listed
  In this paper, we work towards extending Audio-Visual Question Answering (AVQA) to multilingual settings.
• Look, Listen, and Answer: Overcoming Biases for Audio-Visual Question Answering
  18 Apr 2024 1 repository listed Syntology ran 2 of 3 samples · 1 unverified · 1 pointer-only (licence)
  The former leads to a large, diverse test space, while the latter results in a comprehensive robustness evaluation on rare, frequent, and overall questions.
• Answering Diverse Questions via Text Attached with Key Audio-Visual Clues
  11 Mar 2024 1 repository listed
  Audio-visual question answering (AVQA) requires reference to video content and auditory information, followed by correlating the question to predict the most precise answer.
• CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarios
  7 Mar 2024 1 repository listed Syntology ran 6 of 12 samples · 6 unverified
  This paper focuses on the challenge of answering questions in scenarios that are composed of rich and complex dynamic audio-visual components.
• Object-aware Adaptive-Positivity Learning for Audio-Visual Question Answering
  20 Dec 2023 1 repository listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  These selected pairs are constrained to have larger similarity values than the mismatched pairs.
• Progressive Spatio-temporal Perception for Audio-Visual Question Answering
  10 Aug 2023 1 repository listed
  Such naturally multi-modal videos are composed of rich and complex dynamic audio-visual components, where most of which could be unrelated to the given questions, or even play as interference in answering the content of…
• Target-Aware Spatio-Temporal Reasoning via Answering Questions in Dynamics Audio-Visual Scenarios
  21 May 2023 1 repository listed
  Recent works rely on elaborate target-agnostic parsing of audio-visual scenes for spatial grounding while mistreating audio and video as separate entities for temporal grounding.
• VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
  17 Apr 2023 1 repository listed
  Different from widely-studied vision-language pretraining models, VALOR jointly models relationships of vision, audio and language in an end-to-end manner.
• Learning to Answer Questions in Dynamic Audio-Visual Scenarios
  26 Mar 2022 1 repository listed Syntology ran 0 of 4 samples · 4 unverified
  In this paper, we focus on the Audio-Visual Question Answering (AVQA) task, which aims to answer questions regarding different visual objects, sounds, and their associations in videos.
• Hierarchical Conditional Relation Networks for Video Question Answering
  25 Feb 2020 1 repository listed
  Video question answering (VideoQA) is challenging as it requires modeling capacity to distill dynamic visual artifacts and distant relations and to associate them with linguistic concepts.

Syntology lines on 7 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.