TGIF-Frame

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

12 shown of 12 papers with code (15 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
  1 Feb 2023 4 repositories listed Syntology ran 9 of 19 samples · 10 unverified
  In contrast to predominant paradigms of solely relying on sequence-to-sequence generation or encoder-based instance discrimination, mPLUG-2 introduces a multi-module composition network by sharing common universal…
• Zero-Shot Video Question Answering via Frozen Bidirectional Language Models
  16 Jun 2022 3 repositories listed Syntology ran 14 of 34 samples · 20 unverified · 1 pointer-only (licence)
  Manual annotation of question and answers for videos, however, is tedious and prohibits scalability.
• Self-Adaptive Sampling for Efficient Video Question-Answering on Image--Text Models
  9 Jul 2023 2 repositories listed
  Video question-answering is a fundamental task in the field of video understanding.
• VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
  29 May 2023 2 repositories listed Syntology ran 15 of 42 samples · 27 unverified
  Based on the proposed VAST-27M dataset, we train an omni-modality video-text foundational model named VAST, which can perceive and process vision, audio, and subtitle modalities from video, and better support various…
• Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Models
  18 Aug 2023 1 repository listed Syntology ran 3 of 8 samples · 5 unverified · 8 pointer-only (licence)
  We hence propose a new benchmark, Open-vocabulary Video Question Answering (OVQA), to measure the generalizability of VideoQA models by considering rare and unseen answers.
• Lightweight Recurrent Cross-modal Encoder for Video Question Answering
  30 Jun 2023 1 repository listed
  Due to the high computational cost of the self-attention and the high dimensional data of video, they either have to settle for: 1) only training the cross-modal encoder on offline-extracted video and text features or…
• COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
  15 Jun 2023 1 repository listed
  Due to the limited scale and quality of video-text training corpus, most vision-language foundation models employ image-text datasets for pretraining and primarily focus on modeling visually semantic representations…
• VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
  17 Apr 2023 1 repository listed
  Different from widely-studied vision-language pretraining models, VALOR jointly models relationships of vision, audio and language in an end-to-end manner.
• MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models
  23 Mar 2023 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Therefore, we propose MEta Loss TRansformer (MELTR), a plug-in module that automatically and non-linearly combines various loss functions to aid learning the target task via auxiliary learning.
• An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling
  4 Sep 2022 1 repository listed
  Masked visual modeling (MVM) has been recently proven effective for visual pre-training.
• Clover: Towards A Unified Video-Language Alignment and Fusion Model
  16 Jul 2022 1 repository listed
  We then introduce \textbf{Clover}\textemdash a Correlated Video-Language pre-training method\textemdash towards a universal Video-Language model for solving multiple video understanding tasks with neither performance…
• All in One: Exploring Unified Video-Language Pre-training
  14 Mar 2022 1 repository listed
  In this work, we for the first time introduce an end-to-end video-language model, namely \textit{all-in-one Transformer}, that embeds raw video and textual signals into joint representations using a unified backbone…

Syntology lines on 5 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.