| Gramian Multimodal Representation Learning and Alignment |
2 |
2 |
16 Dec 2024 |
official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 3 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (1 pointer-only for licence) |
| InternVideo2: Scaling Foundation Models for Multimodal Video Understanding |
2 |
3 |
22 Mar 2024 |
not harvested |
| vid-TLDR: Training Free Token merging for Light-weight Video Transformer |
1 |
2 |
20 Mar 2024 |
official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified |
| RTQ: Rethinking Video-language Understanding Based on Image-text Model |
2 |
1 |
1 Dec 2023 |
not harvested |
| TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding |
1 |
1 |
29 Oct 2023 |
official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 3 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (5 pointer-only for licence) |
| LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment |
6 |
2 |
3 Oct 2023 |
official (archive's flag): 5 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 3 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (3 pointer-only for licence) |
| Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval |
1 |
1 |
29 Sep 2023 |
official (archive's flag): 17 ran · 17 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 5 honoured, 1 violated, 3 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified (8 pointer-only for licence) |
| BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning |
1 |
1 |
27 Sep 2023 |
official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (2 pointer-only for licence) |
| Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning |
1 |
1 |
20 Sep 2023 |
not harvested |
| COSA: Concatenated Sample Pretrained Vision-Language Foundation Model |
1 |
1 |
15 Jun 2023 |
not harvested |
| VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset |
2 |
2 |
29 May 2023 |
official (archive's flag): 12 ran · 35 ran (of which 4 constructed an object rather than computing a result; 25 with no instrument failure: 4 honoured, 1 violated, 20 with no contract checked; 10 where Syntology's instrument failed) · 7 unverified (8 pointer-only for licence) |
| VLAB: Enhancing Video Language Pre-training by Feature Adapting and Blending |
0 |
1 |
22 May 2023 |
not harvested |
| VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset |
1 |
1 |
17 Apr 2023 |
not harvested |
| Unmasked Teacher: Towards Training-Efficient Video Foundation Models |
1 |
2 |
28 Mar 2023 |
official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence) |
| Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning |
4 |
1 |
25 Mar 2023 |
official (archive's flag): 1 ran · 12 ran (of which 7 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified |
| DiffusionRet: Generative Text-Video Retrieval with Diffusion Model |
4 |
2 |
17 Mar 2023 |
official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified |
| MuLTI: Efficient Video-and-Language Understanding with Text-Guided MultiWay-Sampler and Multiple Choice Modeling |
0 |
1 |
10 Mar 2023 |
not harvested |
| mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video |
4 |
2 |
1 Feb 2023 |
community repositories only · 17 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 9 where Syntology's instrument failed) · 2 unverified (2 pointer-only for licence) |
| Revisiting Temporal Modeling for CLIP-based Image-to-Video Knowledge Transferring |
1 |
1 |
26 Jan 2023 |
not harvested |
| Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval? |
4 |
1 |
31 Dec 2022 |
official (archive's flag): 14 ran · 20 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 5 honoured, 1 violated, 3 with no contract checked; 11 where Syntology's instrument failed) · 5 unverified (11 pointer-only for licence) |
| HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training |
0 |
3 |
30 Dec 2022 |
not harvested |
| VindLU: A Recipe for Effective Video-and-Language Pretraining |
1 |
1 |
9 Dec 2022 |
not harvested |
| InternVideo: General Video Foundation Models via Generative and Discriminative Learning |
2 |
2 |
6 Dec 2022 |
official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified |
| OmniVL:One Foundation Model for Image-Language and Video-Language Tasks |
0 |
2 |
15 Sep 2022 |
not harvested |
| CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment |
1 |
1 |
14 Sep 2022 |
official (archive's flag): 4 ran · 4 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (4 pointer-only for licence) |
| An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling |
1 |
1 |
4 Sep 2022 |
not harvested |
| Clover: Towards A Unified Video-Language Alignment and Fusion Model |
1 |
2 |
16 Jul 2022 |
not harvested |
| X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval |
3 |
1 |
15 Jul 2022 |
official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence) |
| LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval |
0 |
1 |
11 Jul 2022 |
not harvested |
| Revealing Single Frame Bias for Video-and-Language Learning |
2 |
3 |
7 Jun 2022 |
community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (2 pointer-only for licence) |
| MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval |
1 |
1 |
26 Apr 2022 |
not harvested |
| Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations |
0 |
2 |
7 Apr 2022 |
not harvested |
| Disentangled Representation Learning for Text-Video Retrieval |
2 |
1 |
14 Mar 2022 |
official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 4 honoured, 1 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (4 pointer-only for licence) |
| Bridging Video-text Retrieval with Multiple Choice Questions |
2 |
1 |
13 Jan 2022 |
official (archive's flag): 2 ran · 13 ran (of which 8 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified (6 pointer-only for licence) |
| Cross Modal Retrieval with Querybank Normalisation |
1 |
1 |
23 Dec 2021 |
official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified |
| Align and Prompt: Video-and-Language Pre-training with Entity Prompts |
1 |
2 |
17 Dec 2021 |
not harvested |
| Object-aware Video-language Pre-training for Retrieval |
1 |
1 |
1 Dec 2021 |
not harvested |
| VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling |
1 |
1 |
24 Nov 2021 |
official: harvested, nothing ran · 0 ran · 2 unverified (2 pointer-only for licence) |
| Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions |
1 |
1 |
19 Nov 2021 |
not harvested |
| VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding |
2 |
1 |
28 Sep 2021 |
not harvested |
| Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss |
2 |
1 |
9 Sep 2021 |
not harvested |
| CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval |
5 |
1 |
18 Apr 2021 |
official: harvested, nothing ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (3 pointer-only for licence) |
| Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval |
5 |
3 |
1 Apr 2021 |
official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (3 pointer-only for licence) |
| Rudder: A Cross Lingual Video and Text Retrieval Dataset |
1 |
1 |
9 Mar 2021 |
not harvested |
| VLG-Net: Video-Language Graph Matching Network for Video Grounding |
1 |
1 |
19 Nov 2020 |
1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified |
| Use What You Have: Video Retrieval Using Representations From Collaborative Experts |
3 |
1 |
31 Jul 2019 |
3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (1 pointer-only for licence) |