Browse State-of-the-Art › Video Alignment
Video Alignment
43 papers with code · 2 benchmarks · 4 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| MSU Video Alignment and Retrieval Benchmark Suite (4 rows) | VQMT3D | ACCURATE METHOD OF TEMPORAL-SHIFT ESTIMATION FOR 3D VIDEO | — | — | Compare |
| UPenn Action (4 rows) | TCC + TCN | Temporal Cycle-Consistency Learning | code | Syntology 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 83 · with a code link: 43 · where Syntology ran a sample: 17 (13 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (17 of 83 tagged: 13 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 83 of 83, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
23 Apr 2017 7 repositories listedWhile representations are learned from an unlabeled collection of task-related videos, robot behaviors such as pouring are learned by watching a single 3rd-person demonstration by a human.
-
3 Dec 2024 2 repositories listed Syntology official (archive's flag): 16 ran · 18 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 12 where Syntology's instrument failed) · 9 unverified (of 27 harvested samples) · 27 pointer-only (licence)In this report, we introduce HunyuanVideo, an innovative open-source video foundation model that demonstrates performance in video generation comparable to, or even surpassing, that of leading closed-source models.
-
21 Aug 2024 2 repositories listedTo the best of our knowledge, VE-Bench introduces the first quality assessment dataset for video editing and an effective subjective-aligned quantitative metric for this domain.
-
12 Aug 2024 2 repositories listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)We present CogVideoX, a large-scale text-to-video generation model based on diffusion transformer, which can generate 10-second continuous videos aligned with text prompt, with a frame rate of 16 fps and resolution of…
-
8 Jul 2024 2 repositories listedSora's high-motion intensity and long consistent videos have significantly impacted the field of video generation, attracting unprecedented attention.
-
3 Jan 2024 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)To establish a unified evaluation framework for video generation tasks, our benchmark includes 11 metrics spanning four dimensions to assess algorithm performance.
-
23 Oct 2020 2 repositories listedRecognition of human poses and actions is crucial for autonomous systems to interact smoothly with people.
-
2 Dec 2019 2 repositories listedDepictions of similar human body configurations can vary with changing viewpoints.
-
16 Apr 2019 2 repositories listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples)We introduce a self-supervised representation learning method based on the task of temporal alignment between videos.
-
27 Jul 2017 2 repositories listedDiscriminative clustering has been successfully applied to a number of weakly-supervised learning tasks.
-
10 Jun 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)The parameter-efficient adaptation of the image-text pretraining model CLIP for video-text retrieval is a prominent area of research.
-
29 May 2025 1 repository listedGenerating highly dynamic and photorealistic portrait animations driven by audio and skeletal motion remains challenging due to the need for precise lip synchronization, natural facial expressions, and high-fidelity…
-
17 May 2025 1 repository listedTo this end, we present AIGVE-60K, a comprehensive dataset and benchmark for AI-Generated Video Evaluation, which features (i) comprehensive tasks, encompassing 3, 050 extensive prompts across 20 fine-grained task…
-
7 May 2025 1 repository listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Customized video generation aims to produce videos featuring specific subjects under flexible user-defined conditions, yet existing methods often struggle with identity consistency and limited input modalities.
-
5 Apr 2025 1 repository listedWith the ability of 4D and video generation, Video4DGen offers a powerful tool for applications in virtual reality, animation, and beyond.
-
11 Mar 2025 1 repository listedWe propose a new task, video referring matting, which obtains the alpha matte of a specified instance by inputting a referring caption.
-
5 Mar 2025 1 repository listedThe objective of this work is to align asynchronous subtitles in sign language videos with limited labelled data.
-
31 Jan 2025 1 repository listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 3 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 6 pointer-only (licence)The remarkable progress in text-to-video diffusion models enables photorealistic generations, although the contents of the generated video often include unnatural movement or deformation, reverse playback, and…
-
1 Jan 2025 1 repository listedHowever, existing visual-to-visual and visual-to-textual Ego-Exo video alignment methods struggle with the problem that there could be non-visual overlap for the same activity.
-
22 Nov 2024 1 repository listedAs these models become prevalent, various metrics and benchmarks have emerged to evaluate the quality of the generated videos.
-
8 Oct 2024 1 repository listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 8 pointer-only (licence)In this paper, we focus on enhancing a diffusion-based text-to-video (T2V) model during the post-training phase by distilling a highly capable consistency model from a pretrained T2V model.
-
8 Sep 2024 1 repository listedMaTAV is with the advantages of aligning unimodal features to ensure consistency across different modalities and handling long input sequences to better capture contextual multimodal information.
-
6 Sep 2024 1 repository listedRobust frame-wise embeddings are essential to perform video analysis and understanding tasks.
-
1 Jul 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 7 pointer-only (licence)Meanwhile, the temporal controller incorporates an onset detector and a timestampbased adapter to achieve precise audio-video alignment.
-
20 Jun 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)To mitigate the risk of harmful outputs from large vision models (LVMs), we introduce the SafeSora dataset to promote research on aligning text-to-video generation with human values.
-
21 Apr 2024 1 repository listedOur approach exhibits an improved ability to leverage the video modality by using the audio modality as a bridge with the language modality.
-
18 Mar 2024 1 repository listedTo this end, this paper proposes a novel text-guided video inpainting model that achieves better consistency, controllability and compatibility.
-
18 Mar 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)Based on T2VQA-DB, we propose a novel transformer-based model for subjective-aligned Text-to-Video Quality Assessment (T2VQA).
-
17 Oct 2023 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 11 pointer-only (licence)For video generation, various open-sourced models and public-available services have been developed to generate high-quality videos.
-
27 Sep 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)In this paper, we are the first to propose a hybrid model, dubbed as Show-1, which marries pixel-based and latent-based VDMs for text-to-video generation.
-
26 Jun 2023 1 repository listed
-
15 Jun 2023 1 repository listed
-
18 May 2023 1 repository listed
-
15 May 2023 1 repository listed
-
30 Mar 2023 1 repository listed
-
24 Mar 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
22 Mar 2023 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
-
22 Oct 2022 1 repository listed
-
23 Jun 2022 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples)
-
28 Mar 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
21 Oct 2019 1 repository listed
-
19 Aug 2018 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
1 Jun 2018 1 repository listed
-
Audio-Sync Video Generation with Multi-Stream Temporal Control9 Jun 2025 0 repositories listed
-
DAPE: Dual-Stage Parameter-Efficient Fine-Tuning for Consistent Video Editing with Diffusion Models11 May 2025 0 repositories listed
-
DyST-XL: Dynamic Layout Planning and Content Control for Compositional Text-to-Video Generation21 Apr 2025 0 repositories listed
-
Smooth-Foley: Creating Continuous Sound for Video-to-Audio Generation Under Semantic Guidance24 Dec 2024 0 repositories listed
-
Improving Dynamic Object Interactions in Text-to-Video Generation with AI Feedback3 Dec 2024 0 repositories listed
-
VideoRepair: Improving Text-to-Video Generation via Misalignment Evaluation and Localized Refinement22 Nov 2024 0 repositories listed
-
Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Content10 Oct 2024 0 repositories listed
-
Learning to Localize Actions in Instructional Videos with LLM-Based Multi-Pathway Text-Video Alignment22 Sep 2024 0 repositories listed
-
Sync from the Sea: Retrieving Alignable Videos from Large-Scale Datasets2 Sep 2024 0 repositories listed
-
Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Model31 Jul 2024 0 repositories listed
-
A Comprehensive Review of Few-shot Action Recognition20 Jul 2024 0 repositories listed
-
Semantic GUI Scene Learning and Video Alignment for Detecting Duplicate Video-based Bug Reports11 Jul 2024 0 repositories listed
-
Align and Aggregate: Compositional Reasoning with Video Alignment and Answer Aggregation for Video Question-Answering3 Jul 2024 0 repositories listed
-
AniClipart: Clipart Animation with Text-to-Video Priors18 Apr 2024 0 repositories listed
-
Scaling Up Video Summarization Pretraining with Large Language Models4 Apr 2024 0 repositories listed
-
The Effects of Short Video-Sharing Services on Video Copy Detection26 Mar 2024 0 repositories listed
-
FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing10 Mar 2024 0 repositories listed
-
Towards A Better Metric for Text-to-Video Generation15 Jan 2024 0 repositories listed
-
Frequency-aware Event-based Video Deblurring for Real-World Motion Blur1 Jan 2024 0 repositories listed
-
Learning to Predict Activity Progress by Self-Supervised Video Alignment1 Jan 2024 0 repositories listed
-
STELLA: Continual Audio-Video Pre-training with Spatio-Temporal Localized Alignment12 Oct 2023 0 repositories listed
-
24 Jul 2023 0 repositories listed
-
ContentCTR: Frame-level Live Streaming Click-Through Rate Prediction with Multimodal Transformer26 Jun 2023 0 repositories listed
-
Learning to Ground Instructional Articles in Videos through Narrations6 Jun 2023 0 repositories listed
-
Learning by Aligning 2D Skeleton Sequences and Multi-Modality Fusion31 May 2023 0 repositories listed
-
Video alignment using unsupervised learning of local and global features13 Apr 2023 0 repositories listed
-
VADER: Video Alignment Differencing and Retrieval23 Mar 2023 0 repositories listed
-
Weakly-supervised Representation Learning for Video Alignment and Analysis8 Feb 2023 0 repositories listed
-
1 Jan 2023 0 repositories listed
-
Self-supervised and Weakly Supervised Contrastive Learning for Frame-wise Action Representations6 Dec 2022 0 repositories listed
-
Learning by Aligning Videos in Time31 Mar 2021 0 repositories listed
-
Normalized Human Pose Features for Human Action Video Alignment1 Jan 2021 0 repositories listed
-
1 Dec 2018 0 repositories listed
-
Teaching Machines to Understand Baseball Games: Large-Scale Baseball Video Database for Multiple Video Understanding Tasks1 Sep 2018 0 repositories listed
-
Learning to Align Images using Weak Geometric Supervision4 Aug 2018 0 repositories listed
-
3 Jun 2018 0 repositories listed
-
Learning Robust Video Synchronization without Annotations19 Oct 2016 0 repositories listed
-
28 Mar 2016 0 repositories listed
-
Book2Movie: Aligning Video Scenes With Book Chapters1 Jun 2015 0 repositories listed
-
Road Detection via On--line Label Transfer10 Dec 2014 0 repositories listed
Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections