Papers › Fréchet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videos

Fréchet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videos

23 Jul 2024arXiv:2407.16124archive 2025-07-28

Jiahe Liu, Youran Qu, Qi Yan, Xiaohui Zeng, Lele Wang, Renjie Liao

Significant advancements have been made in video generative models recently. Unlike image generation, video generation presents greater challenges, requiring not only generating high-quality frames but also ensuring temporal consistency across these frames. Despite the impressive progress, research on metrics for evaluating the quality of generated videos, especially concerning temporal and motion consistency, remains underexplored. To bridge this research gap, we propose Fr\'echet Video Motion Distance (FVMD) metric, which focuses on evaluating motion consistency in video generation. Specifically, we design explicit motion features based on key point tracking, and then measure the similarity between these features via the Fr\'echet distance. We conduct sensitivity analysis by injecting noise into real videos to verify the effectiveness of FVMD. Further, we carry out a large-scale human study, demonstrating that our metric effectively detects temporal noise and aligns better with human perceptions of generated video quality than existing metrics. Additionally, our motion features can consistently improve the performance of Video Quality Assessment (VQA) models, indicating that our approach is also applicable to unary video quality evaluation. Code is available at https://github.com/ljh0v0/FMD-frechet-motion-distance.

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2407.16124")

Code

Syntology Ran 20 of 23 code samples harvested from 2 repositories linked to this paper; 3 have no recorded run. Of those that ran: 2 ran · honoured contract; 18 ran with no contract checked.

By repository: official repository: 20 samples from 1 repository, 18 ran; community (archive-listed): 3 samples from 1 repository, 2 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

ljh0v0/fmd-frechet-motion-distance officialmentioned in papermentioned on GitHubpytorchApache-2.0 report
dsl-lab/fvmd-frechet-video-motion-distance mentioned on GitHubpytorchApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

23 samples harvested; 20 ran; 2 honoured the contract we drafted; 3 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

2ran · honoured contract
18ran
3unverified

Licence: 0 of the 23 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 2 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

bilinear_sample2d ljh0v0/fmd-frechet-motion-distance/fvmd/utils/samp.py official repository ran Apache-2.0 (permissive) · a1c2b83f2ed58af9 · report
calc_acceleration ljh0v0/fmd-frechet-motion-distance/fvmd/keypoint_tracking.py official repository ran Apache-2.0 (permissive) · a6571e1c41b062fb · report
calc_velocity ljh0v0/fmd-frechet-motion-distance/fvmd/keypoint_tracking.py official repository ran Apache-2.0 (permissive) · a6307e11ed350db2 · report
calculate_activation_statistics ljh0v0/fmd-frechet-motion-distance/fvmd/frechet_distance.py official repository ran fingerprinted Apache-2.0 (permissive) · be7a68ab5541a79d · report
calculate_fd_given_vectors ljh0v0/fmd-frechet-motion-distance/fvmd/frechet_distance.py official repository ran fingerprinted Apache-2.0 (permissive) · 96b374030dd1b41b · report
calculate_frechet_distance ljh0v0/fmd-frechet-motion-distance/fvmd/frechet_distance.py official repository ran Apache-2.0 (permissive) · 1640133300f0b805 · report
count_subcube_hist ljh0v0/fmd-frechet-motion-distance/fvmd/extract_motion_features.py official repository ran Apache-2.0 (permissive) · 0b86b901d7c8eee5 · report
cut_subcube ljh0v0/fmd-frechet-motion-distance/fvmd/extract_motion_features.py official repository ran Apache-2.0 (permissive) · 564904fe8c3e3f36 · report
eye_3x3 ljh0v0/fmd-frechet-motion-distance/fvmd/utils/geom.py official repository ran Apache-2.0 (permissive) · c6a46e4312ecdb81 · report
farthest_point_sample ljh0v0/fmd-frechet-motion-distance/fvmd/utils/misc.py official repository ran Apache-2.0 (permissive) · e1adde1a35ea6aa9 · report
get_lr_str ljh0v0/fmd-frechet-motion-distance/fvmd/utils/basic.py official repository ran fingerprinted Apache-2.0 (permissive) · 1ef7e186129f3877 · report
ind2sub ljh0v0/fmd-frechet-motion-distance/fvmd/utils/basic.py official repository ran Apache-2.0 (permissive) · 433a4096809820d8 · report
load ljh0v0/fmd-frechet-motion-distance/fvmd/utils/saverloader.py official repository ran Apache-2.0 (permissive) · 7cc0ed613ecce873 · report
matmul3 ljh0v0/fmd-frechet-motion-distance/fvmd/utils/geom.py official repository ran Apache-2.0 (permissive) · 0d3e6ecf8bc2abdd · report
posemb_sincos_2d_xy ljh0v0/fmd-frechet-motion-distance/fvmd/utils/misc.py official repository ran Apache-2.0 (permissive) · 1ef23d4ecc09d434 · report
preprocess_color ljh0v0/fmd-frechet-motion-distance/fvmd/utils/improc.py official repository ran fingerprinted Apache-2.0 (permissive) · ba50f39a6d884a2e · report
preprocess_color_tf ljh0v0/fmd-frechet-motion-distance/fvmd/utils/improc.py official repository ran Apache-2.0 (permissive) · 7a83555254767abf · report
sub2ind ljh0v0/fmd-frechet-motion-distance/fvmd/utils/basic.py official repository ran fingerprinted Apache-2.0 (permissive) · 49458c1bab9add55 · report
calc_hist ljh0v0/fmd-frechet-motion-distance/fvmd/extract_motion_features.py official repository unverified Apache-2.0 (permissive) · cf1497316cd1cf12 · report
pca_embed ljh0v0/fmd-frechet-motion-distance/fvmd/utils/improc.py official repository unverified Apache-2.0 (permissive) · 0794073727c4b054 · report
coords_grid dsl-lab/fvmd-frechet-video-motion-distance/fvmd/nets/pips2.py community (archive-listed) ran · honoured contract Apache-2.0 (permissive) · ea43be6c224959b1 · report
matmul2 dsl-lab/fvmd-frechet-video-motion-distance/fvmd/utils/geom.py community (archive-listed) ran · honoured contract fingerprinted Apache-2.0 (permissive) · c9c44e261dffcaf1 · report
bilinear_sampler dsl-lab/fvmd-frechet-video-motion-distance/fvmd/nets/pips2.py community (archive-listed) unverified Apache-2.0 (permissive) · 1ac8cce613d98769 · report

Tasks

Image GenerationPoint TrackingVideo GenerationVideo Quality AssessmentVisual Question Answering (VQA)

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections