Papers › LAMV: Learning to Align and Match Videos With Kernelized Temporal Layers
LAMV: Learning to Align and Match Videos With Kernelized Temporal Layers
Lorenzo Baraldi, Matthijs Douze, Rita Cucchiara, Hervé Jégou
This paper considers a learnable approach for comparing and aligning videos. Our architecture builds upon and revisits temporal match kernels within neural networks: we propose a new temporal layer that finds temporal alignments by maximizing the scores between two sequences of vectors, according to a time-sensitive similarity metric parametrized in the Fourier domain. We learn this layer with a temporal proposal strategy, in which we minimize a triplet loss that takes into account both the localization accuracy and the recognition rate. We evaluate our approach on video alignment, copy detection and event retrieval. Our approach outperforms the state on the art on temporal video alignment and video copy detection datasets in comparable setups. It also attains the best reported results for particular event search, while precisely aligning videos.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
1 archive task tag without a task page not shown.
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Video Alignment | MSU Video Alignment and Retrieval Benchmark Suite | TMK | Accuracy w/ 3 frames error (Hard) | 0.0554 | #4 of 4 | Archive leaderboard | report |
| Video Alignment | MSU Video Alignment and Retrieval Benchmark Suite | TMK | Accuracy w/ 3 frames error (Light) | 0.0571 | #4 of 4 | Archive leaderboard | report |
| Video Alignment | MSU Video Alignment and Retrieval Benchmark Suite | TMK | Accuracy w/ 3 frames error (Medium color) | 0.0607 | #4 of 4 | Archive leaderboard | report |
| Video Alignment | MSU Video Alignment and Retrieval Benchmark Suite | TMK | Accuracy w/ 3 frames error (Medium geometric) | 0.0446 | #4 of 4 | Archive leaderboard | report |
| Video Retrieval | FIVR-200K | LAMV | mAP (CSVR) | 0.466 | #17 of 17 | Archive leaderboard | report |
| Video Retrieval | FIVR-200K | LAMV | mAP (DSVR) | 0.496 | #17 of 17 | Archive leaderboard | report |
| Video Retrieval | FIVR-200K | LAMV | mAP (ISVR) | 0.371 | #17 of 17 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections