Papers › Background-aware Moment Detection for Video Moment Retrieval
Background-aware Moment Detection for Video Moment Retrieval
Minjoon Jung, Youwon Jang, SeongHo Choi, Joochan Kim, Jin-Hwa Kim, Byoung-Tak Zhang
Video moment retrieval (VMR) identifies a specific moment in an untrimmed video for a given natural language query. This task is prone to suffer the weak alignment problem innate in video datasets. Due to the ambiguity, a query does not fully cover the relevant details of the corresponding moment, or the moment may contain misaligned and irrelevant frames, potentially limiting further performance gains. To tackle this problem, we propose a background-aware moment detection transformer (BM-DETR). Our model adopts a contrastive approach, carefully utilizing the negative queries matched to other moments in the video. Specifically, our model learns to predict the target moment from the joint probability of each frame given the positive query and the complement of negative queries. This leads to effective use of the surrounding background, improving moment sensitivity and enhancing overall alignments in videos. Extensive experiments on four benchmarks demonstrate the effectiveness of our approach. Our code is available at: \url{https://github.com/minjoong507/BM-DETR}
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Moment Retrieval | Charades-STA | BM-DETR | R@1 IoU=0.5 | 59.48 | #13 of 25 | Archive leaderboard | report |
| Moment Retrieval | Charades-STA | BM-DETR | R@1 IoU=0.7 | 38.33 | #13 of 25 | Archive leaderboard | report |
| Moment Retrieval | QVHighlights | BM-DETR | R@1 IoU=0.5 | 60.12 | #22 of 32 | Archive leaderboard | report |
| Moment Retrieval | QVHighlights | BM-DETR | R@1 IoU=0.7 | 43.05 | #22 of 32 | Archive leaderboard | report |
| Moment Retrieval | QVHighlights | BM-DETR | mAP | 40.08 | #22 of 32 | Archive leaderboard | report |
| Moment Retrieval | QVHighlights | BM-DETR | mAP@0.5 | 63.08 | #22 of 32 | Archive leaderboard | report |
| Moment Retrieval | QVHighlights | BM-DETR | mAP@0.75 | 40.18 | #22 of 32 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections