Papers › VRAG: Region Attention Graphs for Content-Based Video Retrieval
VRAG: Region Attention Graphs for Content-Based Video Retrieval
Kennard Ng, Ser-Nam Lim, Gim Hee Lee
Content-based Video Retrieval (CBVR) is used on media-sharing platforms for applications such as video recommendation and filtering. To manage databases that scale to billions of videos, video-level approaches that use fixed-size embeddings are preferred due to their efficiency. In this paper, we introduce Video Region Attention Graph Networks (VRAG) that improves the state-of-the-art of video-level methods. We represent videos at a finer granularity via region-level features and encode video spatio-temporal dynamics through region-level relations. Our VRAG captures the relationships between regions based on their semantic content via self-attention and the permutation invariant aggregation of Graph Convolution. In addition, we show that the performance gap between video-level and frame-level methods can be reduced by segmenting videos into shots and using shot embeddings for video retrieval. We evaluate our VRAG over several video retrieval tasks and achieve a new state-of-the-art for video-level retrieval. Furthermore, our shot-level VRAG shows higher retrieval precision than other existing video-level methods, and closer performance to frame-level methods at faster evaluation speeds. Finally, our code will be made publicly available.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Video Retrieval | FIVR-200K | VRAG (CS) | mAP (CSVR) | 0.678 | #13 of 17 | Archive leaderboard | report |
| Video Retrieval | FIVR-200K | VRAG (CS) | mAP (DSVR) | 0.723 | #13 of 17 | Archive leaderboard | report |
| Video Retrieval | FIVR-200K | VRAG (CS) | mAP (ISVR) | 0.554 | #13 of 17 | Archive leaderboard | report |
| Video Retrieval | FIVR-200K | VRAG (video) | mAP (CSVR) | 0.470 | #16 of 17 | Archive leaderboard | report |
| Video Retrieval | FIVR-200K | VRAG (video) | mAP (DSVR) | 0.484 | #16 of 17 | Archive leaderboard | report |
| Video Retrieval | FIVR-200K | VRAG (video) | mAP (ISVR) | 0.399 | #16 of 17 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections