Papers › Learning Fast and Robust Target Models for Video Object Segmentation

Learning Fast and Robust Target Models for Video Object Segmentation

27 Feb 2020CVPR 2020 6arXiv:2003.00908archive 2025-07-28

Andreas Robinson, Felix Järemo Lawin, Martin Danelljan, Fahad Shahbaz Khan, Michael Felsberg

Video object segmentation (VOS) is a highly challenging problem since the initial mask, defining the target object, is only given at test-time. The main difficulty is to effectively handle appearance changes and similar background objects, while maintaining accurate segmentation. Most previous approaches fine-tune segmentation networks on the first frame, resulting in impractical frame-rates and risk of overfitting. More recent methods integrate generative target appearance models, but either achieve limited robustness or require large amounts of training data. We propose a novel VOS architecture consisting of two network components. The target appearance model consists of a light-weight module, which is learned during the inference stage using fast optimization techniques to predict a coarse but robust target segmentation. The segmentation model is exclusively trained offline, designed to process the coarse scores into high quality segmentation masks. Our method is fast, easily trainable and remains highly effective in cases of limited training data. We perform extensive experiments on the challenging YouTube-VOS and DAVIS datasets. Our network achieves favorable performance, while operating at higher frame-rates compared to state-of-the-art. Code and trained models are available at https://github.com/andr345/frtm-vos.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

andr345/frtm-vos officialmentioned in papermentioned on GitHubpytorchGPL-3.0 report
9p15p/frtm-vos mentioned on GitHubpytorchGPL-3.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

One-shot visual object segmentationSegmentationSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Object SegmentationVideo Semantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Semi-Supervised Video Object Segmentation DAVIS (no YouTube-VOS training) FRTM D16 val (G) 81.7 #20 of 26 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS (no YouTube-VOS training) FRTM D17 val (F) 71.2 #20 of 26 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS (no YouTube-VOS training) FRTM D17 val (G) 68.8 #20 of 26 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS (no YouTube-VOS training) FRTM D17 val (J) 66.4 #20 of 26 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS (no YouTube-VOS training) FRTM FPS 21.9 #20 of 26 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 FRTM (val) J&F 81.7 #58 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 FRTM (val) Speed (FPS) 21.9 #58 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 FRTM F-Measure (Seen) 76.2 #42 of 53 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 FRTM F-Measure (Unseen) 74.1 #42 of 53 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 FRTM Jaccard (Seen) 72.3 #42 of 53 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 FRTM Overall 72.1 #42 of 53 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 FRTM Speed (FPS) 65.9 #42 of 53 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: VOS

VOS

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections