Papers › Efficient Video Object Segmentation via Network Modulation

Efficient Video Object Segmentation via Network Modulation

4 Feb 2018CVPR 2018 6arXiv:1802.01218archive 2025-07-28

Linjie Yang, Yanran Wang, Xuehan Xiong, Jianchao Yang, Aggelos K. Katsaggelos

Video object segmentation targets at segmenting a specific object throughout a video sequence, given only an annotated first frame. Recent deep learning based approaches find it effective by fine-tuning a general-purpose segmentation model on the annotated frame using hundreds of iterations of gradient descent. Despite the high accuracy these methods achieve, the fine-tuning process is inefficient and fail to meet the requirements of real world applications. We propose a novel approach that uses a single forward pass to adapt the segmentation model to the appearance of a specific object. Specifically, a second meta neural network named modulator is learned to manipulate the intermediate layers of the segmentation network given limited visual and spatial information of the target object. The experiments show that our approach is 70times faster than fine-tuning approaches while achieving similar accuracy.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

linjieyangsc/video_seg officialmentioned in papertf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ObjectSegmentationSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Instance SegmentationVideo Object SegmentationVideo Semantic SegmentationVisual Object Tracking

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
One-shot visual object segmentation YouTube-VOS 2018 OSMN Jaccard (Seen) 60.0 #2 of 2 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 OSMN F-measure (Decay) 10.6 #68 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 OSMN F-measure (Mean) 72.9 #68 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 OSMN F-measure (Recall) 84.0 #68 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 OSMN J&F 73.45 #68 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 OSMN Jaccard (Decay) 9.0 #68 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 OSMN Jaccard (Mean) 74.0 #68 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 OSMN Jaccard (Recall) 87.6 #68 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) OSMN F-measure (Decay) 17.4 #59 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) OSMN F-measure (Recall) 47.4 #59 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) OSMN J&F 41.3 #59 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) OSMN Jaccard (Decay) 19.0 #59 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) OSMN Jaccard (Mean) 37.7 #59 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) OSMN Jaccard (Recall) 38.9 #59 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) OSMN F-measure (Decay) 24.3 #78 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) OSMN F-measure (Mean) 57.1 #78 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) OSMN F-measure (Recall) 66.1 #78 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) OSMN J&F 54.8 #78 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) OSMN Jaccard (Decay) 21.5 #78 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) OSMN Jaccard (Mean) 52.5 #78 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) OSMN Jaccard (Recall) 60.9 #78 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 OSMN F-Measure (Seen) 60.1 #52 of 53 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 OSMN F-Measure (Unseen) 44.0 #52 of 53 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 OSMN Jaccard (Seen) 60.0 #52 of 53 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 OSMN Jaccard (Unseen) 40.6 #52 of 53 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 OSMN Overall 51.2 #52 of 53 Archive leaderboard report
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 OSMN Speed (FPS) 7.14 #52 of 53 Archive leaderboard report
Video Instance Segmentation YouTube-VIS validation OSMN AP50 28.6 #43 of 44 Archive leaderboard report
Video Instance Segmentation YouTube-VIS validation OSMN AP75 33.1 #43 of 44 Archive leaderboard report
Video Instance Segmentation YouTube-VIS validation OSMN mask AP 29.1 #43 of 44 Archive leaderboard report
Visual Object Tracking YouTube-VOS 2018 OSMN F-Measure (Seen) 60.1 #4 of 9 Archive leaderboard report
Visual Object Tracking YouTube-VOS 2018 OSMN F-Measure (Unseen) 44.0 #4 of 9 Archive leaderboard report
Visual Object Tracking YouTube-VOS 2018 OSMN Jaccard (Seen) 60.0 #4 of 9 Archive leaderboard report
Visual Object Tracking YouTube-VOS 2018 OSMN O (Average of Measures) 51.2 #4 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections