Papers › LSMVOS: Long-Short-Term Similarity Matching for Video Object

LSMVOS: Long-Short-Term Similarity Matching for Video Object

2 Sep 2020arXiv:2009.00771archive 2025-07-28

Zhang Xuerui, Yuan Xia

Objective Semi-supervised video object segmentation refers to segmenting the object in subsequent frames given the object label in the first frame. Existing algorithms are mostly based on the objectives of matching and propagation strategies, which often make use of the previous frame with masking or optical flow. This paper explores a new propagation method, uses short-term matching modules to extract the information of the previous frame and apply it in propagation, and proposes the network of Long-Short-Term similarity matching for video object segmentation (LSMOVS) Method: By conducting pixel-level matching and correlation between long-term matching module and short-term matching module with the first frame and previous frame, global similarity map and local similarity map are obtained, as well as feature pattern of current frame and masking of previous frame. After two refine networks, final results are obtained through segmentation network. Results: According to the experiments on the two data sets DAVIS 2016 and 2017, the method of this paper achieves favorable average of region similarity and contour accuracy without online fine tuning, which achieves 86.5% and 77.4% in terms of single target and multiple targets. Besides, the count of segmented frames per second reached 21. Conclusion: The short-term matching module proposed in this paper is more conducive to extracting the information of the previous frame than only the mask. By combining the long-term matching module with the short-term matching module, the whole network can achieve efficient video object segmentation without online fine tuning

PaperPDFCode

Code

wudao001/LSMVOS mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ObjectOptical Flow EstimationSegmentationSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Object SegmentationVideo Semantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Semi-Supervised Video Object Segmentation DAVIS 2016 LSMVOS F-measure (Decay) 4.9 #48 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 LSMVOS F-measure (Mean) 87.3 #48 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 LSMVOS F-measure (Recall) 96.1 #48 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 LSMVOS J&F 86.5 #48 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 LSMVOS Jaccard (Decay) 5.1 #48 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 LSMVOS Jaccard (Mean) 85.7 #48 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2016 LSMVOS Jaccard (Recall) 97.1 #48 of 78 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) LSMVOS F-measure (Decay) 16.5 #43 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) LSMVOS F-measure (Mean) 71.2 #43 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) LSMVOS F-measure (Recall) 81.4 #43 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) LSMVOS J&F 67.4 #43 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) LSMVOS Jaccard (Decay) 16.9 #43 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) LSMVOS Jaccard (Mean) 63.7 #43 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (test-dev) LSMVOS Jaccard (Recall) 72.7 #43 of 59 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) LSMVOS F-measure (Decay) 15.7 #50 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) LSMVOS F-measure (Mean) 80.8 #50 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) LSMVOS F-measure (Recall) 91.3 #50 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) LSMVOS J&F 77.4 #50 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) LSMVOS Jaccard (Decay) 12.9 #50 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) LSMVOS Jaccard (Mean) 73.9 #50 of 81 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS 2017 (val) LSMVOS Jaccard (Recall) 83.6 #50 of 81 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections