Papers › Learning Position and Target Consistency for Memory-based Video Object Segmentation

Learning Position and Target Consistency for Memory-based Video Object Segmentation

9 Apr 2021CVPR 2021 1arXiv:2104.04329archive 2025-07-28

Li Hu, Peng Zhang, Bang Zhang, Pan Pan, Yinghui Xu, Rong Jin

This paper studies the problem of semi-supervised video object segmentation(VOS). Multiple works have shown that memory-based approaches can be effective for video object segmentation. They are mostly based on pixel-level matching, both spatially and temporally. The main shortcoming of memory-based approaches is that they do not take into account the sequential order among frames and do not exploit object-level knowledge from the target. To address this limitation, we propose to Learn position and target Consistency framework for Memory-based video object segmentation, termed as LCM. It applies the memory mechanism to retrieve pixels globally, and meanwhile learns position consistency for more reliable segmentation. The learned location response promotes a better discrimination between target and distractors. Besides, LCM introduces an object-level relationship from the target to maintain target consistency, making LCM more robust to error drifting. Experiments show that our LCM achieves state-of-the-art performance on both DAVIS and Youtube-VOS benchmark. And we rank the 1st in the DAVIS 2020 challenge semi-supervised VOS task.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ObjectOne-shot visual object segmentationSegmentationSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Object SegmentationVideo Semantic Segmentation

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Semi-Supervised Video Object Segmentation DAVIS (no YouTube-VOS training) LCM D17 val (F) 77.2 #8 of 26 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS (no YouTube-VOS training) LCM D17 val (G) 75.2 #8 of 26 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS (no YouTube-VOS training) LCM D17 val (J) 73.1 #8 of 26 Archive leaderboard report
Semi-Supervised Video Object Segmentation DAVIS (no YouTube-VOS training) LCM FPS 8.47 #8 of 26 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

VOS

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections