Papers › Improving Unsupervised Video Object Segmentation via Fake Flow Generation

Improving Unsupervised Video Object Segmentation via Fake Flow Generation

16 Jul 2024arXiv:2407.11714archive 2025-07-28

Suhwan Cho, Minhyeok Lee, Jungho Lee, Donghyeong Kim, Seunghoon Lee, Sungmin Woo, Sangyoun Lee

Unsupervised video object segmentation (VOS), also known as video salient object detection, aims to detect the most prominent object in a video at the pixel level. Recently, two-stream approaches that leverage both RGB images and optical flow maps have gained significant attention. However, the limited amount of training data remains a substantial challenge. In this study, we propose a novel data generation method that simulates fake optical flows from single images, thereby creating large-scale training data for stable network learning. Inspired by the observation that optical flow maps are highly dependent on depth maps, we generate fake optical flows by refining and augmenting the estimated depth maps of each image. By incorporating our simulated image-flow pairs, we achieve new state-of-the-art performance on all public benchmark datasets without relying on complex modules. We believe that our data generation method represents a potential breakthrough for future VOS research.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ObjectObject DetectionOptical Flow EstimationSalient Object DetectionSemantic SegmentationUnsupervised Video Object SegmentationVideo Object SegmentationVideo Salient Object DetectionVideo Semantic Segmentationobject-detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Unsupervised Video Object Segmentation DAVIS 2016 val FakeFlow F 89.0 #3 of 25 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2016 val FakeFlow G 88.5 #3 of 25 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2016 val FakeFlow J 88.0 #3 of 25 Archive leaderboard report
Unsupervised Video Object Segmentation FBMS test FakeFlow J 84.7 #1 of 15 Archive leaderboard report
Unsupervised Video Object Segmentation YouTube-Objects FakeFlow J 75.1 #1 of 16 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

VOS

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections