Papers › Find First, Track Next: Decoupling Identification and Propagation in Referring Video...

Find First, Track Next: Decoupling Identification and Propagation in Referring Video Object Segmentation

5 Mar 2025arXiv:2503.03492archive 2025-07-28

Suhwan Cho, Seunghoon Lee, Minhyeok Lee, Jungho Lee, Sangyoun Lee

Referring video object segmentation aims to segment and track a target object in a video using a natural language prompt. Existing methods typically fuse visual and textual features in a highly entangled manner, processing multi-modal information together to generate per-frame masks. However, this approach often struggles with ambiguous target identification, particularly in scenes with multiple similar objects, and fails to ensure consistent mask propagation across frames. To address these limitations, we introduce FindTrack, a novel decoupled framework that separates target identification from mask propagation. FindTrack first adaptively selects a key frame by balancing segmentation confidence and vision-text alignment, establishing a robust reference for the target object. This reference is then utilized by a dedicated propagation module to track and segment the object across the entire video. By decoupling these processes, FindTrack effectively reduces ambiguities in target association and enhances segmentation consistency. We demonstrate that FindTrack outperforms existing methods on public benchmarks.

PaperPDFCode

Code

suhwan-cho/FindTrack officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ObjectReferring Video Object SegmentationSegmentationSemantic SegmentationVideo Object SegmentationVideo Semantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Referring Video Object Segmentation MeViS FindTrack F 55.9 #2 of 16 Archive leaderboard report
Referring Video Object Segmentation MeViS FindTrack J 50.5 #2 of 16 Archive leaderboard report
Referring Video Object Segmentation MeViS FindTrack J&F 53.2 #2 of 16 Archive leaderboard report
Referring Video Object Segmentation Ref-DAVIS17 FindTrack F 78.5 #1 of 11 Archive leaderboard report
Referring Video Object Segmentation Ref-DAVIS17 FindTrack J 69.9 #1 of 11 Archive leaderboard report
Referring Video Object Segmentation Ref-DAVIS17 FindTrack J&F 74.2 #1 of 11 Archive leaderboard report
Referring Video Object Segmentation Refer-YouTube-VOS FindTrack F 75.7 #1 of 18 Archive leaderboard report
Referring Video Object Segmentation Refer-YouTube-VOS FindTrack J 71.8 #1 of 18 Archive leaderboard report
Referring Video Object Segmentation Refer-YouTube-VOS FindTrack J&F 73.7 #1 of 18 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections