Papers › CoTracker: It is Better to Track Together
CoTracker: It is Better to Track Together
Nikita Karaev, Ignacio Rocco, Benjamin Graham, Natalia Neverova, Andrea Vedaldi, Christian Rupprecht
We introduce CoTracker, a transformer-based model that tracks a large number of 2D points in long video sequences. Differently from most existing approaches that track points independently, CoTracker tracks them jointly, accounting for their dependencies. We show that joint tracking significantly improves tracking accuracy and robustness, and allows CoTracker to track occluded points and points outside of the camera view. We also introduce several innovations for this class of trackers, including using token proxies that significantly improve memory efficiency and allow CoTracker to track 70k points jointly and simultaneously at inference on a single GPU. CoTracker is an online algorithm that operates causally on short windows. However, it is trained utilizing unrolled windows as a recurrent network, maintaining tracks for long periods of time even when points are occluded or leave the field of view. Quantitatively, CoTracker substantially outperforms prior trackers on standard point-tracking benchmarks.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
1 archive task tag without a task page not shown.
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Point Tracking | TAP-Vid-DAVIS | CoTracker | Average Jaccard | 65.9 | #3 of 3 | Archive leaderboard | report |
| Point Tracking | TAP-Vid-DAVIS | CoTracker | Average PCK | 79.4 | #3 of 3 | Archive leaderboard | report |
| Point Tracking | TAP-Vid-DAVIS | CoTracker | Occlusion Accuracy | 89.9 | #3 of 3 | Archive leaderboard | report |
| Point Tracking | TAP-Vid-DAVIS-First | CoTracker | Average Jaccard | 62.2 | #2 of 2 | Archive leaderboard | report |
| Point Tracking | TAP-Vid-DAVIS-First | CoTracker | Average PCK | 75.7 | #2 of 2 | Archive leaderboard | report |
| Point Tracking | TAP-Vid-DAVIS-First | CoTracker | Occlusion Accuracy | 89.3 | #2 of 2 | Archive leaderboard | report |
| Point Tracking | TAP-Vid-Kinetics-First | CoTracker | Average Jaccard | 48.8 | #2 of 2 | Archive leaderboard | report |
| Point Tracking | TAP-Vid-Kinetics-First | CoTracker | Average PCK | 64.5 | #2 of 2 | Archive leaderboard | report |
| Point Tracking | TAP-Vid-Kinetics-First | CoTracker | Occlusion Accuracy | 85.8 | #2 of 2 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections