Papers › Bridging the Gap Between End-to-end and Non-End-to-end Multi-Object Tracking

Bridging the Gap Between End-to-end and Non-End-to-end Multi-Object Tracking

22 May 2023arXiv:2305.12724archive 2025-07-28

Feng Yan, Weixin Luo, Yujie Zhong, Yiyang Gan, Lin Ma

Existing end-to-end Multi-Object Tracking (e2e-MOT) methods have not surpassed non-end-to-end tracking-by-detection methods. One potential reason is its label assignment strategy during training that consistently binds the tracked objects with tracking queries and then assigns the few newborns to detection queries. With one-to-one bipartite matching, such an assignment will yield unbalanced training, i.e., scarce positive samples for detection queries, especially for an enclosed scene, as the majority of the newborns come on stage at the beginning of videos. Thus, e2e-MOT will be easier to yield a tracking terminal without renewal or re-initialization, compared to other tracking-by-detection methods. To alleviate this problem, we present Co-MOT, a simple and effective method to facilitate e2e-MOT by a novel coopetition label assignment with a shadow concept. Specifically, we add tracked objects to the matching targets for detection queries when performing the label assignment for training the intermediate decoders. For query initialization, we expand each query by a set of shadow counterparts with limited disturbance to itself. With extensive ablations, Co-MOT achieves superior performance without extra costs, e.g., 69.4% HOTA on DanceTrack and 52.8% TETA on BDD100K. Impressively, Co-MOT only requires 38% FLOPs of MOTRv2 to attain a similar performance, resulting in the 1.4× faster inference speed.

PaperPDFCode

In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

BingfengYan/CO-MOT officialmentioned on GitHubpytorchNOASSERTION report
bingfengyan/visam mentioned on GitHubpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Multi-Object TrackingObject TrackingVideo Object Tracking

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Multi-Object Tracking BDD100K CO-MOT AssocA 56.2 #1 of 1 Archive leaderboard report
Multi-Object Tracking BDD100K CO-MOT ClsA 63.6 #1 of 1 Archive leaderboard report
Multi-Object Tracking BDD100K CO-MOT LocA 38.7 #1 of 1 Archive leaderboard report
Multi-Object Tracking BDD100K CO-MOT TETA 52.8 #1 of 1 Archive leaderboard report
Multi-Object Tracking DanceTrack CO-MOT AssA 58.9 #6 of 37 Archive leaderboard report
Multi-Object Tracking DanceTrack CO-MOT DetA 82.1 #6 of 37 Archive leaderboard report
Multi-Object Tracking DanceTrack CO-MOT HOTA 69.4 #6 of 37 Archive leaderboard report
Multi-Object Tracking DanceTrack CO-MOT IDF1 71.9 #6 of 37 Archive leaderboard report
Multi-Object Tracking DanceTrack CO-MOT MOTA 91.2 #6 of 37 Archive leaderboard report
Multi-Object Tracking MOT17 CO-MOT AssA 60.6 #24 of 48 Archive leaderboard report
Multi-Object Tracking MOT17 CO-MOT DetA 59.5 #24 of 48 Archive leaderboard report
Multi-Object Tracking MOT17 CO-MOT HOTA 60.1 #24 of 48 Archive leaderboard report
Multi-Object Tracking MOT17 CO-MOT IDF1 72.7 #24 of 48 Archive leaderboard report
Multi-Object Tracking MOT17 CO-MOT MOTA 72.6 #24 of 48 Archive leaderboard report
Multi-Object Tracking MOT17 CO-MOT e2e-MOT Yes #24 of 48 Archive leaderboard report
Video Object Tracking SoccerNet-v2 CO-MOT HOTA 69.54 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections