Papers › EarlyBird: Early-Fusion for Multi-View Tracking in the Bird's Eye View

EarlyBird: Early-Fusion for Multi-View Tracking in the Bird's Eye View

20 Oct 2023arXiv:2310.13350archive 2025-07-28

Torben Teepe, Philipp Wolters, Johannes Gilg, Fabian Herzog, Gerhard Rigoll

Multi-view aggregation promises to overcome the occlusion and missed detection challenge in multi-object detection and tracking. Recent approaches in multi-view detection and 3D object detection made a huge performance leap by projecting all views to the ground plane and performing the detection in the Bird's Eye View (BEV). In this paper, we investigate if tracking in the BEV can also bring the next performance breakthrough in Multi-Target Multi-Camera (MTMC) tracking. Most current approaches in multi-view tracking perform the detection and tracking task in each view and use graph-based approaches to perform the association of the pedestrian across each view. This spatial association is already solved by detecting each pedestrian once in the BEV, leaving only the problem of temporal association. For the temporal association, we show how to learn strong Re-Identification (re-ID) features for each detection. The results show that early-fusion in the BEV achieves high accuracy for both detection and tracking. EarlyBird outperforms the state-of-the-art methods and improves the current state-of-the-art on Wildtrack by +4.6 MOTA and +5.6 IDF1.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

tteepe/EarlyBird officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Object DetectionMulti-Object TrackingMultiview DetectionObject Detectionobject-detection

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Multi-Object Tracking MultiviewX EarlyBird IDF1 82.4 #2 of 2 Archive leaderboard report
Multi-Object Tracking MultiviewX EarlyBird MOTA 88.4 #2 of 2 Archive leaderboard report
Multi-Object Tracking Wildtrack EarlyBird IDF1 92.3 #4 of 9 Archive leaderboard report
Multi-Object Tracking Wildtrack EarlyBird MOTA 89.5 #4 of 9 Archive leaderboard report
Multiview Detection MultiviewX EarlyBird MODA 94.2 #4 of 9 Archive leaderboard report
Multiview Detection MultiviewX EarlyBird MODP 90.1 #4 of 9 Archive leaderboard report
Multiview Detection Wildtrack EarlyBird MODA 91.2 #7 of 10 Archive leaderboard report
Multiview Detection Wildtrack EarlyBird MODP 81.8 #7 of 10 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections