Papers › TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Tracking

TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Tracking

1 Apr 2021arXiv:2104.00194archive 2025-07-28

Peng Chu, Jiang Wang, Quanzeng You, Haibin Ling, Zicheng Liu

Tracking multiple objects in videos relies on modeling the spatial-temporal interactions of the objects. In this paper, we propose a solution named TransMOT, which leverages powerful graph transformers to efficiently model the spatial and temporal interactions among the objects. TransMOT effectively models the interactions of a large number of objects by arranging the trajectories of the tracked objects as a set of sparse weighted graphs, and constructing a spatial graph transformer encoder layer, a temporal transformer encoder layer, and a spatial graph transformer decoder layer based on the graphs. TransMOT is not only more computationally efficient than the traditional Transformer, but it also achieves better tracking accuracy. To further improve the tracking speed and accuracy, we propose a cascade association framework to handle low-score detections and long-term occlusions that require large computational resources to model in TransMOT. The proposed method is evaluated on multiple benchmark datasets including MOT15, MOT16, MOT17, and MOT20, and it achieves state-of-the-art performance on all the datasets.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DecoderMulti-Object TrackingMultiple Object TrackingObjectObject TrackingOnline Multi-Object Tracking

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Multi-Object Tracking 2DMOT15 STGT IDF1 66 #2 of 2 Archive leaderboard report
Multi-Object Tracking 2DMOT15 STGT MOTA 57 #2 of 2 Archive leaderboard report
Multi-Object Tracking MOT16 STGT IDF1 76.8 #4 of 24 Archive leaderboard report
Multi-Object Tracking MOT16 STGT MOTA 76.7 #4 of 24 Archive leaderboard report
Multi-Object Tracking MOT17 STGT IDF1 75.1 #28 of 48 Archive leaderboard report
Multi-Object Tracking MOT17 STGT MOTA 76.7 #28 of 48 Archive leaderboard report
Multi-Object Tracking MOT20 STGT IDF1 75.2 #20 of 27 Archive leaderboard report
Multi-Object Tracking MOT20 STGT MOTA 77.5 #20 of 27 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionBPEDense ConnectionsDropoutGraph TransformerLabel SmoothingLapEigenLaplacian PELayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections