Papers › Temporal Adaptive RGBT Tracking with Modality Prompt

Temporal Adaptive RGBT Tracking with Modality Prompt

2 Jan 2024arXiv:2401.01244archive 2025-07-28

Hongyu Wang, Xiaotao Liu, YiFan Li, Meng Sun, Dian Yuan, Jing Liu

RGBT tracking has been widely used in various fields such as robotics, surveillance processing, and autonomous driving. Existing RGBT trackers fully explore the spatial information between the template and the search region and locate the target based on the appearance matching results. However, these RGBT trackers have very limited exploitation of temporal information, either ignoring temporal information or exploiting it through online sampling and training. The former struggles to cope with the object state changes, while the latter neglects the correlation between spatial and temporal information. To alleviate these limitations, we propose a novel Temporal Adaptive RGBT Tracking framework, named as TATrack. TATrack has a spatio-temporal two-stream structure and captures temporal information by an online updated template, where the two-stream structure refers to the multi-modal feature extraction and cross-modal interaction for the initial template and the online update template respectively. TATrack contributes to comprehensively exploit spatio-temporal information and multi-modal information for target localization. In addition, we design a spatio-temporal interaction (STI) mechanism that bridges two branches and enables cross-modal interaction to span longer time scales. Extensive experiments on three popular RGBT tracking benchmarks show that our method achieves state-of-the-art performance, while running at real-time speed.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Autonomous DrivingRgb-T Tracking

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Rgb-T Tracking LasHeR TATrack Precision 70.2 #25 of 39 Archive leaderboard report
Rgb-T Tracking LasHeR TATrack Success 56.1 #25 of 39 Archive leaderboard report
Rgb-T Tracking RGBT210 TATrack Precision 85.3 #13 of 19 Archive leaderboard report
Rgb-T Tracking RGBT210 TATrack Success 61.8 #13 of 19 Archive leaderboard report
Rgb-T Tracking RGBT234 TATrack Precision 87.2 #24 of 42 Archive leaderboard report
Rgb-T Tracking RGBT234 TATrack Success 64.4 #24 of 42 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections