Papers › Challenge-Aware RGBT Tracking

Challenge-Aware RGBT Tracking

26 Jul 2020ECCV 2020 8arXiv:2007.13143archive 2025-07-28

Chenglong Li, Lei Liu, Andong Lu, Qing Ji, Jin Tang

RGB and thermal source data suffer from both shared and specific challenges, and how to explore and exploit them plays a critical role to represent the target appearance in RGBT tracking. In this paper, we propose a novel challenge-aware neural network to handle the modality-shared challenges (e.g., fast motion, scale variation and occlusion) and the modality-specific ones (e.g., illumination variation and thermal crossover) for RGBT tracking. In particular, we design several parameter-shared branches in each layer to model the target appearance under the modality-shared challenges, and several parameterindependent branches under the modality-specific ones. Based on the observation that the modality-specific cues of different modalities usually contains the complementary advantages, we propose a guidance module to transfer discriminative features from one modality to another one, which could enhance the discriminative ability of some weak modality. Moreover, all branches are aggregated together in an adaptive manner and parallel embedded in the backbone network to efficiently form more discriminative target representations. These challenge-aware branches are able to model the target appearance under certain challenges so that the target representations can be learnt by a few parameters even in the situation of insufficient training data. From the experimental results we will show that our method operates at a real-time speed while performing well against the state-of-the-art methods on three benchmark datasets.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Rgb-T Tracking

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Rgb-T Tracking GTOT CAT Precision 88.9 #13 of 15 Archive leaderboard report
Rgb-T Tracking GTOT CAT Success 71.7 #13 of 15 Archive leaderboard report
Rgb-T Tracking LasHeR CAT Precision 45.0 #38 of 39 Archive leaderboard report
Rgb-T Tracking LasHeR CAT Success 31.4 #38 of 39 Archive leaderboard report
Rgb-T Tracking RGBT210 CAT Precision 79.2 #17 of 19 Archive leaderboard report
Rgb-T Tracking RGBT210 CAT Success 53.3 #17 of 19 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections