Papers › Efficient RGB-T Tracking via Cross-Modality Distillation

Efficient RGB-T Tracking via Cross-Modality Distillation

1 Jan 2023CVPR 2023 1archive 2025-07-28

Tianlu Zhang, Hongyuan Guo, Qiang Jiao, Qiang Zhang, Jungong Han

Most current RGB-T trackers adopt a two-stream structure to extract unimodal RGB and thermal features and complex fusion strategies to achieve multi-modal feature fusion, which require a huge number of parameters, thus hindering their real-life applications. On the other hand, a compact RGB-T tracker may be computationally efficient but encounter non-negligible performance degradation, due to the weakening of feature representation ability. To remedy this situation, a cross-modality distillation framework is presented to bridge the performance gap between a compact tracker and a powerful tracker. Specifically, a specific-common feature distillation module is proposed to transform the modality-common information as well as the modality-specific information from a deeper two-stream network to a shallower single-stream network. In addition, a multi-path selection distillation module is proposed to instruct a simple fusion module to learn more accurate multi-modal information from a well-designed fusion mechanism by using multiple paths. We validate the effectiveness of our method with extensive experiments on three RGB-T benchmarks, which achieves state-of-the-art performance but consumes much less computational resources.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Rgb-T Tracking

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Rgb-T Tracking GTOT CMD Precision 89.2 #12 of 15 Archive leaderboard report
Rgb-T Tracking GTOT CMD Success 73.4 #12 of 15 Archive leaderboard report
Rgb-T Tracking LasHeR CMD Precision 59.0 #33 of 39 Archive leaderboard report
Rgb-T Tracking LasHeR CMD Success 46.6 #33 of 39 Archive leaderboard report
Rgb-T Tracking RGBT234 CMD Precision 82.4 #35 of 42 Archive leaderboard report
Rgb-T Tracking RGBT234 CMD Success 58.4 #35 of 42 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections