Papers › Middle Fusion and Multi-Stage, Multi-Form Prompts for Robust RGB-T Tracking
Middle Fusion and Multi-Stage, Multi-Form Prompts for Robust RGB-T Tracking
Qiming Wang, Yongqiang Bai, Hongxing Song
RGB-T tracking, a vital downstream task of object tracking, has made remarkable progress in recent years. Yet, it remains hindered by two major challenges: 1) the trade-off between performance and efficiency; 2) the scarcity of training data. To address the latter challenge, some recent methods employ prompts to fine-tune pre-trained RGB tracking models and leverage upstream knowledge in a parameter-efficient manner. However, these methods inadequately explore modality-independent patterns and disregard the dynamic reliability of different modalities in open scenarios. We propose M3PT, a novel RGB-T prompt tracking method that leverages middle fusion and multi-modal and multi-stage visual prompts to overcome these challenges. We pioneer the use of the adjustable middle fusion meta-framework for RGB-T tracking, which could help the tracker balance the performance with efficiency, to meet various demands of application. Furthermore, based on the meta-framework, we utilize multiple flexible prompt strategies to adapt the pre-trained model to comprehensive exploration of uni-modal patterns and improved modeling of fusion-modal features in diverse modality-priority scenarios, harnessing the potential of prompt learning in RGB-T tracking. Evaluating on 6 existing challenging benchmarks, our method surpasses previous state-of-the-art prompt fine-tuning methods while maintaining great competitiveness against excellent full-parameter fine-tuning methods, with only 0.34M fine-tuned parameters.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Rgb-T Tracking | LasHeR | M3PT | Precision | 67.3 | #28 of 39 | Archive leaderboard | report |
| Rgb-T Tracking | LasHeR | M3PT | Success | 54.2 | #28 of 39 | Archive leaderboard | report |
| Rgb-T Tracking | RGBT210 | M3PT | Precision | 83.9 | #14 of 19 | Archive leaderboard | report |
| Rgb-T Tracking | RGBT210 | M3PT | Success | 60.8 | #14 of 19 | Archive leaderboard | report |
| Rgb-T Tracking | RGBT234 | M3PT | Precision | 85.9 | #28 of 42 | Archive leaderboard | report |
| Rgb-T Tracking | RGBT234 | M3PT | Success | 63.4 | #28 of 42 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections