Papers › Attribute-Based Progressive Fusion Network for RGBT Tracking

Attribute-Based Progressive Fusion Network for RGBT Tracking

26 Jan 2022AAAI2022 2022 1archive 2025-07-28

Yun Xiao, Mengmeng Yang, Chenglong Li, Lei Liu, Jin Tang

RGBT tracking usually suffers from various challenging factors of fast motion, scale variation, illumination variation,thermal crossover and occlusion, to name a few. Existing works often study fusion models to solve all challenges simultaneously, which requires fusion models complex enough and training data large enough, and are usually diffcult to be constructed in real-world scenarios. In this work, we disentangle the fusion process via the challenge attributes, and thus propose a novel Attribute-Based Progressive Fusion Network (APFNet) to increase the fusion capacity with a small number of parameters while reducing the dependence on large-scale training data. In particular, we design fve attribute-specifc fusion branches to integrate RGB and thermal features under the challenges of thermal crossover, illumination variation, scale variation, occlusion and fast motion respectively. By disentangling the fusion process, we can use a small number of parameters for each branch to achieve robust fusion of different modalities and train each branch using the small training subset with the corresponding attribute annotation. Then, to adaptive fuse features of all branches, we design an aggregation fusion module based on SKNet. Finally, we also design an enhancement fusion transformer to strengthen the aggregated feature and modality-specifc features. Experimental results on benchmark datasets demonstrate the effectiveness of our APFNet against other state-of-the-art methods.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

AttributeRgb-T Tracking

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Rgb-T Tracking GTOT APFNet Precision 90.5 #10 of 15 Archive leaderboard report
Rgb-T Tracking GTOT APFNet Success 73.7 #10 of 15 Archive leaderboard report
Rgb-T Tracking LasHeR APFNet Precision 50.0 #35 of 39 Archive leaderboard report
Rgb-T Tracking LasHeR APFNet Success 36.2 #35 of 39 Archive leaderboard report
Rgb-T Tracking RGBT210 APFNet Precision 79.9 #16 of 19 Archive leaderboard report
Rgb-T Tracking RGBT210 APFNet Success 54.9 #16 of 19 Archive leaderboard report
Rgb-T Tracking RGBT234 APFNet Precision 82.7 #34 of 42 Archive leaderboard report
Rgb-T Tracking RGBT234 APFNet Success 57.9 #34 of 42 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingBatch NormalizationConvolutionDense ConnectionsDilated ConvolutionGlobal Average PoolingGrouped ConvolutionMax PoolingReLUSKNetSelective KernelSelective Kernel ConvolutionSoftmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections