Papers › Learning to Update for Object Tracking with Recurrent Meta-learner

Learning to Update for Object Tracking with Recurrent Meta-learner

19 Jun 2018arXiv:1806.07078archive 2025-07-28

Bi Li, Wenxuan Xie, Wen-Jun Zeng, Wenyu Liu

Model update lies at the heart of object tracking. Generally, model update is formulated as an online learning problem where a target model is learned over the online training set. Our key innovation is to \emph{formulate the model update problem in the meta-learning framework and learn the online learning algorithm itself using large numbers of offline videos}, i.e., \emph{learning to update}. The learned updater takes as input the online training set and outputs an updated target model. As a first attempt, we design the learned updater based on recurrent neural networks (RNNs) and demonstrate its application in a template-based tracker and a correlation filter-based tracker. Our learned updater consistently improves the base trackers and runs faster than realtime on GPU while requiring small memory footprint during testing. Experiments on standard benchmarks demonstrate that our learned updater outperforms commonly used update baselines including the efficient exponential moving average (EMA)-based update and the well-designed stochastic gradient descent (SGD)-based update. Equipped with our learned updater, the template-based tracker achieves state-of-the-art performance among realtime trackers on GPU.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Meta-LearningObject TrackingVisual Object TrackingVisual Tracking

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Visual Object Tracking VOT2016 SiamFC-lu (Ours) Expected Average Overlap (EAO) 0.295 #6 of 6 Archive leaderboard report
Visual Object Tracking VOT2017 SiamFC-lu (Ours) Expected Average Overlap (EAO) 0.263 #5 of 6 Archive leaderboard report
Visual Tracking OTB-100 SiamFC-lu (Ours) AUC 0.318 #1 of 1 Archive leaderboard report
Visual Tracking OTB-2013 SiamFC-lu (Ours) AUC 0.657 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections