{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mixformer-end-to-end-tracking-with-iterative-1","title":"MixFormer: End-to-End Tracking with Iterative Mixed Attention","arxiv_id":"2203.11082","date":"2022-03-21","proceeding":"CVPR 2022 1","authors":["Yutao Cui","Cheng Jiang","LiMin Wang","Gangshan Wu"],"abstract":"Tracking often uses a multi-stage pipeline of feature extraction, target information integration, and bounding box estimation. To simplify this pipeline and unify the process of feature extraction and target information integration, we present a compact tracking framework, termed as MixFormer, built upon transformers. Our core design is to utilize the flexibility of attention operations, and propose a Mixed Attention Module (MAM) for simultaneous feature extraction and target information integration. This synchronous modeling scheme allows to extract target-specific discriminative features and perform extensive communication between target and search area. Based on MAM, we build our MixFormer tracking framework simply by stacking multiple MAMs with progressive patch embedding and placing a localization head on top. In addition, to handle multiple target templates during online tracking, we devise an asymmetric attention scheme in MAM to reduce computational cost, and propose an effective score prediction module to select high-quality templates. Our MixFormer sets a new state-of-the-art performance on five tracking benchmarks, including LaSOT, TrackingNet, VOT2020, GOT-10k, and UAV123. In particular, our MixFormer-L achieves NP score of 79.9% on LaSOT, 88.9% on TrackingNet and EAO of 0.555 on VOT2020. We also perform in-depth ablation studies to demonstrate the effectiveness of simultaneous feature extraction and information integration. Code and trained models are publicly available at https://github.com/MCG-NJU/MixFormer.","url_abs":"https://arxiv.org/abs/2203.11082v2","url_pdf":"https://arxiv.org/pdf/2203.11082v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mixformer-end-to-end-tracking-with-iterative-1","repo_url":"https://github.com/MCG-NJU/MixFormer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"semi-supervised-video-object-segmentation","task_name":"Semi-Supervised Video Object Segmentation"},{"task_slug":"video-object-tracking","task_name":"Video Object Tracking"},{"task_slug":"visual-object-tracking","task_name":"Visual Object Tracking"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/semi-supervised-video-object-segmentation-on-15","task":"Semi-Supervised Video Object Segmentation","dataset":"VOT2020","model":"MixFormer-L","rank_in_archive_order":14,"of":20,"metrics":{"EAO":"0.555"},"uses_additional_data":false},{"leaderboard":"/sota/video-object-tracking-on-nv-vot211","task":"Video Object Tracking","dataset":"NT-VOT211","model":"Mixformer(ConvMAE)","rank_in_archive_order":6,"of":43,"metrics":{"AUC":"39.23","Precision":"54.20"},"uses_additional_data":false},{"leaderboard":"/sota/visual-object-tracking-on-avist","task":"Visual Object Tracking","dataset":"AVisT","model":"MixFormerL-22k","rank_in_archive_order":3,"of":7,"metrics":{"Success Rate":"56.0"},"uses_additional_data":false},{"leaderboard":"/sota/visual-object-tracking-on-got-10k","task":"Visual Object Tracking","dataset":"GOT-10k","model":"MixFormer-L","rank_in_archive_order":21,"of":42,"metrics":{"Average Overlap":"75.6","Success Rate 0.5":"85.73","Success Rate 0.75":"72.8"},"uses_additional_data":false},{"leaderboard":"/sota/visual-object-tracking-on-got-10k","task":"Visual Object Tracking","dataset":"GOT-10k","model":"MixFormer-1k","rank_in_archive_order":25,"of":42,"metrics":{"Average Overlap":"71.2","Success Rate 0.5":"79.9","Success Rate 0.75":"65.8"},"uses_additional_data":false},{"leaderboard":"/sota/visual-object-tracking-on-got-10k","task":"Visual Object Tracking","dataset":"GOT-10k","model":"MixFormer","rank_in_archive_order":27,"of":42,"metrics":{"Average Overlap":"70.7","Success Rate 0.5":"80.0","Success Rate 0.75":"67.8"},"uses_additional_data":false},{"leaderboard":"/sota/visual-object-tracking-on-lasot","task":"Visual Object Tracking","dataset":"LaSOT","model":"MixFormer-L","rank_in_archive_order":30,"of":46,"metrics":{"AUC":"70.1","Normalized Precision":"79.9","Precision":"76.3"},"uses_additional_data":false},{"leaderboard":"/sota/visual-object-tracking-on-trackingnet","task":"Visual Object Tracking","dataset":"TrackingNet","model":"MixFormer-L","rank_in_archive_order":19,"of":40,"metrics":{"Accuracy":"83.9","Normalized Precision":"88.9","Precision":"83.1"},"uses_additional_data":false},{"leaderboard":"/sota/visual-object-tracking-on-uav123","task":"Visual Object Tracking","dataset":"UAV123","model":"MixFormer","rank_in_archive_order":10,"of":16,"metrics":{"AUC":"0.704","Precision":"0.918"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2203.11082","atlas_url":"https://app.syntology.ai/?focus=2203.11082","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.11082"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/MCG-NJU/MixFormer","reach":null}],"summary":{"ran":1},"by_repo_kind":{"official":{"samples":1,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d59f9f66befc71af","entry":"MixFormer","repo":"MCG-NJU/MixFormer","repo_kind":"official","path":"lib/models/mixformer_cvt/mixformer.py","file_url":"https://github.com/MCG-NJU/MixFormer/blob/HEAD/lib/models/mixformer_cvt/mixformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d59f9f66befc71af"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}