{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mambaevt-event-stream-based-visual-object","title":"MambaEVT: Event Stream based Visual Object Tracking using State Space Model","arxiv_id":"2408.10487","date":"2024-08-20","proceeding":null,"authors":["Xiao Wang","Chao Wang","Shiao Wang","Xixi Wang","Zhicheng Zhao","Lin Zhu","Bo Jiang"],"abstract":"Event camera-based visual tracking has drawn more and more attention in recent years due to the unique imaging principle and advantages of low energy consumption, high dynamic range, and dense temporal resolution. Current event-based tracking algorithms are gradually hitting their performance bottlenecks, due to the utilization of vision Transformer and the static template for target object localization. In this paper, we propose a novel Mamba-based visual tracking framework that adopts the state space model with linear complexity as a backbone network. The search regions and target template are fed into the vision Mamba network for simultaneous feature extraction and interaction. The output tokens of search regions will be fed into the tracking head for target localization. More importantly, we consider introducing a dynamic template update strategy into the tracking framework using the Memory Mamba network. By considering the diversity of samples in the target template library and making appropriate adjustments to the template memory module, a more effective dynamic template can be integrated. The effective combination of dynamic and static templates allows our Mamba-based tracking algorithm to achieve a good balance between accuracy and computational cost on multiple large-scale datasets, including EventVOT, VisEvent, and FE240hz. The source code will be released on https://github.com/Event-AHU/MambaEVT","url_abs":"https://arxiv.org/abs/2408.10487v1","url_pdf":"https://arxiv.org/pdf/2408.10487v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mambaevt-event-stream-based-visual-object","repo_url":"https://github.com/event-ahu/mambaevt","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"mamba","task_name":"Mamba"},{"task_slug":"object-localization","task_name":"Object Localization"},{"task_slug":"object-tracking","task_name":"Object Tracking"},{"task_slug":"visual-object-tracking","task_name":"Visual Object Tracking"},{"task_slug":"visual-tracking","task_name":"Visual Tracking"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":null,"method_name":"Library"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"mamba","method_name":"Mamba"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"},{"method_slug":"vision-transformer","method_name":"Vision Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2408.10487","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.10487"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/event-ahu/mambaevt","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":8,"ran_honours":1,"unverified":1},"by_repo_kind":{"official":{"samples":10,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"305742bafecf04f8","entry":"adjust_keep_rate","repo":"event-ahu/mambaevt","repo_kind":"official","path":"lib/utils/ce_utils.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/lib/utils/ce_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"305742bafecf04f8"}},{"code_sha256_prefix":"e0a06ded5d4f6c3c","entry":"box_cxcywh_to_xyxy","repo":"event-ahu/mambaevt","repo_kind":"official","path":"lib/utils/box_ops.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/lib/utils/box_ops.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e0a06ded5d4f6c3c"}},{"code_sha256_prefix":"40c655a7fe309e49","entry":"box_xywh_to_xyxy","repo":"event-ahu/mambaevt","repo_kind":"official","path":"lib/utils/box_ops.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/lib/utils/box_ops.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"40c655a7fe309e49"}},{"code_sha256_prefix":"b48a27604b9574e0","entry":"box_xyxy_to_xywh","repo":"event-ahu/mambaevt","repo_kind":"official","path":"lib/utils/box_ops.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/lib/utils/box_ops.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b48a27604b9574e0"}},{"code_sha256_prefix":"f0de0cc660ea9823","entry":"compute_grids","repo":"event-ahu/mambaevt","repo_kind":"official","path":"lib/utils/heapmap_utils.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/lib/utils/heapmap_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f0de0cc660ea9823"}},{"code_sha256_prefix":"d8da96a9ed23308f","entry":"generate_bbox_mask","repo":"event-ahu/mambaevt","repo_kind":"official","path":"lib/utils/ce_utils.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/lib/utils/ce_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d8da96a9ed23308f"}},{"code_sha256_prefix":"02f602286c531143","entry":"generate_heatmap","repo":"event-ahu/mambaevt","repo_kind":"official","path":"lib/utils/heapmap_utils.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/lib/utils/heapmap_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"02f602286c531143"}},{"code_sha256_prefix":"90e571943800f79c","entry":"generate_mask_cond","repo":"event-ahu/mambaevt","repo_kind":"official","path":"lib/utils/ce_utils.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/lib/utils/ce_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"90e571943800f79c"}},{"code_sha256_prefix":"8ed1a71ee932713a","entry":"get_center3x3","repo":"event-ahu/mambaevt","repo_kind":"official","path":"lib/utils/heapmap_utils.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/lib/utils/heapmap_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8ed1a71ee932713a"}},{"code_sha256_prefix":"c7dd3505bfe76c6e","entry":"prepare_input","repo":"event-ahu/mambaevt","repo_kind":"official","path":"tracking/profile_model.py","file_url":"https://github.com/event-ahu/mambaevt/blob/HEAD/tracking/profile_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c7dd3505bfe76c6e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}