{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/multiple-object-tracking-as-id-prediction","title":"Multiple Object Tracking as ID Prediction","arxiv_id":"2403.16848","date":"2024-03-25","proceeding":"CVPR 2025 1","authors":["Ruopeng Gao","Yijun Zhang","LiMin Wang"],"abstract":"In Multiple Object Tracking (MOT), tracking-by-detection methods have stood the test for a long time, which split the process into two parts according to the definition: object detection and association. They leverage robust single-frame detectors and treat object association as a post-processing step through hand-crafted heuristic algorithms and surrogate tasks. However, the nature of heuristic techniques prevents end-to-end exploitation of training data, leading to increasingly cumbersome and challenging manual modification while facing complicated or novel scenarios. In this paper, we regard this object association task as an End-to-End in-context ID prediction problem and propose a streamlined baseline called MOTIP. Specifically, we form the target embeddings into historical trajectory information while considering the corresponding IDs as in-context prompts, then directly predict the ID labels for the objects in the current frame. Thanks to this end-to-end process, MOTIP can learn tracking capabilities straight from training data, freeing itself from burdensome hand-crafted algorithms. Without bells and whistles, our method achieves impressive state-of-the-art performance in complex scenarios like DanceTrack and SportsMOT, and it performs competitively with other transformer-based methods on MOT17. We believe that MOTIP demonstrates remarkable potential and can serve as a starting point for future research. The code is available at https://github.com/MCG-NJU/MOTIP.","url_abs":"https://arxiv.org/abs/2403.16848v1","url_pdf":"https://arxiv.org/pdf/2403.16848v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"multiple-object-tracking-as-id-prediction","repo_url":"https://github.com/MCG-NJU/MOTIP","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"multi-object-tracking","task_name":"Multi-Object Tracking"},{"task_slug":"multiple-object-tracking","task_name":"Multiple Object Tracking"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-tracking","task_name":"Object Tracking"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/multi-object-tracking-on-dancetrack","task":"Multi-Object Tracking","dataset":"DanceTrack","model":"MOTIP (Deformable DETR, with DanceTrack val and CrowdHuman)","rank_in_archive_order":2,"of":37,"metrics":{"AssA":"65.9","DetA":"82.6","HOTA":"73.7","IDF1":"78.4","MOTA":"92.7"},"uses_additional_data":true},{"leaderboard":"/sota/multi-object-tracking-on-dancetrack","task":"Multi-Object Tracking","dataset":"DanceTrack","model":"MOTIP (Deformable DETR, with CrowdHuman)","rank_in_archive_order":4,"of":37,"metrics":{"AssA":"62.8","DetA":"81.3","HOTA":"71.4","IDF1":"76.3","MOTA":"91.6"},"uses_additional_data":true},{"leaderboard":"/sota/multi-object-tracking-on-dancetrack","task":"Multi-Object Tracking","dataset":"DanceTrack","model":"MOTIP (DAB-Deformable DETR)","rank_in_archive_order":5,"of":37,"metrics":{"AssA":"60.8","DetA":"80.8","HOTA":"70.0","IDF1":"75.1","MOTA":"91.0"},"uses_additional_data":false},{"leaderboard":"/sota/multi-object-tracking-on-dancetrack","task":"Multi-Object Tracking","dataset":"DanceTrack","model":"MOTIP (Deformable DETR)","rank_in_archive_order":9,"of":37,"metrics":{"AssA":"57.6","DetA":"79.4","HOTA":"67.5","IDF1":"72.2","MOTA":"90.3"},"uses_additional_data":false},{"leaderboard":"/sota/multi-object-tracking-on-mot17","task":"Multi-Object Tracking","dataset":"MOT17","model":"MOTIP (Deformable-DETR)","rank_in_archive_order":25,"of":48,"metrics":{"HOTA":"59.2","e2e-MOT":"Yes"},"uses_additional_data":false},{"leaderboard":"/sota/multiple-object-tracking-on-sportsmot","task":"Multiple Object Tracking","dataset":"SportsMOT","model":"MOTIP (Deformable DETR, with SportsMOT val)","rank_in_archive_order":6,"of":19,"metrics":{"AssA":"65.4","DetA":"86.5","HOTA":"75.2","IDF1":"78.2","MOTA":"96.1"},"uses_additional_data":true},{"leaderboard":"/sota/multiple-object-tracking-on-sportsmot","task":"Multiple Object Tracking","dataset":"SportsMOT","model":"MOTIP (Deformable DETR)","rank_in_archive_order":11,"of":19,"metrics":{"AssA":"62.0","DetA":"83.4","HOTA":"71.9","IDF1":"75.0","MOTA":"92.9"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2403.16848","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.16848"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MCG-NJU/MOTIP","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":10},"by_repo_kind":{"official":{"samples":10,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8e8107f647130237","entry":"colormap","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"demo/colormap.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/demo/colormap.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8e8107f647130237"}},{"code_sha256_prefix":"24f206ad2d176f97","entry":"get_color","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"demo/colormap.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/demo/colormap.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"24f206ad2d176f97"}},{"code_sha256_prefix":"3c3d064264577f5b","entry":"get_eval_metrics_dict","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"submit_and_evaluate.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/submit_and_evaluate.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3c3d064264577f5b"}},{"code_sha256_prefix":"1ea73e7b284d1fd3","entry":"inverse_sigmoid","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"models/misc.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/models/misc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1ea73e7b284d1fd3"}},{"code_sha256_prefix":"bdafc7d097832321","entry":"is_unique","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"configs/util.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/configs/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bdafc7d097832321"}},{"code_sha256_prefix":"6337f160be146b5f","entry":"label_to_one_hot","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"models/misc.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/models/misc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6337f160be146b5f"}},{"code_sha256_prefix":"9d15ad1dcaf2c8ef","entry":"pos_to_pos_embed","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"models/misc.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/models/misc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9d15ad1dcaf2c8ef"}},{"code_sha256_prefix":"a542c79696b8b5ae","entry":"sigmoid_focal_loss","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"models/motip/id_criterion.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/models/motip/id_criterion.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a542c79696b8b5ae"}},{"code_sha256_prefix":"2fdf2b473542679f","entry":"update_config","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"configs/util.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/configs/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2fdf2b473542679f"}},{"code_sha256_prefix":"6649f1498013ce4d","entry":"update_config_with_kv","repo":"MCG-NJU/MOTIP","repo_kind":"official","path":"configs/util.py","file_url":"https://github.com/MCG-NJU/MOTIP/blob/HEAD/configs/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6649f1498013ce4d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}