{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ovt-b-a-new-large-scale-benchmark-for-open","title":"OVT-B: A New Large-Scale Benchmark for Open-Vocabulary Multi-Object Tracking","arxiv_id":"2410.17534","date":"2024-10-23","proceeding":null,"authors":["Haiji Liang","Ruize Han"],"abstract":"Open-vocabulary object perception has become an important topic in artificial intelligence, which aims to identify objects with novel classes that have not been seen during training. Under this setting, open-vocabulary object detection (OVD) in a single image has been studied in many literature. However, open-vocabulary object tracking (OVT) from a video has been studied less, and one reason is the shortage of benchmarks. In this work, we have built a new large-scale benchmark for open-vocabulary multi-object tracking namely OVT-B. OVT-B contains 1,048 categories of objects and 1,973 videos with 637,608 bounding box annotations, which is much larger than the sole open-vocabulary tracking dataset, i.e., OVTAO-val dataset (200+ categories, 900+ videos). The proposed OVT-B can be used as a new benchmark to pave the way for OVT research. We also develop a simple yet effective baseline method for OVT. It integrates the motion features for object tracking, which is an important feature for MOT but is ignored in previous OVT methods. Experimental results have verified the usefulness of the proposed benchmark and the effectiveness of our method. We have released the benchmark to the public at https://github.com/Coo1Sea/OVT-B-Dataset.","url_abs":"https://arxiv.org/abs/2410.17534v1","url_pdf":"https://arxiv.org/pdf/2410.17534v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ovt-b-a-new-large-scale-benchmark-for-open","repo_url":"https://github.com/coo1sea/ovt-b-dataset","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"jax","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"multi-object-tracking","task_name":"Multi-Object Tracking"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-tracking","task_name":"Object Tracking"},{"task_slug":"open-vocabulary-object-detection","task_name":"Open Vocabulary Object Detection"},{"task_slug":"open-vocabulary-object-detection","task_name":"Open-vocabulary object detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[{"slug":"ovt-b","name":"OVT-B","full_name":"Open-Vocabulary multi-object Tracking Benchmark"}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2410.17534","atlas_url":"https://app.syntology.ai/?focus=2410.17534","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.17534"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/Coo1Sea/OVT-B-Dataset","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/coo1sea/ovt-b-dataset","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":10},"by_repo_kind":{"official":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"301682fc3342590a","entry":"check_imports","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"diffusers_clean/dynamic_modules_utils.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/diffusers_clean/dynamic_modules_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"301682fc3342590a"}},{"code_sha256_prefix":"ce381f589ee1973b","entry":"compute_teta_on_ovsetup","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"ovtrack/datasets/ovtb_dataset.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/ovtrack/datasets/ovtb_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ce381f589ee1973b"}},{"code_sha256_prefix":"c4627f5ef95612d0","entry":"convert_coco_result_to_bdd","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"ovtrack/datasets/bdd_video_dataset.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/ovtrack/datasets/bdd_video_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c4627f5ef95612d0"}},{"code_sha256_prefix":"a8850d80988810a1","entry":"convert_pred_to_label_format","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"ovtrack/datasets/bdd_video_dataset.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/ovtrack/datasets/bdd_video_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a8850d80988810a1"}},{"code_sha256_prefix":"6d9f63b783b9c061","entry":"get_parameter_device","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"diffusers_clean/modeling_utils.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/diffusers_clean/modeling_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6d9f63b783b9c061"}},{"code_sha256_prefix":"278603330ce5c616","entry":"get_parameter_dtype","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"diffusers_clean/modeling_utils.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/diffusers_clean/modeling_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"278603330ce5c616"}},{"code_sha256_prefix":"00cc853a73f3aeb6","entry":"get_relative_import_files","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"diffusers_clean/dynamic_modules_utils.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/diffusers_clean/dynamic_modules_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"00cc853a73f3aeb6"}},{"code_sha256_prefix":"450aeffe7f80f917","entry":"get_relative_imports","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"diffusers_clean/dynamic_modules_utils.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/diffusers_clean/dynamic_modules_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"450aeffe7f80f917"}},{"code_sha256_prefix":"fa98be725f1850b4","entry":"load_state_dict","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"diffusers_clean/modeling_utils.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/diffusers_clean/modeling_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fa98be725f1850b4"}},{"code_sha256_prefix":"d669627a4785e5e9","entry":"majority_vote","repo":"Coo1Sea/OVT-B-Dataset","repo_kind":"official","path":"ovtrack/datasets/bdd_video_dataset.py","file_url":"https://github.com/Coo1Sea/OVT-B-Dataset/blob/HEAD/ovtrack/datasets/bdd_video_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d669627a4785e5e9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}