{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/pointodyssey-a-large-scale-synthetic-dataset","title":"PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking","arxiv_id":"2307.15055","date":"2023-07-27","proceeding":"ICCV 2023 1","authors":["Yang Zheng","Adam W. Harley","Bokui Shen","Gordon Wetzstein","Leonidas J. Guibas"],"abstract":"We introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks. Our data and code are publicly available at: https://pointodyssey.com","url_abs":"https://arxiv.org/abs/2307.15055v1","url_pdf":"https://arxiv.org/pdf/2307.15055v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"pointodyssey-a-large-scale-synthetic-dataset","repo_url":"https://github.com/y-zheng18/point_odyssey","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"pointodyssey-a-large-scale-synthetic-dataset","repo_url":"https://github.com/aharley/pips2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"pointodyssey-a-large-scale-synthetic-dataset","repo_url":"https://github.com/aliciachenw/PIPsUS","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"point-tracking","task_name":"Point Tracking"}],"methods":[],"datasets_introduced":[{"slug":"pointodyssey","name":"PointOdyssey","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/point-tracking-on-pointodyssey","task":"Point Tracking","dataset":"PointOdyssey","model":"PIPs++","rank_in_archive_order":1,"of":2,"metrics":{"MTE":"26.95","Survival":"50.47","δ":"33.64"},"uses_additional_data":false},{"leaderboard":"/sota/point-tracking-on-pointodyssey","task":"Point Tracking","dataset":"PointOdyssey","model":"PIPs+","rank_in_archive_order":2,"of":2,"metrics":{"Survival":"49.88","δ":"32.41"},"uses_additional_data":false},{"leaderboard":"/sota/point-tracking-on-tap-vid","task":"Point Tracking","dataset":"TAP-Vid","model":"PIPs++","rank_in_archive_order":1,"of":1,"metrics":{"MTE":"4.6","Survival":"88.42","δ":"63.45"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2307.15055","atlas_url":"https://app.syntology.ai/?focus=2307.15055","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.15055"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/aharley/pips2","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/aliciachenw/PIPsUS","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/y-zheng18/point_odyssey","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":11,"ran_honours":1,"unverified":1},"by_repo_kind":{"official":{"samples":8,"ran":8,"repositories":1},"listed":{"samples":5,"ran":4,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"2cb7740d09d1d57c","entry":"as_path","repo":"y-zheng18/point_odyssey","repo_kind":"official","path":"utils/file_io.py","file_url":"https://github.com/y-zheng18/point_odyssey/blob/HEAD/utils/file_io.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"2cb7740d09d1d57c"}},{"code_sha256_prefix":"ea43be6c224959b1","entry":"coords_grid","repo":"aliciachenw/PIPsUS","repo_kind":"listed","path":"nets/pipsUS.py","file_url":"https://github.com/aliciachenw/PIPsUS/blob/HEAD/nets/pipsUS.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ea43be6c224959b1"}},{"code_sha256_prefix":"b360fe44d7520e4a","entry":"farthest_point_sampling","repo":"y-zheng18/point_odyssey","repo_kind":"official","path":"utils/gen_tracking.py","file_url":"https://github.com/y-zheng18/point_odyssey/blob/HEAD/utils/gen_tracking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"b360fe44d7520e4a"}},{"code_sha256_prefix":"257df3eb14fc528b","entry":"fetch_optimizer","repo":"aharley/pips2","repo_kind":"listed","path":"finetune_highres.py","file_url":"https://github.com/aharley/pips2/blob/HEAD/finetune_highres.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"257df3eb14fc528b"}},{"code_sha256_prefix":"4f778b5ed0da9d1f","entry":"get_calibration_matrix_K_from_blender","repo":"y-zheng18/point_odyssey","repo_kind":"official","path":"render_animal.py","file_url":"https://github.com/y-zheng18/point_odyssey/blob/HEAD/render_animal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4f778b5ed0da9d1f"}},{"code_sha256_prefix":"0bc392e72f43660f","entry":"get_intrinsics","repo":"y-zheng18/point_odyssey","repo_kind":"official","path":"render_single.py","file_url":"https://github.com/y-zheng18/point_odyssey/blob/HEAD/render_single.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"0bc392e72f43660f"}},{"code_sha256_prefix":"7cc0ed613ecce873","entry":"load","repo":"aharley/pips2","repo_kind":"listed","path":"saverloader.py","file_url":"https://github.com/aharley/pips2/blob/HEAD/saverloader.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7cc0ed613ecce873"}},{"code_sha256_prefix":"21dd9ba5d9e47a8f","entry":"read_json","repo":"y-zheng18/point_odyssey","repo_kind":"official","path":"utils/file_io.py","file_url":"https://github.com/y-zheng18/point_odyssey/blob/HEAD/utils/file_io.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"21dd9ba5d9e47a8f"}},{"code_sha256_prefix":"7617204334d1d459","entry":"read_mp4","repo":"aharley/pips2","repo_kind":"listed","path":"datasets/exportdataset.py","file_url":"https://github.com/aharley/pips2/blob/HEAD/datasets/exportdataset.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7617204334d1d459"}},{"code_sha256_prefix":"ba4494dbb46634a4","entry":"read_obj_file","repo":"y-zheng18/point_odyssey","repo_kind":"official","path":"render_animal.py","file_url":"https://github.com/y-zheng18/point_odyssey/blob/HEAD/render_animal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"ba4494dbb46634a4"}},{"code_sha256_prefix":"cf0f39e1349d5322","entry":"read_obj_file","repo":"y-zheng18/point_odyssey","repo_kind":"official","path":"utils/gen_tracking.py","file_url":"https://github.com/y-zheng18/point_odyssey/blob/HEAD/utils/gen_tracking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"cf0f39e1349d5322"}},{"code_sha256_prefix":"5bdab6524d5a227a","entry":"reprojection","repo":"y-zheng18/point_odyssey","repo_kind":"official","path":"utils/gen_tracking.py","file_url":"https://github.com/y-zheng18/point_odyssey/blob/HEAD/utils/gen_tracking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"5bdab6524d5a227a"}},{"code_sha256_prefix":"1ac8cce613d98769","entry":"bilinear_sampler","repo":"aliciachenw/PIPsUS","repo_kind":"listed","path":"nets/pipsUS.py","file_url":"https://github.com/aliciachenw/PIPsUS/blob/HEAD/nets/pipsUS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ac8cce613d98769"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}