{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/3d-pop-an-automated-annotation-approach-to","title":"3D-POP - An automated annotation approach to facilitate markerless 2D-3D tracking of freely moving birds with marker-based motion capture","arxiv_id":"2303.13174","date":"2023-03-23","proceeding":"CVPR 2023 1","authors":["Hemal Naik","Alex Hoi Hang Chan","Junran Yang","Mathilde Delacoux","Iain D. Couzin","Fumihiro Kano","Máté Nagy"],"abstract":"Recent advances in machine learning and computer vision are revolutionizing the field of animal behavior by enabling researchers to track the poses and locations of freely moving animals without any marker attachment. However, large datasets of annotated images of animals for markerless pose tracking, especially high-resolution images taken from multiple angles with accurate 3D annotations, are still scant. Here, we propose a method that uses a motion capture (mo-cap) system to obtain a large amount of annotated data on animal movement and posture (2D and 3D) in a semi-automatic manner. Our method is novel in that it extracts the 3D positions of morphological keypoints (e.g eyes, beak, tail) in reference to the positions of markers attached to the animals. Using this method, we obtained, and offer here, a new dataset - 3D-POP with approximately 300k annotated frames (4 million instances) in the form of videos having groups of one to ten freely moving birds from 4 different camera views in a 3.6m x 4.2m area. 3D-POP is the first dataset of flocking birds with accurate keypoint annotations in 2D and 3D along with bounding box and individual identities and will facilitate the development of solutions for problems of 2D to 3D markerless pose, trajectory tracking, and identification in birds.","url_abs":"https://arxiv.org/abs/2303.13174v1","url_pdf":"https://arxiv.org/pdf/2303.13174v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"3d-pop-an-automated-annotation-approach-to","repo_url":"https://github.com/alexhang212/dataset-3dpop","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-pose-estimation","task_name":"3D Pose Estimation"},{"task_slug":"animal-pose-estimation","task_name":"Animal Pose Estimation"},{"task_slug":"multiple-object-tracking","task_name":"Multiple Object Tracking"},{"task_slug":"pose-tracking","task_name":"Pose Tracking"}],"methods":[],"datasets_introduced":[{"slug":"3d-pop","name":"3D-POP","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2303.13174","atlas_url":"https://app.syntology.ai/?focus=2303.13174","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.13174"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/alexhang212/dataset-3dpop","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/alexhang212/Dataset-3DPOP","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":13,"unverified":2},"by_repo_kind":{"official":{"samples":15,"ran":13,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0c48eb5f51fc8c81","entry":"Extract3DPoints","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/ComputePlanes.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/ComputePlanes.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0c48eb5f51fc8c81"}},{"code_sha256_prefix":"86e2483d1bf5526b","entry":"FindClosestFrame","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/ManualAnnot.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/ManualAnnot.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"86e2483d1bf5526b"}},{"code_sha256_prefix":"1d8dfecf148cffac","entry":"Get_Dict","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/GapFillHybridExample.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/GapFillHybridExample.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1d8dfecf148cffac"}},{"code_sha256_prefix":"42b706274d0d33ec","entry":"IntroduceGap","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/GapFillHybridExample.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/GapFillHybridExample.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"42b706274d0d33ec"}},{"code_sha256_prefix":"7d061d73a51976a7","entry":"IsPointValid","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"Util/VisualizeUtil.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/Util/VisualizeUtil.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d061d73a51976a7"}},{"code_sha256_prefix":"eaf20efbb95a0c37","entry":"countGap","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/GapFillHybridExample.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/GapFillHybridExample.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eaf20efbb95a0c37"}},{"code_sha256_prefix":"1187036ef80b21e1","entry":"createAngleDatabase","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/ComputePlanes.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/ComputePlanes.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1187036ef80b21e1"}},{"code_sha256_prefix":"47e806fbb4e95458","entry":"getColor","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_Reader/ImageReader.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_Reader/ImageReader.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"47e806fbb4e95458"}},{"code_sha256_prefix":"345c6cfc43587c78","entry":"getFeaturesInCameraSpace","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/automaticAnnotationTool.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/automaticAnnotationTool.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"345c6cfc43587c78"}},{"code_sha256_prefix":"414809e810f2efeb","entry":"getFeaturesInViconSpace","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/automaticAnnotationTool.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/automaticAnnotationTool.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"414809e810f2efeb"}},{"code_sha256_prefix":"5a3bb34299738248","entry":"getFrameData","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/ReprojectCustomFeatures.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/ReprojectCustomFeatures.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5a3bb34299738248"}},{"code_sha256_prefix":"4217b05b7b44bd93","entry":"getRoiPoint","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/ManualAnnot.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/ManualAnnot.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4217b05b7b44bd93"}},{"code_sha256_prefix":"d86f67d9643cb8b4","entry":"videoWriter","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/automaticAnnotationTool.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/automaticAnnotationTool.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d86f67d9643cb8b4"}},{"code_sha256_prefix":"2a96de96e55f2fa0","entry":"PlotLine","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"POP3D_AP/ApplicationExamples/ManualAnnot.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/POP3D_AP/ApplicationExamples/ManualAnnot.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a96de96e55f2fa0"}},{"code_sha256_prefix":"de4617b55f0ad1b1","entry":"getType","repo":"alexhang212/Dataset-3DPOP","repo_kind":"official","path":"Util/VisualizeUtil.py","file_url":"https://github.com/alexhang212/Dataset-3DPOP/blob/HEAD/Util/VisualizeUtil.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de4617b55f0ad1b1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}