{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/advanced-computer-vision-for-extracting","title":"Advanced computer vision for extracting georeferenced vehicle trajectories from drone imagery","arxiv_id":"2411.02136","date":"2024-11-04","proceeding":null,"authors":["Robert Fonod","Haechan Cho","Hwasoo Yeo","Nikolas Geroliminis"],"abstract":"This paper presents a framework for extracting georeferenced vehicle trajectories from high-altitude drone footage, addressing key challenges in urban traffic monitoring and limitations of traditional ground-based systems. We employ state-of-the-art computer vision and deep learning to create an end-to-end pipeline that enhances vehicle detection, tracking, and trajectory stabilization. Conducted in the Songdo International Business District, South Korea, the study used a multi-drone experiment over 20 intersections, capturing approximately 12TB of 4K video data over four days. We developed a novel track stabilization method that uses detected vehicle bounding boxes as exclusion masks during image registration, which, combined with advanced georeferencing techniques, accurately transforms vehicle coordinates into real-world geographical data. Additionally, our framework includes robust vehicle dimension estimation and detailed road segmentation for in-depth traffic analysis. The framework produced two high-quality datasets: the Songdo Traffic dataset, comprising nearly 1 million unique vehicle trajectories, and the Songdo Vision dataset, containing over 5,000 human-annotated frames with about 300,000 vehicle instances in four classes. Comparisons between drone-derived data and high-precision sensor data from an instrumented probe vehicle highlight the accuracy and consistency of our framework's extraction in dense urban settings. By publicly releasing these datasets and the pipeline source code, this work sets new benchmarks for data quality, reproducibility, and scalability in traffic research. Results demonstrate the potential of integrating drone technology with advanced computer vision for precise, cost-effective urban traffic monitoring, providing valuable resources for the research community to develop intelligent transportation systems and improve traffic management strategies.","url_abs":"https://arxiv.org/abs/2411.02136v1","url_pdf":"https://arxiv.org/pdf/2411.02136v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"advanced-computer-vision-for-extracting","repo_url":"https://github.com/rfonod/geo-trax","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"4k","task_name":"4k"},{"task_slug":"image-registration","task_name":"Image Registration"},{"task_slug":"keypoint-detection-and-image-matching","task_name":"Keypoint detection and image matching"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-tracking","task_name":"Object Tracking"},{"task_slug":"video-stabilization","task_name":"Video Stabilization"},{"task_slug":"geo-localization","task_name":"geo-localization"},{"task_slug":"vehicle-detection","task_name":"vehicle detection"}],"methods":[],"datasets_introduced":[{"slug":"songdo-traffic","name":"Songdo Traffic","full_name":"Songdo Traffic: High Accuracy Georeferenced Vehicle Trajectories from a Large-Scale Study in a Smart City"},{"slug":"songdo-vision","name":"Songdo Vision","full_name":"Songdo Vision: Vehicle Annotations from High-Altitude BeV Drone Imagery in a Smart City"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/object-detection-on-songdo-vision","task":"Object Detection","dataset":"Songdo Vision","model":"Geo-trax","rank_in_archive_order":1,"of":1,"metrics":{"Precision":"0.911","Recall":"0.935","mAP@50":"0.951","mAP@50-95":"0.711"},"uses_additional_data":true}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}