Papers › Advanced computer vision for extracting georeferenced vehicle trajectories from drone imagery

Advanced computer vision for extracting georeferenced vehicle trajectories from drone imagery

4 Nov 2024arXiv:2411.02136archive 2025-07-28

Robert Fonod, Haechan Cho, Hwasoo Yeo, Nikolas Geroliminis

This paper presents a framework for extracting georeferenced vehicle trajectories from high-altitude drone footage, addressing key challenges in urban traffic monitoring and limitations of traditional ground-based systems. We employ state-of-the-art computer vision and deep learning to create an end-to-end pipeline that enhances vehicle detection, tracking, and trajectory stabilization. Conducted in the Songdo International Business District, South Korea, the study used a multi-drone experiment over 20 intersections, capturing approximately 12TB of 4K video data over four days. We developed a novel track stabilization method that uses detected vehicle bounding boxes as exclusion masks during image registration, which, combined with advanced georeferencing techniques, accurately transforms vehicle coordinates into real-world geographical data. Additionally, our framework includes robust vehicle dimension estimation and detailed road segmentation for in-depth traffic analysis. The framework produced two high-quality datasets: the Songdo Traffic dataset, comprising nearly 1 million unique vehicle trajectories, and the Songdo Vision dataset, containing over 5,000 human-annotated frames with about 300,000 vehicle instances in four classes. Comparisons between drone-derived data and high-precision sensor data from an instrumented probe vehicle highlight the accuracy and consistency of our framework's extraction in dense urban settings. By publicly releasing these datasets and the pipeline source code, this work sets new benchmarks for data quality, reproducibility, and scalability in traffic research. Results demonstrate the potential of integrating drone technology with advanced computer vision for precise, cost-effective urban traffic monitoring, providing valuable resources for the research community to develop intelligent transportation systems and improve traffic management strategies.

PaperPDFCode

Code

rfonod/geo-trax officialmentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

4kImage RegistrationKeypoint detection and image matchingObject DetectionObject TrackingVideo Stabilizationgeo-localizationvehicle detection

Datasets

Introduced by this paper, per the archive.

Songdo TrafficSongdo Vision

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Object Detection Songdo Vision Geo-trax Precision 0.911 #1 of 1 Archive leaderboard report
Object Detection Songdo Vision Geo-trax Recall 0.935 #1 of 1 Archive leaderboard report
Object Detection Songdo Vision Geo-trax mAP@50 0.951 #1 of 1 Archive leaderboard report
Object Detection Songdo Vision Geo-trax mAP@50-95 0.711 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections