Papers › GSNet: Joint Vehicle Pose and Shape Reconstruction with Geometrical and Scene-aware Supervision

GSNet: Joint Vehicle Pose and Shape Reconstruction with Geometrical and Scene-aware Supervision

26 Jul 2020ECCV 2020 8arXiv:2007.13124archive 2025-07-28

Lei Ke, Shichao Li, Yanan sun, Yu-Wing Tai, Chi-Keung Tang

We present a novel end-to-end framework named as GSNet (Geometric and Scene-aware Network), which jointly estimates 6DoF poses and reconstructs detailed 3D car shapes from single urban street view. GSNet utilizes a unique four-way feature extraction and fusion scheme and directly regresses 6DoF poses and shapes in a single forward pass. Extensive experiments show that our diverse feature extraction and fusion scheme can greatly improve model performance. Based on a divide-and-conquer 3D shape representation strategy, GSNet reconstructs 3D vehicle shape with great detail (1352 vertices and 2700 faces). This dense mesh representation further leads us to consider geometrical consistency and scene context, and inspires a new multi-objective loss function to regularize network training, which in turn improves the accuracy of 6D pose estimation and validates the merit of jointly performing both tasks. We evaluate GSNet on the largest multi-task ApolloCar3D benchmark and achieve state-of-the-art performance both quantitatively and qualitatively. Project page is available at https://lkeab.github.io/gsnet/.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

lkeab/gsnet officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Car Instance Understanding3D Pose Estimation3D Reconstruction3D Shape Modeling3D Shape Reconstruction3D Shape Reconstruction From A Single 2D Image3D Shape Representation6D Pose Estimation6D Pose Estimation using RGBAutonomous DrivingAutonomous VehiclesKeypoint DetectionPose EstimationSelf-Driving CarsVehicle Key-Point and Orientation EstimationVehicle Pose Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Car Instance Understanding ApolloCar3D GSNet A3DP 20.21 #2 of 2 Archive leaderboard report
3D Pose Estimation ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
3D Reconstruction ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
3D Shape Reconstruction ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
3D Shape Reconstruction From A Single 2D Image ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
6D Pose Estimation ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
6D Pose Estimation using RGB ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
Autonomous Driving ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
Autonomous Vehicles ApolloCar3D GSNet A3DP 20.21 #2 of 2 Archive leaderboard report
Keypoint Detection ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
Pose Estimation ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
Vehicle Key-Point and Orientation Estimation ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report
Vehicle Pose Estimation ApolloCar3D GSNet A3DP 20.21 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections