Papers › SimBEV: A Synthetic Multi-Task Multi-Sensor Driving Data Generation Tool and Dataset

SimBEV: A Synthetic Multi-Task Multi-Sensor Driving Data Generation Tool and Dataset

4 Feb 2025arXiv:2502.01894archive 2025-07-28

Goodarz Mehr, Azim Eskandarian

Bird's-eye view (BEV) perception has garnered significant attention in autonomous driving in recent years, in part because BEV representation facilitates multi-modal sensor fusion. BEV representation enables a variety of perception tasks including BEV segmentation, a concise view of the environment useful for planning a vehicle's trajectory. However, this representation is not fully supported by existing datasets, and creation of new datasets for this purpose can be a time-consuming endeavor. To address this challenge, we introduce SimBEV. SimBEV is a randomized synthetic data generation tool that is extensively configurable and scalable, supports a wide array of sensors, incorporates information from multiple sources to capture accurate BEV ground truth, and enables a variety of perception tasks including BEV segmentation and 3D object detection. SimBEV is used to create the SimBEV dataset, a large collection of annotated perception data from diverse driving scenarios. SimBEV and the SimBEV dataset are open and available to the public.

PaperPDFCode

Code

goodarzmehr/simbev officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Object DetectionAutonomous DrivingBEV SegmentationBird's-Eye View Semantic SegmentationObject DetectionSensor FusionSynthetic Data Generation

Datasets

Introduced by this paper, per the archive.

SimBEV

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Object Detection SimBEV UniTR+LSS SDS 0.622 #1 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR+LSS mAOE 0.207 #1 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR+LSS mAP 0.478 #1 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR+LSS mASE 0.085 #1 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR+LSS mATE 0.113 #1 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR+LSS mAVE 0.53 #1 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR SDS 0.617 #2 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR mAOE 0.224 #2 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR mAP 0.477 #2 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR mASE 0.09 #2 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR mATE 0.113 #2 of 5 Archive leaderboard report
3D Object Detection SimBEV UniTR mAVE 0.55 #2 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion SDS 0.566 #3 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion mAOE 0.122 #3 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion mAP 0.481 #3 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion mASE 0.127 #3 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion mATE 0.146 #3 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion mAVE 1.54 #3 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-L SDS 0.564 #4 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-L mAOE 0.133 #4 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-L mAP 0.481 #4 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-L mASE 0.134 #4 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-L mATE 0.144 #4 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-L mAVE 1.56 #4 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-C SDS 0.251 #5 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-C mAOE 1.044 #5 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-C mAP 0.221 #5 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-C mASE 0.137 #5 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-C mATE 0.744 #5 of 5 Archive leaderboard report
3D Object Detection SimBEV BEVFusion-C mAVE 4.65 #5 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion bicycle 0.036 #1 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion bus 0.8 #1 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion car 0.727 #1 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion mIoU 0.5 #1 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion motorcycle 0.363 #1 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion pedestrian 0.2 #1 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion rider 0.233 #1 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion road 0.884 #1 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion truck 0.745 #1 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR bicycle 0.114 #2 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR bus 0.517 #2 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR car 0.738 #2 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR mIoU 0.497 #2 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR motorcycle 0.365 #2 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR pedestrian 0.275 #2 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR rider 0.362 #2 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR road 0.928 #2 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR truck 0.677 #2 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-L bicycle 0.036 #3 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-L bus 0.815 #3 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-L car 0.706 #3 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-L mIoU 0.483 #3 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-L motorcycle 0.325 #3 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-L pedestrian 0.189 #3 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-L rider 0.184 #3 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-L road 0.877 #3 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-L truck 0.735 #3 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR+LSS bicycle 0.063 #4 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR+LSS bus 0.585 #4 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR+LSS car 0.728 #4 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR+LSS mIoU 0.476 #4 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR+LSS motorcycle 0.359 #4 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR+LSS pedestrian 0.129 #4 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR+LSS rider 0.316 #4 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR+LSS road 0.933 #4 of 5 Archive leaderboard report
BEV Segmentation SimBEV UniTR+LSS truck 0.694 #4 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-C bicycle 0 #5 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-C bus 0.229 #5 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-C car 0.172 #5 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-C mIoU 0.152 #5 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-C motorcycle 0 #5 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-C pedestrian 0 #5 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-C rider 0 #5 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-C road 0.76 #5 of 5 Archive leaderboard report
BEV Segmentation SimBEV BEVFusion-C truck 0.051 #5 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion bicycle 0.036 #1 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion bus 0.808 #1 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion car 0.727 #1 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion mIoU 0.5 #1 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion motorcycle 0.363 #1 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion pedestrian 0.202 #1 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion rider 0.233 #1 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion road 0.884 #1 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion truck 0.745 #1 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR bicycle 0.114 #2 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR bus 0.517 #2 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR car 0.738 #2 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR mIoU 0.497 #2 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR motorcycle 0.365 #2 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR pedestrian 0.275 #2 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR rider 0.362 #2 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR road 0.928 #2 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR truck 0.677 #2 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-L bicycle 0.036 #3 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-L bus 0.815 #3 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-L car 0.706 #3 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-L mIoU 0.483 #3 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-L motorcycle 0.325 #3 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-L pedestrian 0.189 #3 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-L rider 0.184 #3 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-L road 0.877 #3 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-L truck 0.735 #3 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR+LSS bicycle 0.063 #4 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR+LSS bus 0.585 #4 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR+LSS car 0.728 #4 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR+LSS mIoU 0.476 #4 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR+LSS motorcycle 0.359 #4 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR+LSS pedestrian 0.129 #4 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR+LSS rider 0.316 #4 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR+LSS road 0.933 #4 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV UniTR+LSS truck 0.694 #4 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-C bicycle 0 #5 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-C bus 0.229 #5 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-C car 0.172 #5 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-C mIoU 0.152 #5 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-C motorcycle 0 #5 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-C pedestrian 0 #5 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-C rider 0 #5 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-C road 0.76 #5 of 5 Archive leaderboard report
Bird's-Eye View Semantic Segmentation SimBEV BEVFusion-C truck 0.051 #5 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AttentionSoftmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections