Datasets › AutomotiveUI-Bench-4K

AutomotiveUI-Bench-4K

Introduced by Benjamin Raphael Ernhofer et al. in Leveraging Vision-Language Models for Visual Grounding and Analysis of Automotive UI9 May 2025 archive 2025-07-28

Dataset Overview: 998 images and 4,208 annotations focusing on interaction with in-vehicle infotainment (IVI) systems. Key Features:

  • Serves as a validation benchmark for automotive UI.
  • Scope: Covers 15 automotive brands/OEMs, model years 2018-2025.
  • Image Source: Primarily photographs of IVI displays (due to screenshot limitations in most vehicles), with some direct screenshots (e.g., Android Auto).
  • Annotation Classes:
    • Test Action: Bounding box + imperative command in natural language.
    • Expected Result: Bounding box + expected outcome in natural lanugage + Pass/Fail status.
    • Bounding boxes are in format [[x0,y0,x1,y1]]
  • Languages:
    • IVI UI: German and English.
    • Annotations: English only (German UI text translated or quoted).
  • 15 Brands/OEMs

Benchmarks archive 2025-07-28

No leaderboard in the archive resolves to this dataset.

Papers archive 2025-07-28

No paper in the archive has a leaderboard row on this dataset; the archive counts 1 paper for it but never published that list.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

cc-by-4.0

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • AutomotiveUI-Bench-4K

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections