360+x: A Panoptic Multi-modal Scene Understanding Dataset

The 360+x dataset is a large-scale database that emphasizes a comprehensive multifaceted understanding of daily scenes. It provides diverse viewpoints and data modalities to emulate how humans obtain daily information in real-world scenarios. It includes 232 scene examples, each with an average duration of 6.2 minutes, spanning across 28 scene categories (comprising 15 indoor scenes and 13 outdoor scenes).

Every example in this dataset comprises the following components:

• A third-person 360-degree panoptic video (5760 × 2880, 25 FPS) along with its frontal views version.
• Multiple first-person binocular videos (2432 × 1216, 60 FPS) and their monocular counterparts.
• Four-channel audio accompanied by directional binaural delay information.
• Annotation: Scene class label and Temporal segments label.
• Metadata: including textual scene descriptions, weather conditions, capture time, and GPS information.