Home › Datasets › task › Self-Supervised Learning

Self-Supervised Learning datasets

archive 2025-07-28

47 datasets carry the task tag "Self-Supervised Learning" (the task itself: Self-Supervised Learning), ordered by the archive's paper count. Page 1 of 1: 47 shown of 47. Facet routes are this site's own (the archive records the tag string, not a page).

The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.

Self-Supervised Learning datasets 1–47 of 47

CIFAR-10

description withheld: archive row vandalised before snapshot

Images Image Classification Classification Image Generation Zero-Shot Learning Anomaly Detection Image Retrieval+58 tasks

16,145 papers · 91 benchmarks

CIFAR-100

The CIFAR-100 dataset (Canadian Institute for Advanced Research, 100 classes) is a subset of the Tiny Images dataset and consists of 60000 32x32 color images.

Images Image Classification Classification Image Generation Zero-Shot Learning Anomaly Detection Few-Shot Image Classification+37 tasks

9,045 papers · 51 benchmarks

Tiny ImageNet

Tiny ImageNet contains 100000 images of 200 classes (500 for each class) downsized to 64×64 colored images.

Images Image Classification Image Clustering Conditional Image Generation Self-Supervised Learning Weakly-Supervised Object Localization Personalized Federated Learning+1 tasks

1,232 papers · 7 benchmarks

STL-10 (Self-Taught Learning 10)

The STL-10 is an image dataset derived from ImageNet and popularly used to evaluate algorithms of unsupervised feature learning or self-taught learning.

Images Image Classification Image Generation Anomaly Detection Semi-Supervised Image Classification Image Clustering Out-of-Distribution Detection+12 tasks

1,092 papers · 18 benchmarks

2D-3D-S (2D-3D-Semantic)

The 2D-3D-S dataset provides a variety of mutually registered modalities from 2D, 2.5D and 3D domains, with instance-level semantic and geometric annotations.

Images Semantic Segmentation Depth Estimation Semi-Supervised Semantic Segmentation Self-Supervised Learning Visual Navigation 3D Room Layouts From A Single RGB Panorama+2 tasks

147 papers · 6 benchmarks

NSynth

NSynth is a dataset of one shot instrumental notes, containing 305,979 musical notes with unique pitch, timbre and envelope.

Audio Self-Supervised Learning Few-Shot Audio Classification Audio Generation Instrument Recognition Music Generation Pitch Classification

138 papers · 2 benchmarks

AVA (Atomic Visual Actions)

AVA is a project that provides audiovisual annotations of video for improving our understanding of human activity.

Videos Action Recognition Node Classification Action Detection Speech Enhancement Action Recognition In Videos Video Understanding+7 tasks

113 papers · 7 benchmarks

CATER

Rendered synthetically using a library of standard 3D objects, and tests the ability to recognize compositions of object movements that require long-term reasoning.

Videos Action Recognition Visual Reasoning Self-Supervised Learning Video Object Tracking Atomic action recognition Composite action recognition

51 papers · 3 benchmarks

MotionSense

This dataset includes time-series data generated by accelerometer and gyroscope sensors (attitude, gravity, userAcceleration, and rotationRate).

Time series Activity Recognition Imputation Self-Supervised Learning

35 papers · 0 benchmarks

COCO 10% labeled data

Semi-Supervised Object Detection on COCO 10% labeled data

Images Self-Supervised Learning Semi-Supervised Object Detection Semi-Supervised Instance Segmentation

28 papers · 2 benchmarks

COVID-CT

Contains 349 COVID-19 CT images from 216 patients and 463 non-COVID-19 CTs.

Self-Supervised Learning COVID-19 Diagnosis Computed Tomography (CT)

28 papers · 0 benchmarks

CREMA-D

CREMA-D is an emotional multimodal actor data set of 7,442 original clips from 91 actors.

Audio Facial Expression Recognition (FER)Audio Classification Speech Emotion Recognition Self-Supervised Learning Few-Shot Audio Classification Talking Face Generation+1 tasks

28 papers · 7 benchmarks

MVSEC (Multi Vehicle Stereo Event Camera)

The Multi Vehicle Stereo Event Camera (MVSEC) dataset is a collection of data designed for the development of novel 3D perception algorithms for event based cameras.

Images Stereo LiDAR Optical Flow Estimation Self-Supervised Learning Video Reconstruction Event-based Optical Flow

28 papers · 2 benchmarks

AVA-ActiveSpeaker

Contains temporally labeled face tracks in video, where each face instance is labeled as speaking or not, and whether the speech is audible.

Speech Enhancement Speaker Diarization Self-Supervised Learning Audio-Visual Active Speaker Detection

22 papers · 1 benchmark

Gibson Environment

Gibson is an opensource perceptual and physics simulator to explore active and real-world perception.

Environment Self-Supervised Learning Robot Navigation Hierarchical Reinforcement Learning

22 papers · 0 benchmarks

MosMedData

MosMedData contains anonymised human lung computed tomography (CT) scans with COVID-19 related findings, as well as without such findings.

Medical Medical Image Segmentation Self-Supervised Learning Computed Tomography (CT)

22 papers · 1 benchmark

COMETA

Consists of 20k English biomedical entity mentions from Reddit expert-annotated with links to SNOMED CT, a widely-used medical knowledge graph.

Entity Linking Self-Supervised Learning Metric Learning

21 papers · 0 benchmarks

INRIA Aerial Image Labeling

The INRIA Aerial Image Labeling dataset is comprised of 360 RGB tiles of 5000×5000px with a spatial resolution of 30cm/px on 10 cities across the globe.

Images Semantic Segmentation Self-Supervised Learning Contrastive Learning

21 papers · 1 benchmark

TVC (TV show Captions)

TV show Caption is a large-scale multimodal captioning dataset, containing 261,490 caption descriptions paired with 108,965 short video moments.

Videos Texts Question Answering Video Retrieval Video Captioning Self-Supervised Learning

16 papers · 1 benchmark

ImageNet-100 (TEMI Split)

This split was introduced in TEMI (BMVC 2023) Adaloglou, Nikolas, Felix Michels, Hamza Kalisch, and Markus Kollmann.

Image Classification Image Clustering Self-Supervised Learning Open-World Semi-Supervised Learning

12 papers · 4 benchmarks

Argoverse 2 Sensor

The Argoverse 2 Sensor Dataset is a collection of 1,000 scenarios with 3D object tracking annotations.

3D Self-Supervised Learning Motion Forecasting

11 papers · 0 benchmarks

OrangeSum

Source: BARThez: a Skilled Pretrained French Sequence-to-Sequence Model OrangeSum is a single-document extreme summarization dataset with two tasks: title and abstract.

Texts Text Summarization Self-Supervised Learning Natural Language Understanding OrangeSum

8 papers · 1 benchmark

ACAV100M (Automatically Curated Audio-Visual)

ACAV100M processes 140 million full-length videos (total duration 1,030 years) which are used to produce a dataset of 100 million 10-second clips (31 years) with high audio-visual correspondence.

Videos Self-Supervised Learning

7 papers · 0 benchmarks

YUD+ (Additional Vanishing Point Labels for the York Urban Database)

YUD+ is a dataset containing additional Vanishing Point Labels for the York Urban Database.

Images Self-Supervised Learning Homography Estimation

7 papers · 0 benchmarks

3DSeg-8

The 3DSeg-8 is a collection of several publicly available 3D segmentation datasets from different medical imaging modalities, e.g.

Medical Anomaly Detection Self-Supervised Learning

6 papers · 0 benchmarks

CLUECorpus2020

CLUECorpus2020 is a large-scale corpus that can be used directly for self-supervised learning such as pre-training of a language model, or language generation.

Texts Text Generation Language Modelling Self-Supervised Learning

6 papers · 0 benchmarks

Wild-Time

Wild-Time is a benchmark of 5 datasets that reflect temporal distribution shifts arising in a variety of real-world applications, including patient prognosis and news classification.

Images Texts Continual Learning Domain Generalization Self-Supervised Learning Ensemble Learning

6 papers · 0 benchmarks

NYU-VP

NYU-VP is a new dataset for multi-model fitting, vanishing point (VP) estimation in this case.

Images Self-Supervised Learning Homography Estimation

5 papers · 0 benchmarks

StreetStyle

StreetStyle is a large-scale dataset of photos of people annotated with clothing attributes, and use this dataset to train attribute classifiers via deep learning.

Images Image Generation Self-Supervised Learning Image Forensics

5 papers · 0 benchmarks

Argoverse 2 Lidar

The Argoverse 2 Lidar Dataset is a collection of 20,000 scenarios with lidar sensor data, HD maps, and ego-vehicle pose.

LiDAR Self-Supervised Learning Motion Forecasting

4 papers · 0 benchmarks

BIOSCAN-5M

As part of an ongoing worldwide effort to comprehend and monitor insect biodiversity, we present the BIOSCAN-5M Insect dataset to the machine learning community.

Images Biology Classification Semi-Supervised Image Classification Domain Generalization Transfer Learning Hierarchical Multi-label Classification Multimodal Deep Learning+4 tasks

4 papers · 0 benchmarks

CARLANE Benchmark

Unsupervised Domain Adaptation demonstrates great potential to mitigate domain shifts by transferring models from labeled source domains to unlabeled target domains.

Images Domain Adaptation 2D Semantic Segmentation Transfer Learning Lane Detection Autonomous Driving Self-Supervised Learning+1 tasks

4 papers · 3 benchmarks

DABS (Domain-Agnostic Benchmark for Self-supervised learning)

DABS is a domain-agnostic benchmark for self-supervised learning to encourage research and progress towards domain-agnostic methods.

Images Self-Supervised Learning

4 papers · 1 benchmark

LIMUC (Labeled Images for Ulcerative Colitis)

The LIMUC dataset is the largest publicly available labeled ulcerative colitis dataset that compromises 11276 images from 564 patients and 1043 colonoscopy procedures.

Images Biomedical Medical Image Classification Semi-Supervised Image Classification Medical Image Classification Self-Supervised Learning Medical Diagnosis

4 papers · 1 benchmark

DCASE 2014

DCASE2014 is an audio classification benchmark.

Videos Audio Action Recognition Audio Classification Self-Supervised Learning

3 papers · 0 benchmarks

Argoverse 2 Map Change

The Argoverse 2 Map Change Dataset is a collection of 1,000 scenarios with ring camera imagery, lidar, and HD maps.

Videos LiDAR Self-Supervised Learning Motion Forecasting

2 papers · 0 benchmarks

Extended Agriculture-Vision

Extended Agriculture-Vision dataset comprises two parts: 1.

Classification Semantic Segmentation Self-Supervised Learning Contrastive Learning

2 papers · 0 benchmarks

OADAT (OADAT: Experimental and Synthetic Clinical Optoacoustic Data for Standardized Image Processing)

An experimental and synthetic (simulated) OA raw signals and reconstructed image domain datasets rendered with different experimental parameters and tomographic acquisition geometries.

Images Medical Semantic Segmentation Image-to-Image Translation Image Reconstruction Self-Supervised Learning Unsupervised Pre-training

2 papers · 0 benchmarks

Open Radar Datasets (Open Radar Datasets: Outdoor Moving Object Dataset)

A classification dataset of radar spectrograms in i "ground surveillance" setting recorded with the Open Radar Initiative.

Classification Object Tracking Self-Supervised Learning

2 papers · 0 benchmarks

SSL4EO-S12

SSL4EO-S12 is a large-scale, global, multimodal, and multi-seasonal corpus of satellite imagery from the ESA Sentinel-1 & -2 satellite missions.

Hyperspectral images Self-Supervised Learning

2 papers · 0 benchmarks

Unified SSL Benchmark (USB)

The Unified SSL Benchmark (USB) consists of 15 diverse, challenging, and comprehensive tasks from CV, natural language processing (NLP), and audio processing (Audio) to evaluate self-supervised learning (SSL) methods.

Self-Supervised Learning

2 papers · 0 benchmarks

ApartmenTour

Contains a large number of online videos and subtitles.

Videos Texts Self-Supervised Learning

1 paper · 0 benchmarks

GeoJEPAD (GeoJEPA Dataset)

GeoJEPAD is a multimodal dataset combining OpenStreetMap (OSM) data (attributes and geometries) with high-resolution aerial imagery from diverse urban areas.

Images Texts Graphs Self-Supervised Learning

1 paper · 0 benchmarks

L1BSR (L1BSR dataset)

The Sentinel-2 satellite carries 12 CMOS detectors for the VNIR bands, with adjacent detectors having overlapping fields of view that result in overlapping regions in level-1 B (L1B) images.

Images Stereo Image Super-Resolution Image Restoration Stereo Image Super-Resolution Self-Supervised Learning Image Registration Stereo Disparity Estimation

1 paper · 0 benchmarks

MAX-60K (Masked Autoencoder for X-ray Fluorescence 60K Dataset)

The dataset for masked autoencoder for X-ray fluorescence (XRF) is a following development after the dataset (Chao et al., 2022).

Environment Self-Supervised Learning regression Fill Mask Chemical Process

1 paper · 0 benchmarks

YFCC-CelebA

The scales of the data accessible through internet search engines can reach hundreds of millions, or even billions.

Images Face Recognition Self-Supervised Learning

1 paper · 0 benchmarks

diaforge-utc-r-0725 (DiaFORGE UTC: Unified Tool-Calling Conversations Dataset)

Dataset for our paper Disambiguation-Centric Finetuning Makes Enterprise Tool-Calling LLMs More Realistic and Less Risky which includes 5000 enterprise tools and the corresponding dialogues generated using DiaFORGE UTC data engine.

Texts Dialog Actions Question Answering Text Generation Information Retrieval Intent Detection Large Language Model Slot Filling+17 tasks

1 paper · 0 benchmarks

Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.

Self-Supervised Learning datasets

Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets

Self-Supervised Learning datasets 1–47 of 47