Home › Datasets › task › Multi-Task Learning

Multi-Task Learning datasets

archive 2025-07-28

59 datasets carry the task tag "Multi-Task Learning" (the task itself: Multi-Task Learning), ordered by the archive's paper count. Page 1 of 2: 48 shown of 59. Facet routes are this site's own (the archive records the tag string, not a page).

The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.

Multi-Task Learning datasets 1–48 of 59

Cityscapes

Cityscapes is a large-scale database which focuses on semantic understanding of urban street scenes.

Images Semantic Segmentation Image Generation 2D Semantic Segmentation Instance Segmentation Scene Parsing Image-to-Image Translation+27 tasks

3,702 papers · 51 benchmarks

CelebA (CelebFaces Attributes Dataset)

CelebFaces Attributes dataset contains 202,599 face images of the size 178×218 from 10,177 celebrities, each annotated with 40 binary labels indicating facial attributes like hair color, gender and age.

Images Image Classification Image Generation Image Super-Resolution Face Alignment Long-tail Learning Image Inpainting+14 tasks

3,477 papers · 17 benchmarks

NYUv2 (NYU-Depth V2)

The NYU-Depth V2 data set is comprised of video sequences from a variety of indoor scenes as recorded by both the RGB and Depth cameras from the Microsoft Kinect.

RGB-D Semantic Segmentation Instance Segmentation 3D Object Detection Depth Estimation Panoptic Segmentation Monocular Depth Estimation+12 tasks

986 papers · 16 benchmarks

UTKFace

The UTKFace dataset is a large-scale face dataset with long age span (range from 0 to 116 years old).

Images Age Estimation Multi-Task Learning Fairness Facial Attribute Classification Age/Bias-conflicting Race/Unbiased+2 tasks

243 papers · 4 benchmarks

ChestX-ray14

ChestX-ray14 is a medical imaging dataset which comprises 112,120 frontal-view X-ray images of 30,805 (collected from the year of 1992 to 2015) unique patients with the text-mined fourteen common disease labels, mined from the text…

Images Medical Multi-Label Classification Multi-Task Learning Medical Image Generation Pneumonia Detection Thoracic Disease Classification

237 papers · 6 benchmarks

Clotho

Clotho is an audio captioning dataset, consisting of 4981 audio samples, and each audio sample has five captions (a total of 24 905 captions).

Texts Audio Language Modelling Multi-Task Learning Audio captioning Data Augmentation Text to Audio Retrieval Audio to Text Retrieval+2 tasks

202 papers · 3 benchmarks

ETHICS

A new benchmark that spans concepts in justice, well-being, duties, virtues, and commonsense morality.

Texts Multi-Task Learning

183 papers · 1 benchmark

Aff-Wild2

Aff-Wild2 is a large-scale in-the-wild database and an extension of the Aff-Wild dataset for affect recognition.

Images Emotion Recognition Facial Expression Recognition (FER)Multi-Task Learning Facial Expression Recognition

142 papers · 2 benchmarks

Hypersim

For many fundamental scene understanding tasks, it is difficult or impossible to obtain per-pixel ground truth labels from real images.

Images Point cloud 3d meshes RGB-D 2D Object Detection Semantic Segmentation Instance Segmentation 3D Object Detection Depth Estimation 3D Reconstruction+11 tasks

108 papers · 4 benchmarks

TartanAir

A dataset for robot navigation task and more.

Multi-Task Learning Visual Odometry

107 papers · 0 benchmarks

KP20k

KP20k is a large-scale scholarly articles dataset with 528K articles for training, 20K articles for validation and 20K articles for testing.

Texts Text Summarization Language Modelling Multi-Task Learning Keyphrase Extraction Phrase Ranking Phrase Tagging

87 papers · 3 benchmarks

QM9

QM9 provides quantum chemical properties (at DFT level) for a relevant, consistent, and comprehensive chemical space of small organic molecules.

Drug Discovery Time Series Graph Regression Molecular Property Prediction Formation Energy Multi-Task Learning+5 tasks

76 papers · 9 benchmarks

Meta-World Benchmark

An open-source simulated benchmark for meta-reinforcement learning and multi-task learning consisting of 50 distinct robotic manipulation tasks.

Meta-Learning Multi-Task Learning Meta Reinforcement Learning

73 papers · 0 benchmarks

CELEX

CELEX database comprises three different searchable lexical databases, Dutch, English and German.

Texts Multi-Task Learning Morphological Analysis Word Embeddings

59 papers · 0 benchmarks

Wireframe

The Wireframe dataset consists of 5,462 images (5,000 for training, 462 for test) of indoor and outdoor man-made scenes.

Images Multi-Task Learning Line Segment Detection

57 papers · 2 benchmarks

KuaiRand

KuaiRand is an unbiased sequential recommendation dataset collected from the recommendation logs of the video-sharing mobile app, Kuaishou (快手).

Recommendation Systems Multi-Task Learning Sequential Recommendation Multi-Armed Bandits

42 papers · 1 benchmark

THCHS-30

THCHS-30 is a free Chinese speech database THCHS-30 that can be used to build a full-fledged Chinese speech recognition system.

Speech Speech Recognition Speech Synthesis Multi-Task Learning

34 papers · 0 benchmarks

MTL-AQA

A new multitask action quality assessment (AQA) dataset, the largest to date, comprising of more than 1600 diving samples; contains detailed annotations for fine-grained action recognition, commentary generation, and estimating the AQA…

Videos Texts Audio Action Recognition Action Recognition In Videos Video Understanding Video Captioning Multi-Task Learning Action Quality Assessment+6 tasks

33 papers · 2 benchmarks

CH-SIMS

CH-SIMS is a Chinese single- and multimodal sentiment analysis dataset which contains 2,281 refined video segments in the wild with both multimodal and independent unimodal annotations.

Texts Sentiment Analysis Multi-Task Learning Multimodal Sentiment Analysis

25 papers · 1 benchmark

WIDER (Web Image Dataset for Event Recognition)

WIDER is a dataset for complex event recognition from static images.

Images Image Captioning Face Detection Multi-Task Learning Blind Face Restoration

22 papers · 1 benchmark

CAL500 (Computer Audition Lab 500)

CAL500 (Computer Audition Lab 500) is a dataset aimed for evaluation of music information retrieval systems.

Audio Tabular Multi-Label Classification Multi-Task Learning Matrix Completion

21 papers · 0 benchmarks

AQA-7

Consists of 1106 action samples from seven actions with quality scores as measured by expert human judges.

Videos Audio Multi-Task Learning Action Quality Assessment Skills Assessment Skills Evaluation

20 papers · 1 benchmark

LEAF Benchmark

A suite of open-source federated datasets, a rigorous evaluation framework, and a set of reference implementations, all geared towards capturing the obstacles and intricacies of practical federated environments.

Federated Learning Multi-Task Learning Traffic Classification

19 papers · 0 benchmarks

JuICe (JuICe Dataset)

JuICe is a corpus of 1.5 million examples with a curated test set of 3.7K instances based on online programming assignments.

Texts Information Retrieval Code Generation Multi-Task Learning

16 papers · 0 benchmarks

SemArt

SemArt is a multi-modal dataset for semantic art understanding.

Images Texts Cross-Modal Retrieval Multi-Task Learning Art Analysis

16 papers · 0 benchmarks

GCDC (Grammarly Corpus of Discourse Coherence)

A corpus of real-world texts.

Multi-Task Learning Coherence Evaluation

13 papers · 2 benchmarks

FSDKaggle2018

FSDKaggle2018 is an audio dataset containing 11,073 audio files annotated with 41 labels of the AudioSet Ontology.

Audio Multi-Task Learning Few-Shot Audio Classification Audio Tagging

12 papers · 1 benchmark

CropAndWeed

The CropAndWeed dataset is focused on the fine-grained identification of 74 relevant crop and weed species with a strong emphasis on data variability.

Images Object Detection Semantic Segmentation Domain Adaptation Instance Segmentation Fine-Grained Image Classification Panoptic Segmentation+5 tasks

10 papers · 0 benchmarks

SkillSpan (Hard and Soft Skill Extraction from English Job Postings)

SkillSpan is a dataset for Skill Extraction (SE).

Texts Multi-Task Learning

10 papers · 0 benchmarks

NCLS (Neural Cross-Lingual Summarization Corpora)

Presents two high-quality large-scale CLS datasets based on existing monolingual summarization datasets.

Abstractive Text Summarization Multi-Task Learning

9 papers · 0 benchmarks

OmniArt

Presents half a million samples and structured meta-data to encourage further research and societal engagement.

Multi-Task Learning Period Estimation

9 papers · 1 benchmark

VMSMO

The Video-based Multimodal Summarization with Multimodal Output (VMSMO) corpus consists of 184,920 document-summary pairs, with 180,000 training pairs, 2,460 validation and test pairs.

Videos Texts Reading Comprehension Multi-Task Learning

8 papers · 0 benchmarks

FSDKaggle2019

FSDKaggle2019 is an audio dataset containing 29,266 audio files annotated with 80 labels of the AudioSet Ontology.

Audio Multi-Task Learning Audio Tagging

5 papers · 0 benchmarks

PGDP5K (Plane Geometry Diagram Parsing Dataset)

PGDP5K is a dataset consisting of 5000 diagram samples composed of 16 shapes, covering 5 positional relations, 22 symbol types and 6 text types, labeled with more fine-grained annotations at primitive level, including primitive classes,…

Images Scene Parsing Visual Reasoning Multi-Task Learning

5 papers · 1 benchmark

WWW Crowd

WWW Crowd provides 10,000 videos with over 8 million frames from 8,257 diverse scenes, therefore offering a comprehensive dataset for the area of crowd understanding.

Images Videos Scene Understanding Multi-Task Learning Crowd Counting

5 papers · 0 benchmarks

CS (Chinese Simile)

This dataset is constructed and based on the online free-access fictions that are tagged with sci-fi, urban novel, love story, youth, etc.

Texts Reading Comprehension Multi-Task Learning

3 papers · 0 benchmarks

Famulus

This is a dataset for segmentation and classification of epistemic activities in diagnostic reasoning texts.

Texts Multi-Task Learning

3 papers · 0 benchmarks

HSD (Honda Scenes Dataset)

An annotated dataset is released to enable dynamic scene classification that includes 80 hours of diverse high quality driving video data clips collected in the San Francisco Bay area.

Images Autonomous Vehicles Multi-Task Learning Scene Recognition

3 papers · 0 benchmarks

HotelRec

Publicly available dataset in the hotel domain (50M versus 0.9M) and additionally, the largest recommendation dataset in a single domain and with textual reviews (50M versus 22M).

Recommendation Systems Multi-Task Learning

3 papers · 0 benchmarks

MMDB (Multimodal Dyadic Behavior)

Multimodal Dyadic Behavior (MMDB) dataset is a unique collection of multimodal (video, audio, and physiological) recordings of the social and communicative behavior of toddlers.

Videos Audio Activity Recognition Face Detection Multi-Task Learning

3 papers · 0 benchmarks

OpenTTGames

OSAI introduces OpenTTGames - an open dataset aimed at evaluation of different computer vision tasks in Table Tennis: ball detection, semantic segmentation of humans, table and scoreboard and fast in-game events spotting.

Videos Object Detection Semantic Segmentation Multi-Task Learning Event Detection

3 papers · 0 benchmarks

RoboPianist

RoboPianist is a benchmarking suite for high-dimensional control, targeted at testing high spatial and temporal precision, coordination, and planning, all with an underactuated system frequently making-and-breaking contacts.

Environment Multi-Task Learning

3 papers · 0 benchmarks

Tasksource

Huggingface Datasets is a great library, but it lacks standardization, and datasets require preprocessing work to be used interchangeably.

Texts Classification Natural Language Inference Multi-Task Learning Multi-task Language Understanding Multiple-choice

3 papers · 0 benchmarks

CQR (Contextual Query Rewrite)

CQR is an extension to the Stanford Dialogue Corpus.

Texts Spoken Language Understanding Multi-Task Learning Spoken Dialogue Systems

2 papers · 0 benchmarks

ExHVV

ExHVV is a novel dataset that offers natural language explanations of connotative roles for three types of entities -- heroes, villains, and victims, encompassing 4,680 entities present in 3K memes.

Images Texts Text Generation Multi-Task Learning Semantic Role Labeling

2 papers · 0 benchmarks

Cifar10Mnist

The Cifar10Mnist dataset is created using CIFAR-10 and MNIST data sources.

Images Multi-Task Learning Adversarial Attack

1 paper · 0 benchmarks

FIW-MM (Families In Wild Multimedia)

A large-scale dataset for recognizing kinship in multimedia which extend FIW with multimedia data (i.e., video, audio, and contextual transcripts).

Multi-Task Learning

1 paper · 0 benchmarks

MCIC-COCO

A large-scale machine comprehension dataset (based on the COCO images and captions).

Image Captioning Reading Comprehension Multi-Task Learning

1 paper · 0 benchmarks

Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.

Multi-Task Learning datasets

Filter 50 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets

Multi-Task Learning datasets 1–48 of 59