Multi-Task Learning

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

8 leaderboard tables shown for this task, 8 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

59 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 59 until expanded.

Subtasks archive 2025-07-28

2 subtasks in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 1,306 papers with code (3,687 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• RetinaFace: Single-stage Dense Face Localisation in the Wild
  2 May 2019 76 repositories listed Syntology ran 17 of 91 samples · 74 unverified
  Face Analysis Project on MXNet
• Language Models are Few-Shot Learners
  28 May 2020 67 repositories listed Syntology ran 15 of 65 samples · 50 unverified · 4 pointer-only (licence)
  By contrast, humans can generally perform a new language task from only a few examples or from simple instructions - something which current NLP systems still largely struggle to do.
• FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking
  4 Apr 2020 33 repositories listed Syntology ran 8 of 53 samples · 45 unverified
  Formulating MOT as multi-task learning of object detection and re-ID in a single network is appealing since it allows joint optimization of the two tasks and enjoys high computation efficiency.
• Language Models are Unsupervised Multitask Learners
  14 Feb 2019 21 repositories listed
  Natural language processing tasks, such as question answering, machine translation, reading comprehension, and summarization, are typically approached with supervised learning on taskspecific datasets.
• Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics
  19 May 2017 19 repositories listed Syntology ran 2 of 4 samples · 2 unverified · 3 pointer-only (licence)
  Numerous deep learning applications benefit from multi-task learning with multiple regression and classification objectives.
• Measuring Massive Multitask Language Understanding
  7 Sep 2020 18 repositories listed Syntology ran 5 of 26 samples · 21 unverified · 1 pointer-only (licence)
  By comprehensively evaluating the breadth and depth of a model's academic and professional understanding, our test can be used to analyze models across many tasks and to identify important shortcomings.
• Gradient Surgery for Multi-Task Learning
  19 Jan 2020 18 repositories listed Syntology ran 7 of 10 samples · 3 unverified · 4 pointer-only (licence)
  While deep learning and deep reinforcement learning (RL) systems have demonstrated impressive results in domains such as image classification, game playing, and robotic control, data efficiency remains a major challenge.
• COVID-CT-Dataset: A CT Scan Dataset about COVID-19
  30 Mar 2020 17 repositories listed
  Using this dataset, we develop diagnosis methods based on multi-task learning and self-supervised learning, that achieve an F1 of 0.
• Towards Real-Time Multi-Object Tracking
  27 Sep 2019 12 repositories listed Syntology ran 2 of 36 samples · 34 unverified
  In this paper, we propose an MOT system that allows target detection and appearance embedding to be learned in a shared model.
• Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts
  19 Jul 2018 11 repositories listed
  In this work, we propose a novel multi-task learning approach, Multi-gate Mixture-of-Experts (MMoE), which explicitly learns to model task relationships from data.
• You Only Learn One Representation: Unified Network for Multiple Tasks
  10 May 2021 9 repositories listed
  In this paper, we propose a unified network to encode implicit knowledge and explicit knowledge together, just like the human brain can learn knowledge from normal learning as well as subconsciousness learning.
• Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning
  24 Oct 2019 9 repositories listed Syntology ran 0 of 9 samples · 9 unverified
  Therefore, if the aim of these methods is to enable faster acquisition of entirely new behaviors, we must evaluate them on task distributions that are sufficiently broad to enable generalization to new behaviors.
• PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data
  2 May 2020 8 repositories listed
  In comparison with person re-identification (ReID), which has been widely studied in the research community, vehicle ReID has received less attention.
• Joint CTC-Attention based End-to-End Speech Recognition using Multi-task Learning
  21 Sep 2016 8 repositories listed Syntology ran 0 of 10 samples · 10 unverified
  Recently, there has been an increasing interest in end-to-end speech recognition that directly transcribes speech to text without any predefined alignments.
• Progressive Layered Extraction (PLE): A Novel Multi-Task Learning (MTL) Model for Personalized Recommendations
  22 Feb 2020 7 repositories listed
  Moreover, through extensive experiments across SOTA MTL models, we have observed an interesting seesaw phenomenon that performance of one task is often improved by hurting the performance of some other tasks.
• LEAF: A Benchmark for Federated Settings
  3 Dec 2018 7 repositories listed Syntology ran 1 of 3 samples · 2 unverified
  Modern federated networks, such as those comprised of wearable devices, mobile phones, or autonomous vehicles, generate massive amounts of data each day.
• Multi-Task Learning as Multi-Objective Optimization
  10 Oct 2018 7 repositories listed Syntology ran 2 of 19 samples · 17 unverified
  These algorithms are not directly applicable to large-scale learning problems since they scale poorly with the dimensionality of the gradients and the number of tasks.
• Revisiting RCNN: On Awakening the Classification Power of Faster RCNN
  19 Mar 2018 7 repositories listed Syntology ran 3 of 5 samples · 2 unverified
  Recent region-based object detectors are usually built with separate classification and localization branches on top of shared feature extraction networks.
• Two-Stream Convolutional Networks for Action Recognition in Videos
  9 Jun 2014 7 repositories listed Syntology ran 1 of 7 samples · 6 unverified · 2 pointer-only (licence)
  Our architecture is trained and evaluated on the standard video actions benchmarks of UCF-101 and HMDB-51, where it is competitive with the state of the art.
• A Multi-task Learning Model for Chinese-oriented Aspect Polarity Classification and Aspect Term Extraction
  17 Dec 2019 6 repositories listed
  Aspect-based sentiment analysis (ABSA) task is a multi-grained task of natural language processing and consists of two subtasks: aspect term extraction (ATE) and aspect polarity classification (APC).
• Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data
  1 Mar 2019 6 repositories listed
  It is the first time copying words from the source context and fully pre-training a sequence to sequence model are experimented on the GEC task.
• UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training
  12 Oct 2021 5 repositories listed
  We integrate the proposed methods into the HuBERT framework.
• CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation
  2 Sep 2021 5 repositories listed Syntology ran 1 of 11 samples · 10 unverified
  We present CodeT5, a unified pre-trained encoder-decoder Transformer model that better leverages the code semantics conveyed from the developer-assigned identifiers.
• YOLOP: You Only Look Once for Panoptic Driving Perception
  25 Aug 2021 5 repositories listed Syntology ran 1 of 18 samples · 17 unverified
  A panoptic driving perception system is an essential part of autonomous driving.
• Federated Multi-Task Learning under a Mixture of Distributions
  23 Aug 2021 5 repositories listed Syntology ran 3 of 17 samples · 14 unverified · 1 pointer-only (licence)
  The increasing size of data generated by smartphones and IoT devices motivated the development of Federated Learning (FL), a framework for on-device collaborative training of machine learning models.
• UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data
  19 Jan 2021 5 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  In this paper, we propose a unified pre-training approach called UniSpeech to learn speech representations with both unlabeled and labeled data, in which supervised phonetic CTC learning and phonetically-aware…
• fairseq S2T: Fast Speech-to-Text Modeling with fairseq
  11 Oct 2020 5 repositories listed
  We introduce fairseq S2T, a fairseq extension for speech-to-text (S2T) modeling tasks such as end-to-end speech recognition and speech-to-text translation.
• Federated Optimization for Heterogeneous Networks
  16 May 2019 5 repositories listed
  Federated learning involves training and effectively combining machine learning models from distributed partitions of data (i.
• What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment
  8 Apr 2019 5 repositories listed
  Can performance on the task of action quality assessment (AQA) be improved by exploiting a description of the action and its quality?
• Multi-task Learning with Sample Re-weighting for Machine Reading Comprehension
  18 Sep 2018 5 repositories listed
  We propose a multi-task learning framework to learn a joint Machine Reading Comprehension (MRC) model that can be applied to a wide range of MRC tasks in different domains.

Syntology lines on 17 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.