Papers › MixMatch: A Holistic Approach to Semi-Supervised Learning

MixMatch: A Holistic Approach to Semi-Supervised Learning

6 May 2019NeurIPS 2019 12arXiv:1905.02249archive 2025-07-28

David Berthelot, Nicholas Carlini, Ian Goodfellow, Nicolas Papernot, Avital Oliver, Colin Raffel

Semi-supervised learning has proven to be a powerful paradigm for leveraging unlabeled data to mitigate the reliance on large labeled datasets. In this work, we unify the current dominant approaches for semi-supervised learning to produce a new algorithm, MixMatch, that works by guessing low-entropy labels for data-augmented unlabeled examples and mixing labeled and unlabeled data using MixUp. We show that MixMatch obtains state-of-the-art results by a large margin across many datasets and labeled data amounts. For example, on CIFAR-10 with 250 labels, we reduce error rate by a factor of 4 (from 38% to 11%) and by a factor of 2 on STL-10. We also demonstrate how MixMatch can help achieve a dramatically better accuracy-privacy trade-off for differential privacy. Finally, we perform an ablation study to tease apart which components of MixMatch are most important for its success.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1905.02249")

Code

Syntology Ran 39 of 63 code samples harvested from 17 repositories linked to this paper; 24 have no recorded run. Of those that ran: 8 ran · honoured contract; 11 ran · our draft was wrong; 7 ran · fixture could not drive it; 13 ran with no contract checked.

By repository: community (archive-listed): 63 samples from 17 repositories, 39 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

30 repositories listed; official and paper-mentioned ones first.

google-research/mixmatch officialmentioned in papermentioned on GitHubtfApache-2.0 report
DamianValle/ScarceClassifier mentioned on GitHubpytorch report
DonghwanKIM0101/CS492I_CV mentioned on GitHubpytorch report
FelixAbrahamsson/mixmatch-pytorch mentioned on GitHubpytorch report
Jeffkang-94/Mixmatch-pytorch-SSL mentioned on GitHubpytorch report
Jeffkang-94/pytorch-MixMatch mentioned on GitHubpytorch report
TianheWu/LGPNet mentioned on GitHubpytorch report
YU1ut/MixMatch-pytorch mentioned on GitHubpytorch report
atinghosh/mixmatch_pytorch mentioned on GitHubpytorch report
dLutscher/MixMatch-TransferLearning mentioned on GitHubpytorch report
dhx000/DGM_project mentioned on GitHubtf report
fbuchert/mixmatch-pytorch mentioned on GitHubpytorch report
filaPro/visda2019 mentioned on GitHubtfNOASSERTION report
gan3sh500/mixmatch-pytorch mentioned on GitHubpytorch report
google-research/crest mentioned on GitHubtf report
kevinghst/mixmatch mentioned on GitHubpytorchMIT report
ktran1/Manifold-attack mentioned on GitHubpytorch report
ms903-github/MixMatch-imdb mentioned on GitHubpytorchMIT report
narendoraiswamy/MixMatch-pytorch-demo mentioned on GitHubpytorchMIT report
noachr/MixMatch-fastai mentioned on GitHubpytorchMIT report
ntozer/mixmatch-tensorflow2.0 mentioned on GitHubtf report
rit-git/Snippext_public mentioned on GitHubpytorch report
smkim7-kr/albu-MixMatch-pytorch mentioned on GitHubpytorch report
tinluu/Self-supervised-CV mentioned on GitHubpytorch report
uizard-technologies/realmix mentioned on GitHubtfApache-2.0 report
viig99/mixmatch-freesound mentioned on GitHubpytorchMIT report
yuxi120407/mixmatch_tensorflow mentioned on GitHubtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

63 samples harvested; 39 ran; 8 honoured the contract we drafted; 24 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

8ran · honoured contract
11ran · our draft was wrong
7ran · fixture could not drive it
13ran
24unverified

Licence: 32 of the 63 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 17 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

Augment DamianValle/ScarceClassifier/src/mixmatch.py community (archive-listed) ran · metamorphic tier: invariant fingerprinted no licence file found · pointer only · f64393cdb0ae8878 · report
BasicBlock atinghosh/mixmatch_pytorch/network_mod.py community (archive-listed) ran fingerprinted no licence file found · pointer only · e4dc4ca4b40de499 · report
MixMatch perrying/realistic-ssl-evaluation-pytorch/lib/algs/mixmatch.py community (archive-listed) ran MIT (permissive) · 1733a4add804ce42 · report
MixMatchLoss Jeffkang-94/Mixmatch-pytorch-SSL/SSL_loss/mixmatch.py community (archive-listed) ran no licence file found · pointer only · 4de37e26980b9f34 · report
NetworkBlock atinghosh/mixmatch_pytorch/network_mod.py community (archive-listed) ran fingerprinted no licence file found · pointer only · 2950d5425e9dd18b · report
RandomCrop DamianValle/ScarceClassifier/src/mixmatch.py community (archive-listed) ran · metamorphic tier: invariant fingerprinted no licence file found · pointer only · 3f2a5048d7bc9b95 · report
Residual3x3Unit yuxi120407/mixmatch_tensorflow/model.py community (archive-listed) ran no licence file found · pointer only · a50bcc606f57701c · report
ResidualBlock yuxi120407/mixmatch_tensorflow/model.py community (archive-listed) ran no licence file found · pointer only · 251561e345918b21 · report
SemiLoss dLutscher/MixMatch-TransferLearning/utils/utils.py community (archive-listed) ran no licence file found · pointer only · 48a12c06cbdd6b70 · report
WideResNet YU1ut/MixMatch-pytorch/models/wideresnet.py community (archive-listed) ran MIT (permissive) · c3d0f2f3671b4bbc · report
Wide_ResNet atinghosh/mixmatch_pytorch/network_mod.py community (archive-listed) ran no licence file found · pointer only · 8608707dd0f937bd · report
augment ntozer/mixmatch-tensorflow2.0/mixmatch.py community (archive-listed) ran · fixture could not drive it MIT (permissive) · 647302bd0cbc0cd4 · report
augment dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) ran no licence file found · pointer only · 39827536f2c0ed9a · report
classifier_criterion rit-git/Snippext_public/snippext/mixmatchnl.py community (archive-listed) ran · our draft was wrong fingerprinted BSD-3-Clause (permissive) · 3cac74cd5cc4e2f1 · report
get_weak_augmentation fbuchert/mixmatch-pytorch/augmentation/augmentations.py community (archive-listed) ran · our draft was wrong MIT (permissive) · fbc0e34ee7b8cdb5 · report
guess_labels ntozer/mixmatch-tensorflow2.0/mixmatch.py community (archive-listed) ran · our draft was wrong MIT (permissive) · e364b83801e8d8c9 · report
guess_targets FelixAbrahamsson/mixmatch-pytorch/mixmatch_pytorch/mixmatch_batch.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 568ec1709ff7ca07 · report
interleave smkim7-kr/albu-MixMatch-pytorch/src/utils.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 87035ef75e16edc6 · report
interleave ntozer/mixmatch-tensorflow2.0/mixmatch.py community (archive-listed) ran · our draft was wrong MIT (permissive) · dc463911b8db674e · report
interleave_offsets smkim7-kr/albu-MixMatch-pytorch/src/utils.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · 73e81fa7395d8998 · report
linear_rampup dLutscher/MixMatch-TransferLearning/utils/utils.py community (archive-listed) ran · honoured contract fingerprinted no licence file found · pointer only · 0aaac678344cd89f · report
mixmatch ntozer/mixmatch-tensorflow2.0/mixmatch.py community (archive-listed) ran · fixture could not drive it MIT (permissive) · 91c88dac1ac09bee · report
mixmatch rit-git/Snippext_public/snippext/mixmatchnl.py community (archive-listed) ran · honoured contract BSD-3-Clause (permissive) · 9f0765feb50790dd · report
mixmatch dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) ran · fixture could not drive it no licence file found · pointer only · 4350f70a89ff949b · report
mixmatch_batch FelixAbrahamsson/mixmatch-pytorch/mixmatch_pytorch/mixmatch_batch.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 3164897bcf3781a2 · report
mixup smkim7-kr/albu-MixMatch-pytorch/src/utils.py community (archive-listed) ran · our draft was wrong MIT (permissive) · a083b3ef65c4a3c1 · report
mixup ntozer/mixmatch-tensorflow2.0/mixmatch.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · de552909167b4340 · report
mixup dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) ran · fixture could not drive it no licence file found · pointer only · 65eae886ef202b56 · report
mixup_mod gan3sh500/mixmatch-pytorch/mixmatch_utils.py community (archive-listed) ran · fixture could not drive it no licence file found · pointer only · 77308af8bcbb2b2b · report
mixup_samples FelixAbrahamsson/mixmatch-pytorch/mixmatch_pytorch/mixmatch_batch.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 9d112ebaba96ddb1 · report
plot_overlap kevinghst/mixmatch/utils/logger.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 50afa2863ffd9fde · report
sharpen ntozer/mixmatch-tensorflow2.0/mixmatch.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · 2777c70138515c4d · report
sharpen FelixAbrahamsson/mixmatch-pytorch/mixmatch_pytorch/mixmatch_batch.py community (archive-listed) ran · honoured contract fingerprinted no licence file found · pointer only · cbc1955a34800714 · report
sharpen gan3sh500/mixmatch-pytorch/mixmatch_utils.py community (archive-listed) ran · honoured contract fingerprinted no licence file found · pointer only · 6d22d34f03eff901 · report
sharpen dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) ran · honoured contract fingerprinted no licence file found · pointer only · 63688837810c6e5a · report
split_U dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) ran no licence file found · pointer only · 3c7a33c95b913c66 · report
tagging_criterion rit-git/Snippext_public/snippext/mixmatchnl.py community (archive-listed) ran · our draft was wrong fingerprinted BSD-3-Clause (permissive) · 670937fdbe1b61da · report
tile_adjacent FelixAbrahamsson/mixmatch-pytorch/mixmatch_pytorch/mixmatch_batch.py community (archive-listed) ran · fixture could not drive it fingerprinted no licence file found · pointer only · caacacf94d563a78 · report
to_categorical gan3sh500/mixmatch-pytorch/mixmatch_utils.py community (archive-listed) ran · fixture could not drive it no licence file found · pointer only · 7ccbcdef1f97bdbf · report
MixMatch DamianValle/ScarceClassifier/src/mixmatch.py community (archive-listed) unverified no licence file found · pointer only · 7397979be7d7eeb1 · report
WideResNet yuxi120407/mixmatch_tensorflow/model.py community (archive-listed) unverified no licence file found · pointer only · 6e4bb6cf26d5d34d · report
augment_labelData dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) unverified no licence file found · pointer only · cd590be04d9864e1 · report
augment_unlabelData dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) unverified no licence file found · pointer only · 21f82c5babfc89be · report
calculate_overall_lwlrap_sklearn viig99/mixmatch-freesound/analysis/compute_lwlrap.py community (archive-listed) unverified MIT (permissive) · c9498d65f32e1148 · report
calculate_per_class_lwlrap viig99/mixmatch-freesound/analysis/compute_lwlrap.py community (archive-listed) unverified MIT (permissive) · 033283e1fa3d96fe · report
categorize narendoraiswamy/MixMatch-pytorch-demo/dataset/_cifar10.py community (archive-listed) unverified MIT (permissive) · d687dcb3c4ba5861 · report
collate_fn viig99/mixmatch-freesound/dataset/freesound.py community (archive-listed) unverified MIT (permissive) · c9ad1e68bbc3805b · report
collate_fn_unlabbelled viig99/mixmatch-freesound/dataset/freesound.py community (archive-listed) unverified MIT (permissive) · 45f16173aaa12967 · report
create_model viig99/mixmatch-freesound/kaggle_submission_checker.py community (archive-listed) unverified MIT (permissive) · f8b6744d7114ac81 · report
expand_ulabel dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) unverified no licence file found · pointer only · 44bd7219e3206702 · report
get_cifar10 kevinghst/mixmatch/dataset/cifar10.py community (archive-listed) unverified MIT (permissive) · a0e25dd8565d9d94 · report
get_cifar10 narendoraiswamy/MixMatch-pytorch-demo/dataset/_cifar10.py community (archive-listed) unverified MIT (permissive) · 0f1e6cdf5451e58d · report
get_mean_and_std kevinghst/mixmatch/utils/misc.py community (archive-listed) unverified MIT (permissive) · 1d6e2edb8832d7b0 · report
guess_label_with_logit dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) unverified no licence file found · pointer only · 71516924003b7081 · report
label_binarizer viig99/mixmatch-freesound/dataset/freesound.py community (archive-listed) unverified MIT (permissive) · ad7aa34a23b546b2 · report
label_guessing gan3sh500/mixmatch-pytorch/mixmatch_utils.py community (archive-listed) unverified no licence file found · pointer only · 0ad756f5a68bcd04 · report
load_state_dict viig99/mixmatch-freesound/kaggle_submission.py community (archive-listed) unverified MIT (permissive) · 197f711034e07fc3 · report
mixmatch gan3sh500/mixmatch-pytorch/mixmatch_utils.py community (archive-listed) unverified no licence file found · pointer only · b11b94decd7ab296 · report
normalise kevinghst/mixmatch/dataset/cifar10.py community (archive-listed) unverified MIT (permissive) · d2a4ac781b2a9628 · report
should_apply_transform viig99/mixmatch-freesound/kaggle_submission.py community (archive-listed) unverified MIT (permissive) · 06ac2737867f1b5b · report
split_X dhx000/DGM_project/mixmatch/cycle_mixmatch.py community (archive-listed) unverified no licence file found · pointer only · 0accfa09823d9b0c · report
train_val_split kevinghst/mixmatch/dataset/cifar10.py community (archive-listed) unverified MIT (permissive) · 035b6b2199fe55d1 · report
train_val_split narendoraiswamy/MixMatch-pytorch-demo/dataset/_cifar10.py community (archive-listed) unverified MIT (permissive) · 41670d21181a8756 · report

Tasks

Image ClassificationSemi-Supervised Image Classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Classification CIFAR-10 MixMatch Percentage correct 95.05 #143 of 265 Archive leaderboard report
Image Classification CIFAR-100 MixMatch Percentage correct 74.1 #157 of 211 Archive leaderboard report
Image Classification STL-10 MixMatch Percentage correct 94.41 #22 of 117 Archive leaderboard report
Image Classification STL-10 IIC Percentage correct 88.80 #42 of 117 Archive leaderboard report
Image Classification STL-10 CutOut Percentage correct 87.36 #45 of 117 Archive leaderboard report
Image Classification SVHN MixMatch Percentage error 2.59 #37 of 62 Archive leaderboard report
Semi-Supervised Image Classification CIFAR-10, 1000 Labels MixMatch Accuracy 92.25 #1 of 9 Archive leaderboard report
Semi-Supervised Image Classification CIFAR-10, 2000 Labels MixMatch Accuracy 92.97 #1 of 4 Archive leaderboard report
Semi-Supervised Image Classification CIFAR-10, 250 Labels MixMatch Percentage error 11.08 #22 of 27 Archive leaderboard report
Semi-Supervised Image Classification CIFAR-10, 4000 Labels MixMatch Percentage error 6.24 #30 of 49 Archive leaderboard report
Semi-Supervised Image Classification CIFAR-10, 500 Labels MixMatch Accuracy 91.35 #1 of 1 Archive leaderboard report
Semi-Supervised Image Classification STL-10, 1000 Labels MixMatch Accuracy 89.82 #10 of 13 Archive leaderboard report
Semi-Supervised Image Classification STL-10, 5000 Labels MixMatch Accuracy 94.41 #1 of 1 Archive leaderboard report
Semi-Supervised Image Classification SVHN, 1000 labels MixMatch Accuracy 96.73 #7 of 17 Archive leaderboard report
Semi-Supervised Image Classification SVHN, 2000 Labels MixMatch Accuracy 96.96 #1 of 1 Archive leaderboard report
Semi-Supervised Image Classification SVHN, 250 Labels MixMatch Accuracy 96.22 #8 of 15 Archive leaderboard report
Semi-Supervised Image Classification SVHN, 4000 Labels MixMatch Accuracy 97.11 #1 of 1 Archive leaderboard report
Semi-Supervised Image Classification SVHN, 500 Labels MixMatch Accuracy 96.36 #2 of 6 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections