Papers › Repetitive Reprediction Deep Decipher for Semi-Supervised Learning

Repetitive Reprediction Deep Decipher for Semi-Supervised Learning

9 Aug 2019arXiv:1908.04345archive 2025-07-28

Guo-Hua Wang, Jianxin Wu

Most recent semi-supervised deep learning (deep SSL) methods used a similar paradigm: use network predictions to update pseudo-labels and use pseudo-labels to update network parameters iteratively. However, they lack theoretical support and cannot explain why predictions are good candidates for pseudo-labels. In this paper, we propose a principled end-to-end framework named deep decipher (D2) for SSL. Within the D2 framework, we prove that pseudo-labels are related to network predictions by an exponential link function, which gives a theoretical support for using predictions as pseudo-labels. Furthermore, we demonstrate that updating pseudo-labels by network predictions will make them uncertain. To mitigate this problem, we propose a training strategy called repetitive reprediction (R2). Finally, the proposed R2-D2 method is tested on the large-scale ImageNet dataset and outperforms state-of-the-art methods by 5 percentage points.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

DoctorKey/R2D2.pytorch officialmentioned on GitHubpytorchSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Semi-Supervised Image Classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Semi-Supervised Image Classification CIFAR-10, 4000 Labels R2-D2 (Shake-Shake) Percentage error 5.72 #26 of 49 Archive leaderboard report
Semi-Supervised Image Classification ImageNet - 10% labeled data R2-D2 (ResNet-18) Top 5 Accuracy 90.48% #53 of 75 Archive leaderboard report
Semi-Supervised Image Classification SVHN, 1000 labels R2-D2 (CNN-13) Accuracy 96.36 #10 of 17 Archive leaderboard report
Semi-Supervised Image Classification cifar-100, 10000 Labels R2-D2 (CNN-13) Percentage error 32.87 #26 of 29 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections