Browse › Computer Vision › Image Classification › STL-10

Image Classification archive 2025-07-28

STL-10 Benchmark (Image Classification)

117 rows 66 with code listed 3 metrics Dataset page

Syntology Since the archive (Syntology): none placed; no newer paper judged to report on this board so far.

Image Classification is a fundamental task in vision recognition that aims to understand and categorize an image as a whole under a specific label. Unlike object detection, which involves classification and location of multiple objects within an image, image classification typically pertains to single-object images. When the classification becomes highly detailed or reaches instance-level, it is often referred to as image retrieval, which also involves finding similar images in a large database.

Source: Metamorphic Testing for Object Detection Systems

The archive carries no text for this table; the description above is the archive's text for the task Image Classification. archive 2025-07-28

Over time archive 2025-07-28

Direction inferred from the metric name, not from the archive: FLOPS (lower is better), PARAMS (lower is better). Not inferred (points only, no best-so-far line): Percentage correct. Points are placed at the row's paper date, not an evaluation date; 117 of 117 rows carry one.

The chart needs JavaScript; the table below carries every value.

Results archive 2025-07-28

Archive rows end at the archive snapshot, 2025-07-28: no result published after that date is in this table. Rank is the archive's row order at that snapshot; not re-ranked here. Metric values are the archive's strings. Column headers sort the table in your browser; each row keeps its archive rank.

Paper Code Ran Syntology Report
1 µ2Net+ (ViT-L/16) 99.64 ✓ Paper Code 2022 linked, not harvested report
2 kNN-CLIP 99.6 ✓ Paper – 2022 no code linked report
3 Wide-ResNet-101 (Spinal FC) 98.66 ✓ Paper Code 2020 linked, not harvested report
4 CN(d=128) 98.45 ✓ Paper – 2021 no code linked report
5 CN(d=64) 98.36 ✓ Paper – 2021 no code linked report
6 NSRL+CN(d=128) 98.36 ✓ Paper – 2021 no code linked report
7 NSRL+CN(d=32) 98.34 ✓ Paper – 2021 no code linked report
8 NSRL+CN(d=64) 98.24 ✓ Paper – 2021 no code linked report
9 CN(d=32) 98.17 ✓ Paper – 2021 no code linked report
10 NAT-M4 97.9573M7.5M ✓ Paper Code 2020 official: harvested, nothing ran · 0 ran · 1 unverified report
11 NAT-M3 97.8436M7.5M ✓ Paper Code 2020 official: harvested, nothing ran · 0 ran · 1 unverified report
12 SEER (RegNet10B) 97.310000M ✓ Paper Code 2022 linked, not harvested report
13 NAT-M2 97.2303M5.1M ✓ Paper Code 2020 official: harvested, nothing ran · 0 ran · 1 unverified report
14 iGPT-L 97.1 ✓ Paper Code 2020 linked, not harvested report
15 NAT-M1 96.7240M4.4M ✓ Paper Code 2020 official: harvested, nothing ran · 0 ran · 1 unverified report
16 EnAET 95.48 ✓ Paper Code 2019 linked, not harvested report
17 VGG-19bn 95.44 ✓ Paper Code 2020 linked, not harvested report
18 Diffusion Classifier (zero-shot) 95.4 – Paper Code 2023 official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified report
19 FixMatch (CTA) 94.83 – Paper Code 2020 53 ran (of which 13 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 2 violated, 20 with no contract checked; 28 where Syntology's instrument failed) · 21 unverified report
20 ReMixMatch 94.77 – Paper Code 2020 53 ran (of which 13 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 2 violated, 20 with no contract checked; 28 where Syntology's instrument failed) · 21 unverified report
21 AMDIM 94.5 – Paper Code 2019 8 ran (of which 5 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified report
22 MixMatch 94.41 – Paper Code 2019 community repositories only · 47 ran (of which 8 constructed an object rather than computing a result; 27 with no instrument failure: 8 honoured, 0 violated, 19 with no contract checked; 20 where Syntology's instrument failed) · 16 unverified report
23 AMDIM-L 94.2 ✓ Paper Code 2020 linked, not harvested report
24 ReMixMatch (K=4) 93.82 – Paper Code 2019 official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified report
25 AMDIM 93.80 – Paper Code 2020 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified report
26 ReMixMatch (K=1) 93.23 – Paper Code 2019 official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified report
27 MP* 93.19 – Paper – 2020 no code linked report
28 UDA 92.34 – Paper Code 2020 53 ran (of which 13 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 2 violated, 20 with no contract checked; 28 where Syntology's instrument failed) · 21 unverified report
29 YADIM 92.15 – Paper Code 2020 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified report
30 FixMatch (RA) 92.02 – Paper Code 2020 53 ran (of which 13 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 2 violated, 20 with no contract checked; 28 where Syntology's instrument failed) · 21 unverified report
31 NSGANetV2 92.0 – Paper Code 2020 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 1 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified report
32 SESN 91.49 – Paper Code 2019 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified report
33 Harmonic WRN-16-8 90.45 – Paper Code 2019 linked, not harvested report
34 wrn16/8 D8 D4 D1 90.20 – Paper Code 2019 linked, not harvested report
35 DLME (ResNet-50, linear) 90.1 – Paper Code 2022 official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result report
36 MixMatch 89.82 – Paper Code 2019 official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified report
37 MixMatch 89.59 – Paper Code 2020 53 ran (of which 13 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 2 violated, 20 with no contract checked; 28 where Syntology's instrument failed) · 21 unverified report
38 wrn16/8* D8 D4 D1 89.43 – Paper Code 2019 linked, not harvested report
39 wrn16/8* D1 D1 D1 88.95 – Paper Code 2019 linked, not harvested report
40 wrn16/8 D1 D1 D1 88.83 – Paper Code 2019 linked, not harvested report
41 IIC 88.8 – Paper Code 2018 official (archive's flag): 2 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified report
42 IIC 88.80 – Paper Code 2019 community repositories only · 47 ran (of which 8 constructed an object rather than computing a result; 27 with no instrument failure: 8 honoured, 0 violated, 19 with no contract checked; 20 where Syntology's instrument failed) · 16 unverified report
43 SOPCNN 88.08 – Paper Code 2020 linked, not harvested report
44 TS 88.03 – Paper – 2020 no code linked report
45 CutOut 87.36 – Paper Code 2019 community repositories only · 47 ran (of which 8 constructed an object rather than computing a result; 27 with no instrument failure: 8 honoured, 0 violated, 19 with no contract checked; 20 where Syntology's instrument failed) · 16 unverified report
46 Cutout 87.26 – Paper Code 2017 community repositories only · 21 ran (of which 3 constructed an object rather than computing a result; 9 with no instrument failure: 3 honoured, 3 violated, 3 with no contract checked; 12 where Syntology's instrument failed) · 3 unverified report
47 wrn16/8 87.26 – Paper Code 2019 linked, not harvested report
48 Hamiltonian 85.5 – Paper Code 2017 linked, not harvested report
49 ResNet-18+MM+FRL 85.42 – Paper – 2020 no code linked report
50 MidPoint 84.6 – Paper Code 2017 linked, not harvested report
51 cosine function 84.38 – Paper – 2018 no code linked report
52 HybridNet 84.10 – Paper – 2018 no code linked report
53 Leapfrog 83.7 – Paper Code 2017 linked, not harvested report
54 skewing 83.47 – Paper – 2018 no code linked report
55 elastic distortion(2) 83.45 – Paper – 2018 no code linked report
56 PSLR-knn 83.2 – Paper – 2020 no code linked report
57 elastic distortion(1) 83.00 – Paper – 2018 no code linked report
58 ResNet baseline 82.00 – Paper – 2018 no code linked report
59 Greedy InfoMax (GIM) 81.9 – Paper Code 2019 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified report
60 rotation 81.45 – Paper – 2018 no code linked report
61 ResNet18(BN, 4) 81.04 – Paper – 2020 no code linked report
62 VGG8B + LocalLearning + CO 80.75 – Paper Code 2019 linked, not harvested report
63 ResNet18(GN, 4) 79.3 – Paper – 2020 no code linked report
64 PSLR-Linear 78.8 – Paper – 2020 no code linked report
65 ResNet18(BN, 128) 78.65 – Paper – 2020 no code linked report
66 Mean Teacher 78.57 – Paper Code 2020 53 ran (of which 13 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 2 violated, 20 with no contract checked; 28 where Syntology's instrument failed) · 21 unverified report
67 CPC† 78.36 – Paper Code 2020 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified report
68 Hamiltonian 78.3 – Paper Code 2018 linked, not harvested report
69 CC-GAN² 77.8 – Paper Code 2016 official: not harvested · 0 ran · 1 unverified report
70 CC-GAN 77.80 – Paper Code 2019 official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified report
71 Parabolic 77.0 – Paper Code 2018 linked, not harvested report
72 Scat + WRN 20-8 76.6 – Paper Code 2017 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified report
73 ResNet18(EBN, 4) 76.49 – Paper – 2020 no code linked report
74 Exemplar CNN 75.7 – Paper Code 2017 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified report
75 ResNet18(EBN, 128) 75.57 – Paper – 2020 no code linked report
76 Stacked what-where AE 74.33 – Paper Code 2017 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified report
77 SWWAE 74.33 – Paper – 2018 no code linked report
78 SWWAE 74.30 – Paper Code 2019 official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified report
79 SWWAE 74.3 – Paper Code 2015 linked, not harvested report
80 Second-order 74.3 – Paper Code 2018 linked, not harvested report
81 Convolutional Clustering 74.1 – Paper – 2015 no code linked report
82 Π-Model 73.77 – Paper Code 2020 53 ran (of which 13 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 2 violated, 20 with no contract checked; 28 where Syntology's instrument failed) · 21 unverified report
83 Discriminative Unsupervised Feature Learning with Convolutional Neural Networks 72.8 – Paper Code 2014 linked, not harvested report
84 ResNet18(GN, 128) 72.66 – Paper – 2020 no code linked report
85 Pseudo-Labeling 72.01 – Paper Code 2020 53 ran (of which 13 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 2 violated, 20 with no contract checked; 28 where Syntology's instrument failed) · 21 unverified report
86 Entropy 71.65 – Paper – 2020 no code linked report
87 BDW 71.12 – Paper – 2020 no code linked report
88 MP 71.05 – Paper – 2020 no code linked report
89 WaveMixLite-256/7 70.88 – Paper Code 2022 linked, not harvested report
90 CNN 70.7 – Paper Code 2017 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified report
91 An Analysis of Unsupervised Pre-training in Light of Recent Advances 70.2 – Paper Code 2014 linked, not harvested report
92 Multi-Task Bayesian Optimization 70.1 – Paper Code 2013 linked, not harvested report
93 NN-Weighter 69.15 – Paper – 2020 no code linked report
94 Accuracy Monitoring 68.62 – Paper – 2020 no code linked report
95 C-SVDDNet 68.2 – Paper – 2014 no code linked report
96 RotNet 68.19 – Paper – 2020 no code linked report
97 DFF Committees 68 – Paper – 2014 no code linked report
98 Hierarchical Matching Pursuit (HMP) 64.6 – Paper Code 2017 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified report
99 L2RW 63.13 – Paper – 2020 no code linked report
100 Discriminative Learning of Sum-Product Networks 62.3 – Paper – 2011 no code linked report
101 CKN 62.3 – Paper – 2014 no code linked report
102 S-CNN 61.94 – Paper – 2016 no code linked report
103 Simulated Fixations 61 – Paper Code 2020 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified report
104 No more meta-parameter tuning in unsupervised sparse feature learning 61 – Paper – 2014 no code linked report
105 Convolutional K-means Network 60.2 – Paper Code 2017 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified report
106 Receptive Fields 60.1 – Paper – 2007 no code linked report
107 PWD 59.45 – Paper – 2020 no code linked report
108 GVD 59.33 – Paper – 2020 no code linked report
109 VR 59.13 – Paper – 2020 no code linked report
110 Core SET 58.93 – Paper – 2020 no code linked report
111 GE 58.84 – Paper – 2020 no code linked report
112 DFAL 58.81 – Paper – 2020 no code linked report
113 Random 58.15 – Paper – 2020 no code linked report
114 BALD-MCD 57.35 – Paper – 2020 no code linked report
115 Sign-symmetry 57.32 – Paper Code 2015 linked, not harvested report
116 M2-PWD 57.31 – Paper – 2020 no code linked report
117 soft ica 52.9 – Paper – 2011 no code linked report

All 117 rows shown. 117 link to a paper page on this site; 18 are marked as using additional training data in the archive. No GitHub stars are tracked; "Code" is the first repository the archive lists for the row. The archive carries no row tags, review links or community-submitted rows for this table; none are shown. archive 2025-07-28

Syntology Ran reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”: of the code samples Syntology harvested from repositories linked to that row's paper (joined by arXiv id), N executed on a synthesized input and U are unverified (harvested, no recorded run). Of the N, C constructed an object rather than computing a result (a part of N, never taken away from it), K ran with no instrument failure (honoured or violated the contract Syntology drafted, or ran with no contract checked) and I are failures of Syntology's instrument, not of the code (a wrong contract draft, or a contract check that could not run). It counts code from repositories linked to that row's paper, not this result: the row's number was not reproduced and nothing here is a correctness claim. The other cell texts mean no graph line for the row: "linked, not harvested" (the archive links code, Syntology has not harvested it), "no code linked" (no code link in the archive), "not matched" (the row's paper URL matched no paper on this site). 39 rows have a graph line, from 15 distinct papers. Rows whose paper has a sample that ran: 34 (29 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument). Papers: 13 with a sample that ran: 12 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument. Whose code ran. When the archive marks a repository official for the row's paper, the cell starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code): “official (archive's flag): N ran” counts the samples from it that ran, instrument failures included; “official: harvested, nothing ran”; when it has no sample for this paper and other samples ran, “community repositories only” if every one came from a repository the archive lists for the paper but neither marks official nor records as mentioned in it, or one Syntology harvested outside the archive's links, and “official: no sample here; runs from other or unrecorded repositories” if any came from a repository named in the paper or found in its text by Syntology, or has no repository recorded; “official: harvested for another paper” (no sample from it is linked to this paper) or “official: not harvested”. No state is printed when the archive marks none official. The cell's tooltip names the repositories the samples that ran came from. Of the 39 rows with a graph line, 25 have an archive-official repository: on 11 a sample from it ran (10 with a run with no instrument failure), on 4 the samples that ran came from community repositories only, and on 0 from other or unrecorded repositories. The filters above hide rows and never renumber them; the first two count, by default, only a run with no instrument failure, and offer any run, instrument failures included. Counting each paper once, of 223 samples: 157 ran (of which 30 constructed an object rather than computing a result; 91 with no instrument failure: 18 honoured, 6 violated, 67 with no contract checked; 66 where Syntology's instrument failed) · 66 unverified. Separately, 68 of those 223 are pointer-only (licence): the site points at that code rather than redistributing it, a licence property recorded for ran and unverified samples alike; each cell's tooltip carries the row's own pointer-only count. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. Per-sample status is on the paper page; each Ran cell links to that paper's sample list. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Since the archive Syntology

Of the 8,888 newer papers whose tables Syntology has read (8,886 checked in full and 2 with a leaderboard still awaiting a verdict), 2 had this board among the leaderboards the extractor considered for their tables (it keeps at most 10 boards per paper and 4 per dataset; the lists of 1,595 of the 8,888 were already full without this board, so if it was crowded out of them it is not counted), and none proposed a result, so none await a verdict and none were placed. Syntology has checked 8,886 of the 18,637 papers on this site that are newer than the archive (for 3,717 of them no archive leaderboard matched the paper's tables, so there was nothing further to check); 733 were read and have nothing to place (arXiv has no HTML version of the paper, or that version has no tables), 41 could not be read (the extractor's reply could not be parsed), and results from the other 8,977 appear after they are checked.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections