Browse › Computer Vision › Semantic Segmentation › Cityscapes test
Cityscapes test Benchmark (Semantic Segmentation)
105 rows
97 with code listed
2 metrics
Dataset page
Syntology Since the archive (Syntology): none placed; no newer paper judged to report on this board so far .
Over time archive 2025-07-28
Direction inferred from the metric name, not from the archive: Mean IoU (class) (higher is better). Not inferred (points only, no best-so-far line): Category mIoU. Points are placed at the row's paper date, not an evaluation date; 105 of 105 rows carry one.
Metric
Mean IoU (class) Category mIoU
Extra training data
The chart needs JavaScript; the table below carries every value.
Results archive 2025-07-28
Archive rows end at the archive snapshot, 2025-07-28: no result published after that date is in this table. Rank is the archive's row order at that snapshot; not re-ranked here. Metric values are the archive's strings. Column headers sort the table in your browser; each row keeps its archive rank.
only rows whose paper has a sample that ran
only rows whose archive-official repository has a sample that ran
a run counts when it is
a run with no instrument failure any run, instrument failures included
hide rows using extra training data
Ran counts code from the row's paper that executed on a synthesized input, not this result.
Rank
Model
Mean IoU (class) Category mIoU Extra Training Data
Paper
Code
Year
Ran Syntology
Report
1
VLTSeg
86.4 –
Paper
Code
2023
linked, not harvested
report
2
MetaPrompt-SD
86.2 –
Paper
Code
2023
official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 2 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
report
3
InternImage-H
86.1% –
Paper
Code
2022
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified
report
4
HS3-Fuse
85.8% –
Paper
–
2021
no code linked
report
5
InverseForm
85.6% –
Paper
Code
2021
1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
report
6
ViT-Adapter-L (Mask2Former, BEiT pretrain)
85.2% –
Paper
Code
2022
linked, not harvested
report
7
SERNet-Former
84.83 –
Paper
Code
2024
linked, not harvested
report
8
Depth Anything
84.8% –
Paper
Code
2024
official (archive's flag): 1 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified
report
9
HRNetV2 + OCR +
84.5% –
Paper
Code
2019
official (archive's flag): 1 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified
report
10
EfficientPS
84.21% –
Paper
Code
2020
linked, not harvested
report
11
Panoptic-DeepLab
84.2% –
Paper
Code
2019
official: harvested, nothing ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified
report
12
HRNetV2 + OCR (w/ ASP)
83.7% –
Paper
Code
2019
official (archive's flag): 1 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified
report
13
DCNAS(coarse + Mapillary)
83.6% –
Paper
–
2020
no code linked
report
14
Euclidean Frank-Wolfe CRFs (backbone: DeepLabv3+)(coarse)
83.6% –
Paper
Code
2021
official (archive's flag): 4 ran · 4 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified
report
15
GALDNet(+Mapillary)++
83.3% –
Paper
Code
2019
official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified
report
16
ResNeSt200 (Mapillary)
83.3% –
Paper
Code
2020
official (archive's flag): 5 ran · 28 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 0 violated, 21 with no contract checked; 7 where Syntology's instrument failed) · 20 unverified
report
17
HANet (Height-driven Attention Networks by LGE A&B)(coarse)
83.2% –
Paper
Code
2020
linked, not harvested
report
18
kMaX-DeepLab (ConvNeXt-L, fine only)
83.2% –
Paper
Code
2022
linked, not harvested
report
19
SegFormer (MiT-B5, Mapillary)
83.1% –
Paper
Code
2021
official: no sample here; runs from other or unrecorded repositories · 66 ran (of which 22 constructed an object rather than computing a result; 52 with no instrument failure: 1 honoured, 2 violated, 49 with no contract checked; 14 where Syntology's instrument failed) · 20 unverified
report
20
OCR (HRNetV2-W48, coarse)
83.0% –
Paper
Code
2019
official (archive's flag): 1 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified
report
21
MRFM(coarse)
83.0% –
Paper
–
2020
no code linked
report
22
DNL (coarse)
83% –
Paper
Code
2020
official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
report
23
DRAN(ResNet-101) WITH ONLY FINE ANNOTATED DATA
82.9% –
Paper
Code
2020
linked, not harvested
report
24
Gated-SCNN
82.8% –
Paper
Code
2019
linked, not harvested
report
25
Dense Prediction Cell
82.7% –
Paper
Code
2018
linked, not harvested
report
26
CAA (ResNet-101)
82.6% –
Paper
Code
2021
linked, not harvested
report
27
OCR (ResNet-101, coarse)
82.4% –
Paper
Code
2019
official (archive's flag): 1 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified
report
28
DDRNet-39 1.5x
82.4% –
Paper
Code
2021
linked, not harvested
report
29
SSMA
82.3% –
Paper
Code
2018
linked, not harvested
report
30
Gated Fully Fusion
82.3% –
Paper
Code
2019
linked, not harvested
report
31
Auto-DeepLab-L
82.1% –
Paper
Code
2019
community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
report
32
DGCNet (ResNet-101)
82% –
Paper
Code
2019
linked, not harvested
report
33
SPNet (ResNet-101)
82.0% –
Paper
Code
2020
official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified
report
34
OCR (ResNet-101)
81.8% –
Paper
Code
2019
official (archive's flag): 1 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified
report
35
RPCNet
81.8 –
Paper
–
2020
no code linked
report
36
OCNet
81.7% –
Paper
Code
2018
linked, not harvested
report
37
SETR-PUP++
81.64% –
Paper
Code
2020
linked, not harvested
report
38
HRNet (HRNetV2-W48)
81.6% –
Paper
Code
2019
official: harvested, nothing ran · 14 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 6 where Syntology's instrument failed) · 4 unverified
report
39
HRNetV2 (train+val)
81.6% –
Paper
Code
2019
21 ran (of which 0 constructed an object rather than computing a result; 16 with no instrument failure: 0 honoured, 1 violated, 15 with no contract checked; 5 where Syntology's instrument failed) · 13 unverified
report
40
DANet (ResNet-101)
81.5% –
Paper
Code
2018
official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
report
41
CCNet
81.4% –
Paper
Code
2018
official (archive's flag): 8 ran · 13 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 1 violated, 4 with no contract checked; 6 where Syntology's instrument failed) · 1 unverified
report
42
BFP
81.4% –
Paper
Code
2019
official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified
report
43
DeepLabv3 (ResNet-101, coarse)
81.3% –
Paper
Code
2017
3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified
report
44
CPN(ResNet-101)
81.3% –
Paper
Code
2020
linked, not harvested
report
45
Asymmetric ALNN
81.3% –
Paper
Code
2019
official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
report
46
AdapNet++
81.24% –
Paper
Code
2018
linked, not harvested
report
47
SVCNet (ResNet-101)
81.0% –
Paper
Code
2019
linked, not harvested
report
48
D3Net-L
80.8% –
Paper
Code
2020
linked, not harvested
report
49
DenseASPP (DenseNet-161)
80.6% –
Paper
Code
2018
linked, not harvested
report
50
Smooth Network with Channel Attention Block
80.3% –
Paper
Code
2018
3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified
report
51
PSPNet++
80.2% –
Paper
Code
2016
community repositories only · 21 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 7 where Syntology's instrument failed) · 8 unverified
report
52
PSANet (ResNet-101)
80.1% –
Paper
Code
2018
linked, not harvested
report
53
ESANet-R34-NBt1D
80.09% –
Paper
Code
2020
linked, not harvested
report
54
DeepLabV3 with R-101
79.9% –
Paper
–
2023
no code linked
report
55
DFN (ResNet-101)
79.3% –
Paper
Code
2018
3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified
report
56
AAF (ResNet-101)
79.1% –
Paper
Code
2018
1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
report
57
ShelfNet-34
79.0% –
Paper
Code
2018
linked, not harvested
report
58
BiSeNet (ResNet-101)
78.9% –
Paper
Code
2018
14 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified
report
59
ResNet-38
78.4% –
Paper
Code
2016
official: harvested, nothing ran · 0 ran · 2 unverified
report
60
PSPNet
78.4% –
Paper
Code
2016
community repositories only · 21 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 7 where Syntology's instrument failed) · 8 unverified
report
61
DepthSeg (ResNet-101)
78.2% –
Paper
Code
2017
linked, not harvested
report
62
DSSPN (ResNet-101)
77.8% –
Paper
–
2018
no code linked
report
63
DUC-HDC (ResNet-101)
77.6% –
Paper
Code
2017
official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
report
64
SaGe
76.9 –
Paper
Code
2021
linked, not harvested
report
65
SwinMTL
76.41% –
Paper
Code
2024
linked, not harvested
report
66
SwiftNetRN-18
75.5% –
Paper
Code
2019
linked, not harvested
report
67
RefineNet (ResNet-101)
73.6% –
Paper
Code
2016
community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
report
68
MobileNet V3-Large 1.0
72.6% –
Paper
Code
2019
86 ran (of which 22 constructed an object rather than computing a result; 75 with no instrument failure: 9 honoured, 2 violated, 64 with no contract checked; 11 where Syntology's instrument failed) · 19 unverified
report
69
SqueezeNAS (LAT Large)
72.5% –
Paper
Code
2019
5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
report
70
Multi Scale Spatial Attention
72.4% –
Paper
–
2020
no code linked
report
71
FRRN
71.8% –
Paper
Code
2016
official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified
report
72
LRR-4x
71.8% –
Paper
Code
2016
linked, not harvested
report
73
Context
71.6% –
Paper
–
2015
no code linked
report
74
FasterSeg
71.5% –
Paper
Code
2019
official (archive's flag): 8 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified
report
75
DFANet A
71.3% –
Paper
Code
2019
1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
report
76
LDFNet
71.3 –
Paper
Code
2018
linked, not harvested
report
77
LightSeg-DarkNet19
70.75% 88.29 –
Paper
Code
2019
linked, not harvested
report
78
ESNet
70.7% –
Paper
Code
2019
linked, not harvested
report
79
ICNet
70.6% –
Paper
Code
2017
linked, not harvested
report
80
LEDNet
70.6% –
Paper
Code
2019
linked, not harvested
report
81
WASPnet (ours)
70.5% –
Paper
Code
2019
linked, not harvested
report
82
DeepLab-CRF (ResNet-101)
70.4% –
Paper
Code
2016
43 ran (of which 12 constructed an object rather than computing a result; 35 with no instrument failure: 1 honoured, 0 violated, 34 with no contract checked; 8 where Syntology's instrument failed) · 20 unverified
report
83
ERFNet (PyTorch)
69.8% –
Paper
Code
2017
linked, not harvested
report
84
Fast-SCNN
68% –
Paper
Code
2019
21 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 0 violated, 21 with no contract checked; 0 where Syntology's instrument failed) · 11 unverified
report
85
LightSeg-MobileNet
67.81% 86.79 –
Paper
Code
2019
linked, not harvested
report
86
LiteSeg-MobileNet
67.81% –
Paper
Code
2019
linked, not harvested
report
87
Template-Based NAS-arch1
67.8% –
Paper
Code
2019
linked, not harvested
report
88
Template-Based NAS-arch0
67.7% –
Paper
Code
2019
linked, not harvested
report
89
EDANet
67.3 –
Paper
Code
2018
linked, not harvested
report
90
Dilation10
67.1% –
Paper
Code
2015
official (archive's flag): 1 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified
report
91
DPN
66.8% –
Paper
Code
2015
linked, not harvested
report
92
SqueezeNAS (LAT Small)
66.8% –
Paper
Code
2019
5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
report
93
SINet
66.5% –
Paper
Code
2019
linked, not harvested
report
94
ESPNetv2
66.2% –
Paper
Code
2018
community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified
report
95
FCN
65.3% –
Paper
Code
2016
linked, not harvested
report
96
LightSeg-ShuffleNet
65.17% 85.39 –
Paper
Code
2019
linked, not harvested
report
97
LiteSeg-ShuffleNet
65.17% –
Paper
Code
2019
linked, not harvested
report
98
DeepLab
63.1% –
Paper
Code
2014
official: not harvested · 0 ran · 1 unverified
report
99
ENet + Lovász-Softmax
63.06% –
Paper
Code
2017
linked, not harvested
report
100
ESPNet
60.3% –
Paper
Code
2018
official: harvested, nothing ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified
report
101
ENet
58.3% –
Paper
Code
2016
26 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 0 violated, 21 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified
report
102
SegNet
57.0% –
Paper
Code
2015
22 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 1 honoured, 0 violated, 13 with no contract checked; 8 where Syntology's instrument failed) · 22 unverified
report
103
IkshanaNet-1
54.82% 82.22% –
Paper
Code
2021
linked, not harvested
report
104
IkshanaNet-2
45.02% 76.73% –
Paper
Code
2021
linked, not harvested
report
105
IkshanaNet-3
42.07% 75.61% –
Paper
Code
2021
linked, not harvested
report
All 105 rows shown. 105 link to a paper page on this site; 0 are marked as using additional training data in the archive. No GitHub stars are tracked; "Code" is the first repository the archive lists for the row. The archive carries no row tags, review links or community-submitted rows for this table; none are shown. archive 2025-07-28
Syntology Ran reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”: of the code samples Syntology harvested from repositories linked to that row's paper (joined by arXiv id), N executed on a synthesized input and U are unverified (harvested, no recorded run). Of the N, C constructed an object rather than computing a result (a part of N, never taken away from it), K ran with no instrument failure (honoured or violated the contract Syntology drafted, or ran with no contract checked) and I are failures of Syntology's instrument, not of the code (a wrong contract draft, or a contract check that could not run). It counts code from repositories linked to that row's paper, not this result: the row's number was not reproduced and nothing here is a correctness claim. The other cell texts mean no graph line for the row: "linked, not harvested" (the archive links code, Syntology has not harvested it), "no code linked" (no code link in the archive), "not matched" (the row's paper URL matched no paper on this site). 47 rows have a graph line, from 40 distinct papers. Rows whose paper has a sample that ran: 45 (41 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument). Papers: 38 with a sample that ran: 34 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument. Whose code ran. When the archive marks a repository official for the row's paper, the cell starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code): “official (archive's flag): N ran” counts the samples from it that ran, instrument failures included; “official: harvested, nothing ran”; when it has no sample for this paper and other samples ran, “community repositories only” if every one came from a repository the archive lists for the paper but neither marks official nor records as mentioned in it, or one Syntology harvested outside the archive's links, and “official: no sample here; runs from other or unrecorded repositories” if any came from a repository named in the paper or found in its text by Syntology, or has no repository recorded; “official: harvested for another paper” (no sample from it is linked to this paper) or “official: not harvested”. No state is printed when the archive marks none official. The cell's tooltip names the repositories the samples that ran came from. Of the 47 rows with a graph line, 32 have an archive-official repository: on 19 a sample from it ran (12 with a run with no instrument failure), on 5 the samples that ran came from community repositories only, and on 2 from other or unrecorded repositories. The filters above hide rows and never renumber them; the first two count, by default, only a run with no instrument failure, and offer any run, instrument failures included. Counting each paper once, of 682 samples: 487 ran (of which 57 constructed an object rather than computing a result; 374 with no instrument failure: 23 honoured, 11 violated, 340 with no contract checked; 113 where Syntology's instrument failed) · 195 unverified. Separately, 203 of those 682 are pointer-only (licence): the site points at that code rather than redistributing it, a licence property recorded for ran and unverified samples alike; each cell's tooltip carries the row's own pointer-only count. Syntology's record for this page last changed 2026-10-05 ; when this build read Syntology's graph is in the build record . Per-sample status is on the paper page; each Ran cell links to that paper's sample list. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect .
Since the archive Syntology
Of the 8,888 newer papers whose tables Syntology has read (8,886 checked in full and 2 with a leaderboard still awaiting a verdict), 1 had this board among the leaderboards the extractor considered for their tables (it keeps at most 10 boards per paper and 4 per dataset; the lists of 1,595 of the 8,888 were already full without this board, so if it was crowded out of them it is not counted), and none proposed a result, so none await a verdict and none were placed. Syntology has checked 8,886 of the 18,637 papers on this site that are newer than the archive (for 3,717 of them no archive leaderboard matched the paper's tables, so there was nothing further to check); 733 were read and have nothing to place (arXiv has no HTML version of the paper, or that version has no tables), 41 could not be read (the extractor's reply could not be parsed), and results from the other 8,977 appear after they are checked.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections