Papers › Fully Convolutional Networks for Semantic Segmentation

Fully Convolutional Networks for Semantic Segmentation

20 May 2016CVPR 2015arXiv:1605.06211archive 2025-07-28

Evan Shelhamer, Jonathan Long, Trevor Darrell

Convolutional networks are powerful visual models that yield hierarchies of features. We show that convolutional networks by themselves, trained end-to-end, pixels-to-pixels, improve on the previous best result in semantic segmentation. Our key insight is to build "fully convolutional" networks that take input of arbitrary size and produce correspondingly-sized output with efficient inference and learning. We define and detail the space of fully convolutional networks, explain their application to spatially dense prediction tasks, and draw connections to prior models. We adapt contemporary classification networks (AlexNet, the VGG net, and GoogLeNet) into fully convolutional networks and transfer their learned representations by fine-tuning to the segmentation task. We then define a skip architecture that combines semantic information from a deep, coarse layer with appearance information from a shallow, fine layer to produce accurate and detailed segmentations. Our fully convolutional network achieves improved segmentation of PASCAL VOC (30% relative improvement to 67.2% mean IU on 2012), NYUDv2, SIFT Flow, and PASCAL-Context, while inference takes one tenth of a second for a typical image.

PaperPDFCode

Syntology This paper's arXiv id is not in Syntology's Atlas id list (549,449 ids, as this build read them; the read time is in the build record), so this page links to no Syntology page for it. The list is not the whole graph; Syntology's feed shows papers as they enter the graph.

Code

37 repositories listed; official and paper-mentioned ones first.

AzogDefiler/Sandbox mentioned on GitHubSyntology: not harvested report
Ceachi/Project-Self-Driving-Car-Advanced-Lane-Lines mentioned on GitHubMITSyntology: not harvested report
ChenMicky/FCN mentioned on GitHubtfSyntology: not harvested report
DaiLisen/Eye-gaze-Point-Detection-Modified-sec- mentioned on GitHubcaffe2Syntology: not harvested report
DrBoltzmann/CarND-Semantic-Segmentation mentioned on GitHubtfSyntology: not harvested report
Lxrd-AJ/Advanced_ML mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution,... (arXiv:1606.00915; that paper's own run record: 43 ran (of which 12 constructed an object rather than computing a result; 35 with no instrument failure: 1 honoured, 0 violated, 34 with no contract checked; 8 where Syntology's instrument failed) · 20 unverified); nothing checks that they implement this paper's method. report
Osdel/ssnets mentioned on GitHubtfSyntology: not harvested report
TejasBajania/Mtech_pro mentioned on GitHubSyntology: not harvested report
TejasBajania/Mtech_thesis_project mentioned on GitHubSyntology: not harvested report
cciprianmihai/Self_Driving_Car_NanoDegree_P2_AdvancedLaneLines mentioned on GitHubMITSyntology: not harvested report
cooparation/FCN_play mentioned on GitHubSyntology: not harvested report
fmahoudeau/fcn mentioned on GitHubtfSyntology: not harvested report
geodekid/FCN mentioned on GitHubcaffe2Syntology: not harvested report
hgjeon/CarND-Semantic-Segmentation mentioned on GitHubtfSyntology: not harvested report
kevinddchen/Keras-FCN mentioned on GitHubtfSyntology: not harvested report
rickyHong/FCN-segmentation-repl mentioned on GitHubcaffe2Syntology: not harvested report
shekkizh/FCN.tensorflow mentioned on GitHubtfSyntology: not harvested report
shelhamer/fcn.berkeleyvision.org mentioned on GitHubcaffe2Syntology: not harvested report
waspinator/deep-learning-explorer mentioned on GitHubApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Mask R-CNN (arXiv:1703.06870; that paper's own run record: 101 ran (of which 3 constructed an object rather than computing a result; 77 with no instrument failure: 2 honoured, 1 violated, 74 with no contract checked; 24 where Syntology's instrument failed) · 39 unverified); nothing checks that they implement this paper's method. report
2023-MindSpore-1/ms-code-15 mindsporeSyntology: not harvested report
2023-MindSpore-1/ms-code-213 mindsporeSyntology: not harvested report
2023-MindSpore-1/ms-code-42 mindsporeSyntology: not harvested report
2023-MindSpore-4/Code10 mindsporeSyntology: not harvested report
Burf/tfdetection tfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks (arXiv:1506.01497; that paper's own run record: 79 ran (of which 9 constructed an object rather than computing a result; 47 with no instrument failure: 18 honoured, 5 violated, 24 with no contract checked; 32 where Syntology's instrument failed) · 45 unverified), Wide Residual Networks (arXiv:1605.07146; that paper's own run record: 66 ran (of which 31 constructed an object rather than computing a result; 47 with no instrument failure: 0 honoured, 0 violated, 47 with no contract checked; 19 where Syntology's instrument failed) · 30 unverified), Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation (arXiv:1802.02611; that paper's own run record: 44 ran (of which 17 constructed an object rather than computing a result; 28 with no instrument failure: 2 honoured, 0 violated, 26 with no contract checked; 16 where Syntology's instrument failed) · 28 unverified) and 1 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
JanMarcelKezmann/TensorFlow-Advanced-Segmentation-Models tfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation (arXiv:1802.02611; that paper's own run record: 44 ran (of which 17 constructed an object rather than computing a result; 28 with no instrument failure: 2 honoured, 0 violated, 26 with no contract checked; 16 where Syntology's instrument failed) · 28 unverified); nothing checks that they implement this paper's method. report
MindSpore-paper-code-3/code10 mindsporeSyntology: not harvested report
PaddlePaddle/PaddleSeg paddleSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flow (arXiv:2109.09406; that paper's own run record: 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
PuchatekwSzortach/voc_fcn tfSyntology: not harvested report
mindspore-ai/models mindsporeSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to AdaBin: Improving Binary Neural Networks with Adaptive Binary Sets (arXiv:2208.08084; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
osmr/imgclsmob mxnetMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ResNeSt: Split-Attention Networks (arXiv:2004.08955; that paper's own run record: 28 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 0 violated, 21 with no contract checked; 7 where Syntology's instrument failed) · 20 unverified); nothing checks that they implement this paper's method. report
petko-nikolov/pysemseg pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to U-Net: Convolutional Networks for Biomedical Image Segmentation (arXiv:1505.04597; that paper's own run record: 530 ran (of which 247 constructed an object rather than computing a result; 378 with no instrument failure: 18 honoured, 10 violated, 350 with no contract checked; 152 where Syntology's instrument failed) · 227 unverified), The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation (arXiv:1611.09326; that paper's own run record: 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 12 unverified) and Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation (arXiv:1802.02611; that paper's own run record: 44 ran (of which 17 constructed an object rather than computing a result; 28 with no instrument failure: 2 honoured, 0 violated, 26 with no contract checked; 16 where Syntology's instrument failed) · 28 unverified); nothing checks that they implement this paper's method. report
pytorch/vision pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Going Deeper with Convolutions (arXiv:1409.4842; that paper's own run record: 34 ran (of which 19 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 0 violated, 29 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified), Deep Residual Learning for Image Recognition (arXiv:1512.03385; that paper's own run record: 254 ran (of which 108 constructed an object rather than computing a result; 163 with no instrument failure: 3 honoured, 1 violated, 159 with no contract checked; 91 where Syntology's instrument failed) · 123 unverified), Deep Networks with Stochastic Depth (arXiv:1603.09382; that paper's own run record: 8 ran (of which 5 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified) and 7 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
usuyama/pytorch-unet pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to U-Net: Convolutional Networks for Biomedical Image Segmentation (arXiv:1505.04597; that paper's own run record: 530 ran (of which 247 constructed an object rather than computing a result; 378 with no instrument failure: 18 honoured, 10 violated, 350 with no contract checked; 152 where Syntology's instrument failed) · 227 unverified); nothing checks that they implement this paper's method. report
wkentaro/pytorch-fcn caffe2Syntology: not harvested report
zj603252818/FCN8s mindsporeSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Real-Time Semantic SegmentationScene SegmentationSegmentationSemantic SegmentationVideo Semantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Scene Segmentation SUN-RGBD FCN Mean IoU 27.39 #5 of 5 Archive leaderboard report
Semantic Segmentation Cityscapes test FCN Mean IoU (class) 65.3% #95 of 105 Archive leaderboard report
Semantic Segmentation NYU Depth v2 FCN-32s RGB-HHA Mean Accuracy 44 #121 of 121 Archive leaderboard report
Semantic Segmentation PASCAL VOC 2011 test FCN-VGG16 Mean IoU 32 #2 of 3 Archive leaderboard report
Semantic Segmentation PASCAL VOC 2011 test FCN-pool4 Mean IoU 22.4 #3 of 3 Archive leaderboard report
Video Semantic Segmentation Cityscapes val FCN-50 [14] mIoU 70.1 #8 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: FCN, Transposed convolution

ConvolutionDense ConnectionsDropoutFCNMax PoolingReLUSoftmaxTransposed convolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections