Papers › 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation

3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation

21 Jun 2016arXiv:1606.06650archive 2025-07-28

Özgün Çiçek, Ahmed Abdulkadir, Soeren S. Lienkamp, Thomas Brox, Olaf Ronneberger

This paper introduces a network for volumetric segmentation that learns from sparsely annotated volumetric images. We outline two attractive use cases of this method: (1) In a semi-automated setup, the user annotates some slices in the volume to be segmented. The network learns from these sparse annotations and provides a dense 3D segmentation. (2) In a fully-automated setup, we assume that a representative, sparsely annotated training set exists. Trained on this data set, the network densely segments new volumetric images. The proposed network extends the previous u-net architecture from Ronneberger et al. by replacing all 2D operations with their 3D counterparts. The implementation performs on-the-fly elastic deformations for efficient data augmentation during training. It is trained end-to-end from scratch, i.e., no pre-trained network is required. We test the performance of the proposed method on a complex, highly variable 3D structure, the Xenopus kidney, and achieve good results for both use cases.

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1606.06650")

Code

Syntology Ran 53 of 76 code samples harvested from 13 repositories linked to this paper; 23 have no recorded run. Of those that ran: 4 ran · honoured contract; 11 ran · our draft was wrong; 4 ran · fixture could not drive it; 34 ran with no contract checked.

By repository: community (archive-listed): 76 samples from 13 repositories, 53 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

27 repositories listed; official and paper-mentioned ones first.

AghdamAmir/3D-UNet mentioned on GitHubpytorch report
Iammuratc/grainDetection mentioned on GitHub report
Shrajan/AAAI-2022 mentioned on GitHubpytorch report
Shrajan/IB_U_Nets mentioned on GitHubpytorch report
UdonDa/3D-UNet-PyTorch mentioned on GitHubpytorch report
black0017/MedicalZooPytorch mentioned on GitHubpytorch report
chenyizi086/wu.2023.sigspatial mentioned on GitHubpytorch report
edraizen/molmimic mentioned on GitHubpytorch report
elektronn/elektronn3 mentioned on GitHubpytorch report
fepegar/unet mentioned on GitHubpytorch report
gvtulder/elasticdeform mentioned on GitHubtfNOASSERTION report
jamiljami/Unet mentioned on GitHub report
kilgore92/PyTorch-UNet mentioned on GitHubpytorchMIT report
leohsuofnthu/Pytorch-IterativeFCN mentioned on GitHubpytorch report
lyqcom/3d-unet mentioned on GitHubmindsporeApache-2.0 report
mlf-core/liver-ct-segmentation mentioned on GitHubpytorch report
qsyao/cuda_spatial_deform mentioned on GitHub report
wolny/pytorch-3dunet mentioned on GitHubpytorch report
jiajun169/mindspore_models mindsporeApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

76 samples harvested; 53 ran; 4 honoured the contract we drafted; 23 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

4ran · honoured contract
11ran · our draft was wrong
4ran · fixture could not drive it
34ran
23unverified

Licence: 20 of the 76 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 13 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

AbstractUpsampling wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran fingerprinted MIT (permissive) · bd5255830dbc70df · report
Bottom Shrajan/AAAI-2022/networks/unet.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · bd5f5829c2ce4f4a · report
ChannelSELayer3D wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran MIT (permissive) · d8c51afcfab2dccb · report
ChannelSpatialSELayer3D wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran MIT (permissive) · e48fc3ac38e078bb · report
Conv3DBlock AghdamAmir/3D-UNet/unet3d.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · 961a837607030f03 · report
Conv3x3 Shrajan/AAAI-2022/networks/unet.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · 002f393823c7b57c · report
ConvBlock mlf-core/liver-ct-segmentation/liver_ct_segmentation/model/unet_3d_models.py community (archive-listed) ran · metamorphic tier: invariant MIT (permissive) · 86cf127000aad21a · report
ConvolutionalBlock fepegar/unet/unet/unet.py community (archive-listed) ran fingerprinted MIT (permissive) · 7bc5f5b5c8b2e7be · report
Decoder Shrajan/AAAI-2022/networks/unet.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · 92c21f0cfe8583db · report
DecodingBlock fepegar/unet/unet/unet.py community (archive-listed) ran MIT (permissive) · 44f8060512ddb75c · report
DownConv elektronn/elektronn3/elektronn3/models/unet.py community (archive-listed) ran fingerprinted MIT (permissive) · 4fbc8e441e25d534 · report
DownSamplingBlock mlf-core/liver-ct-segmentation/liver_ct_segmentation/model/unet_3d_models.py community (archive-listed) ran MIT (permissive) · 84be777da492a5a6 · report
Encoder Shrajan/AAAI-2022/networks/unet.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · c1d32ca647fc4e21 · report
EncodingBlock fepegar/unet/unet/unet.py community (archive-listed) ran fingerprinted MIT (permissive) · d10aff0e169c4244 · report
GridAttention elektronn/elektronn3/elektronn3/models/unet.py community (archive-listed) ran fingerprinted MIT (permissive) · 74dfc4e293ff8a68 · report
InputBlock mlf-core/liver-ct-segmentation/liver_ct_segmentation/model/unet_3d_models.py community (archive-listed) ran · metamorphic tier: invariant MIT (permissive) · d7c2338ecaef5f6f · report
InterpolateUpsampling wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran fingerprinted MIT (permissive) · 5312c997daffbe4f · report
NoUpsampling wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran fingerprinted MIT (permissive) · b71250ad47097e99 · report
OutputBlock mlf-core/liver-ct-segmentation/liver_ct_segmentation/model/unet_3d_models.py community (archive-listed) ran · metamorphic tier: invariant MIT (permissive) · fdd735c8d5934a67 · report
ResNetBlock wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran MIT (permissive) · e2c1fc74b0aa7fc6 · report
ResNetBlockSE wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran MIT (permissive) · fba2e5652d7a6ce1 · report
SingleConv wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran MIT (permissive) · 26f42cb5865457f1 · report
SpatialSELayer3D wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran MIT (permissive) · 0ae1c43a043456ae · report
TConv Shrajan/AAAI-2022/networks/unet.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · f9811d05b5c818c0 · report
TransposeConvUpsampling wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran MIT (permissive) · cb3c64452fa192f4 · report
UNet Shrajan/AAAI-2022/networks/unet.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · 5d0be67e9ea65011 · report
UNet3D wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran MIT (permissive) · c59e8b03c790e76b · report
UNet3D chenyizi086/wu.2023.sigspatial/model/unet3d/unet3d.py community (archive-listed) ran no licence file found · pointer only · a23aa4c62d2ced83 · report
UNet3D AghdamAmir/3D-UNet/unet3d.py community (archive-listed) ran · metamorphic tier: invariant no licence file found · pointer only · 35a374cce6fae706 · report
UpConv3DBlock AghdamAmir/3D-UNet/unet3d.py community (archive-listed) ran · metamorphic tier: invariant no licence file found · pointer only · fc75937f18b2d1a0 · report
UpSamplingBlock mlf-core/liver-ct-segmentation/liver_ct_segmentation/model/unet_3d_models.py community (archive-listed) ran · metamorphic tier: invariant fingerprinted MIT (permissive) · 723045ebfbbe3377 · report
bool_to_int qsyao/cuda_spatial_deform/cuda_backend/py_api.py community (archive-listed) ran · honoured contract fingerprinted licence not identified · pointer only · 3ae04df8b3a499d0 · report
center_in chenyizi086/wu.2023.sigspatial/model/unet3d/unet3d.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 6322564404e6ac5b · report
center_out chenyizi086/wu.2023.sigspatial/model/unet3d/unet3d.py community (archive-listed) ran no licence file found · pointer only · 00e223e69984d6d2 · report
conv_block chenyizi086/wu.2023.sigspatial/model/unet3d/unet3d.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · aaac350375676434 · report
conv_block_2_3d UdonDa/3D-UNet-PyTorch/src/model.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 769628dc3a9af468 · report
conv_block_3d UdonDa/3D-UNet-PyTorch/src/model.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 520950cb24a9041a · report
conv_trans_block_3d UdonDa/3D-UNet-PyTorch/src/model.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 74e9ef01fdad6274 · report
create_conv wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran · our draft was wrong MIT (permissive) · d0ca7c4c392589d5 · report
create_matrix_rotation_x_3d qsyao/cuda_spatial_deform/deform.py community (archive-listed) ran · honoured contract licence not identified · pointer only · aea00ce54798f811 · report
create_zero_centered_coordinate_mesh qsyao/cuda_spatial_deform/deform.py community (archive-listed) ran · fixture could not drive it licence not identified · pointer only · fdaa4b7e9a216060 · report
fix_upsampling_type fepegar/unet/unet/unet.py community (archive-listed) ran · our draft was wrong fingerprinted MIT (permissive) · 48a77a4b4c6899cd · report
get_conv elektronn/elektronn3/elektronn3/models/unet.py community (archive-listed) ran · fixture could not drive it MIT (permissive) · d473e9bce385040b · report
get_conv_transpose_layer fepegar/unet/unet/unet.py community (archive-listed) ran · our draft was wrong MIT (permissive) · ea1e09fb045807d8 · report
get_convtranspose elektronn/elektronn3/elektronn3/models/unet.py community (archive-listed) ran · fixture could not drive it MIT (permissive) · a3169a7b1435e0dc · report
get_downsampling_layer fepegar/unet/unet/unet.py community (archive-listed) ran · our draft was wrong MIT (permissive) · abe939ebcfbefc61 · report
get_maxpool elektronn/elektronn3/elektronn3/models/unet.py community (archive-listed) ran · fixture could not drive it MIT (permissive) · a12e2f04ad60d321 · report
get_upsampling_layer fepegar/unet/unet/unet.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 29992fbf80f8c0a1 · report
max_pooling_3d UdonDa/3D-UNet-PyTorch/src/model.py community (archive-listed) ran MIT (permissive) · a5b542b783b2f9c1 · report
number_of_features_per_level wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · 9c4cd085f7952fa0 · report
run fepegar/unet/tests/test_unet.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 12ba822b7c231300 · report
scale_coords qsyao/cuda_spatial_deform/deform.py community (archive-listed) ran · honoured contract fingerprinted licence not identified · pointer only · a7d7bc408835cb44 · report
up_conv_block chenyizi086/wu.2023.sigspatial/model/unet3d/unet3d.py community (archive-listed) ran no licence file found · pointer only · 38e1ecb8f675c611 · report
AbstractUNet wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) unverified MIT (permissive) · d98c95b8fc1ede43 · report
Decoder fepegar/unet/unet/unet.py community (archive-listed) unverified MIT (permissive) · 0e22a90528c239e0 · report
Decoder wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) unverified MIT (permissive) · d6b608560176497b · report
DoubleConv wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) unverified MIT (permissive) · 00cd22c3bcba8bf8 · report
Encoder fepegar/unet/unet/unet.py community (archive-listed) unverified MIT (permissive) · 8254969b26258f52 · report
Encoder wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) unverified MIT (permissive) · d42847dc9240c8d5 · report
IterativeFCN leohsuofnthu/Pytorch-IterativeFCN/iterativeFCN.py community (archive-listed) unverified no licence file found · pointer only · a1d5172c411b098d · report
UNet fepegar/unet/unet/unet.py community (archive-listed) unverified MIT (permissive) · 6103d27eb89d2193 · report
UNet elektronn/elektronn3/elektronn3/models/unet.py community (archive-listed) unverified MIT (permissive) · 7a32dce4d065a404 · report
UNet UdonDa/3D-UNet-PyTorch/src/model.py community (archive-listed) unverified MIT (permissive) · 08a841012a2f2d6c · report
UNet3D fepegar/unet/unet/unet.py community (archive-listed) unverified MIT (permissive) · e25b932cbe95a18e · report
UNet3D mlf-core/liver-ct-segmentation/liver_ct_segmentation/model/unet_3d_models.py community (archive-listed) unverified MIT (permissive) · 21dc7d3844afe540 · report
UpConv elektronn/elektronn3/elektronn3/models/unet.py community (archive-listed) unverified MIT (permissive) · 54df8e2e39fdda93 · report
a_cosine_learning_rate jiajun169/mindspore_models/Unet3d/src/lr_schedule.py community (archive-listed) unverified Apache-2.0 (permissive) · 316fb42e9e6ed79e · report
correct_nifti_head lyqcom/3d-unet/src/utils.py community (archive-listed) unverified Apache-2.0 (permissive) · 6e413b6f8321f25a · report
create_decoders wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) unverified MIT (permissive) · 1682295cd0093044 · report
create_encoders wolny/pytorch-3dunet/pytorch3dunet/unet3d/model.py community (archive-listed) unverified MIT (permissive) · 27fd44d28f16c5a5 · report
dynamic_lr jiajun169/mindspore_models/Unet3d/src/lr_schedule.py community (archive-listed) unverified Apache-2.0 (permissive) · 90a0e8705a358db8 · report
first lyqcom/3d-unet/src/utils.py community (archive-listed) unverified Apache-2.0 (permissive) · 42ad2df596a897dd · report
get_list_of_files_in_dir jiajun169/mindspore_models/Unet3d/src/convert_nifti.py community (archive-listed) unverified Apache-2.0 (permissive) · 77063b815fa723a0 · report
get_random_patch lyqcom/3d-unet/src/utils.py community (archive-listed) unverified Apache-2.0 (permissive) · 47769d97406c079f · report
linear_warmup_learning_rate jiajun169/mindspore_models/Unet3d/src/lr_schedule.py community (archive-listed) unverified Apache-2.0 (permissive) · d6a99ec714147ac1 · report
unet3D Iammuratc/grainDetection/model.py community (archive-listed) unverified no licence file found · pointer only · e96116a2cbef22f9 · report

Tasks

3D Instance SegmentationData AugmentationMachine TranslationSegmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Instance Segmentation ScanNet(v2) UNet-Backbone mAP @ 50 31.9 #29 of 32 Archive leaderboard report
3D Part Segmentation ShapeNet-Part 3D-UNet [Cicek:2016un] Instance Average IoU 84.6 #60 of 67 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Concatenated Skip ConnectionConvolutionMax PoolingReLUU-Net

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections