{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-medical-segmentation-decathlon","title":"The Medical Segmentation Decathlon","arxiv_id":"2106.05735","date":"2021-06-10","proceeding":null,"authors":["Michela Antonelli","Annika Reinke","Spyridon Bakas","Keyvan Farahani","AnnetteKopp-Schneider","Bennett A. Landman","Geert Litjens","Bjoern Menze","Olaf Ronneberger","Ronald M. Summers","Bram van Ginneken","Michel Bilello","Patrick Bilic","Patrick F. Christ","Richard K. G. Do","Marc J. Gollub","Stephan H. Heckers","William R. Jarnagin","Maureen K. McHugo","Sandy Napel","Jennifer S. Goli Pernicka","Kawal Rhode","Catalina Tobon-Gomez","Eugene Vorontsov","Henkjan Huisman","James A. Meakin","Sebastien Ourselin","Manuel Wiesenfarth","Pablo Arbelaez","Byeonguk Bae","Sihong Chen","Laura Daza","Jianjiang Feng","Baochun He","Fabian Isensee","Yuanfeng Ji","Fucang Jia","Namkug Kim","Ildoo Kim","Dorit Merhof","Akshay Pai","Beomhee Park","Mathias Perslev","Ramin Rezaiifar","Oliver Rippel","Ignacio Sarasua","Wei Shen","Jaemin Son","Christian Wachinger","Liansheng Wang","Yan Wang","Yingda Xia","Daguang Xu","Zhanwei Xu","Yefeng Zheng","Amber L. Simpson","Lena Maier-Hein","M. Jorge Cardoso"],"abstract":"International challenges have become the de facto standard for comparative assessment of image analysis algorithms given a specific task. Segmentation is so far the most widely investigated medical image processing task, but the various segmentation challenges have typically been organized in isolation, such that algorithm development was driven by the need to tackle a single specific clinical problem. We hypothesized that a method capable of performing well on multiple tasks will generalize well to a previously unseen task and potentially outperform a custom-designed solution. To investigate the hypothesis, we organized the Medical Segmentation Decathlon (MSD) - a biomedical image analysis challenge, in which algorithms compete in a multitude of both tasks and modalities. The underlying data set was designed to explore the axis of difficulties typically encountered when dealing with medical images, such as small data sets, unbalanced labels, multi-site data and small objects. The MSD challenge confirmed that algorithms with a consistent good performance on a set of tasks preserved their good average performance on a different set of previously unseen tasks. Moreover, by monitoring the MSD winner for two years, we found that this algorithm continued generalizing well to a wide range of other clinical problems, further confirming our hypothesis. Three main conclusions can be drawn from this study: (1) state-of-the-art image segmentation algorithms are mature, accurate, and generalize well when retrained on unseen tasks; (2) consistent algorithmic performance across multiple tasks is a strong surrogate of algorithmic generalizability; (3) the training of accurate AI segmentation models is now commoditized to non AI experts.","url_abs":"https://arxiv.org/abs/2106.05735v1","url_pdf":"https://arxiv.org/pdf/2106.05735v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-medical-segmentation-decathlon","repo_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2106.05735","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.05735"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":9},"by_repo_kind":{"listed":{"samples":9,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"55c491331fb03c16","entry":"dice_coefficient","repo":"tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","repo_kind":"listed","path":"segmentation_losses.py","file_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow/blob/HEAD/segmentation_losses.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"55c491331fb03c16"}},{"code_sha256_prefix":"429dba7efc52d89d","entry":"dice_coefficient_binary","repo":"tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","repo_kind":"listed","path":"segmentation_losses.py","file_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow/blob/HEAD/segmentation_losses.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"429dba7efc52d89d"}},{"code_sha256_prefix":"a036a5593e08b1b0","entry":"dice_loss","repo":"tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","repo_kind":"listed","path":"segmentation_losses.py","file_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow/blob/HEAD/segmentation_losses.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a036a5593e08b1b0"}},{"code_sha256_prefix":"3712ead23ff0f9b1","entry":"generate_model_prediction","repo":"tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","repo_kind":"listed","path":"generate_prediction_files_for_challenge_submission.py","file_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow/blob/HEAD/generate_prediction_files_for_challenge_submission.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3712ead23ff0f9b1"}},{"code_sha256_prefix":"ba859058bfab9035","entry":"set_tensorflow_mirrored_strategy_gpu_devices_list","repo":"tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","repo_kind":"listed","path":"train_unet_segmentation_model.py","file_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow/blob/HEAD/train_unet_segmentation_model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ba859058bfab9035"}},{"code_sha256_prefix":"4e50db17fbb87fc5","entry":"standardize","repo":"tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","repo_kind":"listed","path":"generate_prediction_files_for_challenge_submission.py","file_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow/blob/HEAD/generate_prediction_files_for_challenge_submission.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e50db17fbb87fc5"}},{"code_sha256_prefix":"85683318706e43ef","entry":"unet_3d_conv3dtranspose_dropout","repo":"tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","repo_kind":"listed","path":"model.py","file_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow/blob/HEAD/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"85683318706e43ef"}},{"code_sha256_prefix":"0364327269701c67","entry":"unet_3d_upsampling_batchnormalization","repo":"tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","repo_kind":"listed","path":"model.py","file_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow/blob/HEAD/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0364327269701c67"}},{"code_sha256_prefix":"533b4851f6eba632","entry":"unet_3d_upsampling_dropout","repo":"tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow","repo_kind":"listed","path":"model.py","file_url":"https://github.com/tamerthamoqa/3D-mri-brain-tumour-image-segmentation-medical-decathlon-tensorflow/blob/HEAD/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"533b4851f6eba632"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}