{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-kits21-challenge-automatic-segmentation","title":"The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CT","arxiv_id":"2307.01984","date":"2023-07-05","proceeding":null,"authors":["Nicholas Heller","Fabian Isensee","Dasha Trofimova","Resha Tejpaul","Zhongchen Zhao","Huai Chen","Lisheng Wang","Alex Golts","Daniel Khapun","Daniel Shats","Yoel Shoshan","Flora Gilboa-Solomon","Yasmeen George","Xi Yang","Jianpeng Zhang","Jing Zhang","Yong Xia","Mengran Wu","Zhiyang Liu","Ed Walczak","Sean McSweeney","Ranveer Vasdev","Chris Hornung","Rafat Solaiman","Jamee Schoephoerster","Bailey Abernathy","David Wu","Safa Abdulkadir","Ben Byun","Justice Spriggs","Griffin Struyk","Alexandra Austin","Ben Simpson","Michael Hagstrom","Sierra Virnig","John French","Nitin Venkatesh","Sarah Chan","Keenan Moore","Anna Jacobsen","Susan Austin","Mark Austin","Subodh Regmi","Nikolaos Papanikolopoulos","Christopher Weight"],"abstract":"This paper presents the challenge report for the 2021 Kidney and Kidney Tumor Segmentation Challenge (KiTS21) held in conjunction with the 2021 international conference on Medical Image Computing and Computer Assisted Interventions (MICCAI). KiTS21 is a sequel to its first edition in 2019, and it features a variety of innovations in how the challenge was designed, in addition to a larger dataset. A novel annotation method was used to collect three separate annotations for each region of interest, and these annotations were performed in a fully transparent setting using a web-based annotation tool. Further, the KiTS21 test set was collected from an outside institution, challenging participants to develop methods that generalize well to new populations. Nonetheless, the top-performing teams achieved a significant improvement over the state of the art set in 2019, and this performance is shown to inch ever closer to human-level performance. An in-depth meta-analysis is presented describing which methods were used and how they faired on the leaderboard, as well as the characteristics of which cases generally saw good performance, and which did not. Overall KiTS21 facilitated a significant advancement in the state of the art in kidney tumor segmentation, and provides useful insights that are applicable to the field of semantic segmentation as a whole.","url_abs":"https://arxiv.org/abs/2307.01984v1","url_pdf":"https://arxiv.org/pdf/2307.01984v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-kits21-challenge-automatic-segmentation","repo_url":"https://github.com/neheller/kits21","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"tumor-segmentation","task_name":"Tumor Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.01984","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.01984"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/neheller/kits21","reach":null}],"summary":{"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":2,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"43a77d4e597eba9a","entry":"get_all_region_dirs","repo":"neheller/kits21","repo_kind":"official","path":"kits21/annotation/import.py","file_url":"https://github.com/neheller/kits21/blob/HEAD/kits21/annotation/import.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"43a77d4e597eba9a"}},{"code_sha256_prefix":"443e438692d931d4","entry":"get_region_dir","repo":"neheller/kits21","repo_kind":"official","path":"kits21/annotation/import.py","file_url":"https://github.com/neheller/kits21/blob/HEAD/kits21/annotation/import.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"443e438692d931d4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}