{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/unleashing-the-strengths-of-unlabeled-data-in","title":"Unleashing the Strengths of Unlabeled Data in Pan-cancer Abdominal Organ Quantification: the FLARE22 Challenge","arxiv_id":"2308.05862","date":"2023-08-10","proceeding":null,"authors":["Jun Ma","Yao Zhang","Song Gu","Cheng Ge","Shihao Ma","Adamo Young","Cheng Zhu","Kangkang Meng","Xin Yang","Ziyan Huang","Fan Zhang","Wentao Liu","YuanKe Pan","Shoujin Huang","Jiacheng Wang","Mingze Sun","Weixin Xu","Dengqiang Jia","Jae Won Choi","Natália Alves","Bram de Wilde","Gregor Koehler","Yajun Wu","Manuel Wiesenfarth","Qiongjie Zhu","Guoqiang Dong","Jian He","the FLARE Challenge Consortium","Bo wang"],"abstract":"Quantitative organ assessment is an essential step in automated abdominal disease diagnosis and treatment planning. Artificial intelligence (AI) has shown great potential to automatize this process. However, most existing AI algorithms rely on many expert annotations and lack a comprehensive evaluation of accuracy and efficiency in real-world multinational settings. To overcome these limitations, we organized the FLARE 2022 Challenge, the largest abdominal organ analysis challenge to date, to benchmark fast, low-resource, accurate, annotation-efficient, and generalized AI algorithms. We constructed an intercontinental and multinational dataset from more than 50 medical groups, including Computed Tomography (CT) scans with different races, diseases, phases, and manufacturers. We independently validated that a set of AI algorithms achieved a median Dice Similarity Coefficient (DSC) of 90.0\\% by using 50 labeled scans and 2000 unlabeled scans, which can significantly reduce annotation requirements. The best-performing algorithms successfully generalized to holdout external validation sets, achieving a median DSC of 89.5\\%, 90.9\\%, and 88.3\\% on North American, European, and Asian cohorts, respectively. They also enabled automatic extraction of key organ biology features, which was labor-intensive with traditional manual measurements. This opens the potential to use unlabeled data to boost performance and alleviate annotation shortages for modern AI models.","url_abs":"https://arxiv.org/abs/2308.05862v1","url_pdf":"https://arxiv.org/pdf/2308.05862v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"unleashing-the-strengths-of-unlabeled-data-in","repo_url":"https://github.com/junma11/flare","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"unleashing-the-strengths-of-unlabeled-data-in","repo_url":"https://github.com/kimjisoo12/guidednet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"computed-tomography-ct","task_name":"Computed Tomography (CT)"}],"methods":[{"method_slug":null,"method_name":"American"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2308.05862","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.05862"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kimjisoo12/guidednet","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/junma11/flare","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":6},"by_repo_kind":{"official":{"samples":6,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"658a889255ae9e3f","entry":"check_dir","repo":"junma11/flare","repo_kind":"official","path":"FLARE23/resource_eval.py","file_url":"https://github.com/junma11/flare/blob/HEAD/FLARE23/resource_eval.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"658a889255ae9e3f"}},{"code_sha256_prefix":"cf3ad2dd74663e2e","entry":"compute_average_surface_distance","repo":"junma11/flare","repo_kind":"official","path":"FLARE23/SurfaceDice.py","file_url":"https://github.com/junma11/flare/blob/HEAD/FLARE23/SurfaceDice.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cf3ad2dd74663e2e"}},{"code_sha256_prefix":"b9353805b904f7d9","entry":"compute_robust_hausdorff","repo":"junma11/flare","repo_kind":"official","path":"FLARE23/SurfaceDice.py","file_url":"https://github.com/junma11/flare/blob/HEAD/FLARE23/SurfaceDice.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b9353805b904f7d9"}},{"code_sha256_prefix":"7dc01eff6c76b4c8","entry":"compute_surface_distances","repo":"junma11/flare","repo_kind":"official","path":"FLARE23/SurfaceDice.py","file_url":"https://github.com/junma11/flare/blob/HEAD/FLARE23/SurfaceDice.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7dc01eff6c76b4c8"}},{"code_sha256_prefix":"f5db63a2c8eac83a","entry":"find_lower_upper_zbound","repo":"junma11/flare","repo_kind":"official","path":"FLARE24/T2andT3_FLARE24_DSC_NSD_Eval.py","file_url":"https://github.com/junma11/flare/blob/HEAD/FLARE24/T2andT3_FLARE24_DSC_NSD_Eval.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f5db63a2c8eac83a"}},{"code_sha256_prefix":"5c4a79a97bc303fa","entry":"find_lower_upper_zbound","repo":"junma11/flare","repo_kind":"official","path":"FLARE23/FLARE23_DSC_NSD_Eval.py","file_url":"https://github.com/junma11/flare/blob/HEAD/FLARE23/FLARE23_DSC_NSD_Eval.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5c4a79a97bc303fa"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}