{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/stochastic-segmentation-with-conditional","title":"Stochastic Segmentation with Conditional Categorical Diffusion Models","arxiv_id":"2303.08888","date":"2023-03-15","proceeding":"ICCV 2023 1","authors":["Lukas Zbinden","Lars Doorenbos","Theodoros Pissas","Adrian Thomas Huber","Raphael Sznitman","Pablo Márquez-Neila"],"abstract":"Semantic segmentation has made significant progress in recent years thanks to deep neural networks, but the common objective of generating a single segmentation output that accurately matches the image's content may not be suitable for safety-critical domains such as medical diagnostics and autonomous driving. Instead, multiple possible correct segmentation maps may be required to reflect the true distribution of annotation maps. In this context, stochastic semantic segmentation methods must learn to predict conditional distributions of labels given the image, but this is challenging due to the typically multimodal distributions, high-dimensional output spaces, and limited annotation data. To address these challenges, we propose a conditional categorical diffusion model (CCDM) for semantic segmentation based on Denoising Diffusion Probabilistic Models. Our model is conditioned to the input image, enabling it to generate multiple segmentation label maps that account for the aleatoric uncertainty arising from divergent ground truth annotations. Our experimental results show that CCDM achieves state-of-the-art performance on LIDC, a stochastic semantic segmentation dataset, and outperforms established baselines on the classical segmentation dataset Cityscapes.","url_abs":"https://arxiv.org/abs/2303.08888v5","url_pdf":"https://arxiv.org/pdf/2303.08888v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"stochastic-segmentation-with-conditional","repo_url":"https://github.com/larsdoorenbos/ccdm-stochastic-segmentation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2303.08888","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.08888"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/larsdoorenbos/ccdm-stochastic-segmentation","reach":null}],"summary":{"ran":2,"ran_honours":2,"unverified":1},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c8072dbcae9b1fb6","entry":"DiffusionModel","repo":"larsdoorenbos/ccdm-stochastic-segmentation","repo_kind":"official","path":"ddpm/models/diffusion_denoising.py","file_url":"https://github.com/larsdoorenbos/ccdm-stochastic-segmentation/blob/HEAD/ddpm/models/diffusion_denoising.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c8072dbcae9b1fb6"}},{"code_sha256_prefix":"9987c4533b204d7b","entry":"OneHotCategoricalBCHW","repo":"larsdoorenbos/ccdm-stochastic-segmentation","repo_kind":"official","path":"ddpm/models/diffusion_denoising.py","file_url":"https://github.com/larsdoorenbos/ccdm-stochastic-segmentation/blob/HEAD/ddpm/models/diffusion_denoising.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9987c4533b204d7b"}},{"code_sha256_prefix":"8fe4b00f6864101e","entry":"cosine_schedule","repo":"larsdoorenbos/ccdm-stochastic-segmentation","repo_kind":"official","path":"ddpm/models/diffusion_denoising.py","file_url":"https://github.com/larsdoorenbos/ccdm-stochastic-segmentation/blob/HEAD/ddpm/models/diffusion_denoising.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8fe4b00f6864101e"}},{"code_sha256_prefix":"0bbe78920342bfbb","entry":"linear_schedule","repo":"larsdoorenbos/ccdm-stochastic-segmentation","repo_kind":"official","path":"ddpm/models/diffusion_denoising.py","file_url":"https://github.com/larsdoorenbos/ccdm-stochastic-segmentation/blob/HEAD/ddpm/models/diffusion_denoising.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0bbe78920342bfbb"}},{"code_sha256_prefix":"53d76e5ab10f50ef","entry":"DenoisingModel","repo":"larsdoorenbos/ccdm-stochastic-segmentation","repo_kind":"official","path":"ddpm/models/diffusion_denoising.py","file_url":"https://github.com/larsdoorenbos/ccdm-stochastic-segmentation/blob/HEAD/ddpm/models/diffusion_denoising.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53d76e5ab10f50ef"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}