{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/deep-gaussian-mixture-model-for-unsupervised","title":"Deep Gaussian mixture model for unsupervised image segmentation","arxiv_id":"2404.12252","date":"2024-04-18","proceeding":null,"authors":["Matthias Schwab","Agnes Mayr","Markus Haltmeier"],"abstract":"The recent emergence of deep learning has led to a great deal of work on designing supervised deep semantic segmentation algorithms. As in many tasks sufficient pixel-level labels are very difficult to obtain, we propose a method which combines a Gaussian mixture model (GMM) with unsupervised deep learning techniques. In the standard GMM the pixel values with each sub-region are modelled by a Gaussian distribution. In order to identify the different regions, the parameter vector that minimizes the negative log-likelihood (NLL) function regarding the GMM has to be approximated. For this task, usually iterative optimization methods such as the expectation-maximization (EM) algorithm are used. In this paper, we propose to estimate these parameters directly from the image using a convolutional neural network (CNN). We thus change the iterative procedure in the EM algorithm replacing the expectation-step by a gradient-step with regard to the networks parameters. This means that the network is trained to minimize the NLL function of the GMM which comes with at least two advantages. As once trained, the network is able to predict label probabilities very quickly compared with time consuming iterative optimization methods. Secondly, due to the deep image prior our method is able to partially overcome one of the main disadvantages of GMM, which is not taking into account correlation between neighboring pixels, as it assumes independence between them. We demonstrate the advantages of our method in various experiments on the example of myocardial infarct segmentation on multi-sequence MRI images.","url_abs":"https://arxiv.org/abs/2404.12252v1","url_pdf":"https://arxiv.org/pdf/2404.12252v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deep-gaussian-mixture-model-for-unsupervised","repo_url":"https://github.com/matthi99/deepgmm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"unsupervised-image-segmentation","task_name":"Unsupervised Image Segmentation"},{"task_slug":"model","task_name":"model"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2404.12252","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.12252"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/matthi99/deepgmm","reach":{"status":"ok"}}],"summary":{"ran":6,"unverified":2},"by_repo_kind":{"official":{"samples":8,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"e34174da729686f1","entry":"NLL","repo":"matthi99/deepgmm","repo_kind":"official","path":"utils/utils.py","file_url":"https://github.com/matthi99/deepgmm/blob/HEAD/utils/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e34174da729686f1"}},{"code_sha256_prefix":"21ee7acf0ede36e2","entry":"create_zero_centered_coordinate_mesh","repo":"matthi99/deepgmm","repo_kind":"official","path":"utils/dataloader.py","file_url":"https://github.com/matthi99/deepgmm/blob/HEAD/utils/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"21ee7acf0ede36e2"}},{"code_sha256_prefix":"196273f4c5108f25","entry":"get_activation","repo":"matthi99/deepgmm","repo_kind":"official","path":"utils/unet.py","file_url":"https://github.com/matthi99/deepgmm/blob/HEAD/utils/unet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"196273f4c5108f25"}},{"code_sha256_prefix":"213d3aea28be3dba","entry":"normalize","repo":"matthi99/deepgmm","repo_kind":"official","path":"utils/utils.py","file_url":"https://github.com/matthi99/deepgmm/blob/HEAD/utils/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"213d3aea28be3dba"}},{"code_sha256_prefix":"ae641f99579bd1ac","entry":"padsize","repo":"matthi99/deepgmm","repo_kind":"official","path":"utils/unet.py","file_url":"https://github.com/matthi99/deepgmm/blob/HEAD/utils/unet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ae641f99579bd1ac"}},{"code_sha256_prefix":"c66b22c6f4c480f6","entry":"prepare_data","repo":"matthi99/deepgmm","repo_kind":"official","path":"utils/utils.py","file_url":"https://github.com/matthi99/deepgmm/blob/HEAD/utils/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c66b22c6f4c480f6"}},{"code_sha256_prefix":"c6bfcd7981549a8f","entry":"elastic_deform_coordinates","repo":"matthi99/deepgmm","repo_kind":"official","path":"utils/dataloader.py","file_url":"https://github.com/matthi99/deepgmm/blob/HEAD/utils/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c6bfcd7981549a8f"}},{"code_sha256_prefix":"1f4f6ec1acd912f4","entry":"get_loss","repo":"matthi99/deepgmm","repo_kind":"official","path":"utils/losses.py","file_url":"https://github.com/matthi99/deepgmm/blob/HEAD/utils/losses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1f4f6ec1acd912f4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}