{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/high-precision-dichotomous-image-segmentation","title":"High-Precision Dichotomous Image Segmentation via Probing Diffusion Capacity","arxiv_id":"2410.10105","date":"2024-10-14","proceeding":"ICLR 2025 2","authors":["Qian Yu","Peng-Tao Jiang","Hao Zhang","Jinwei Chen","Bo Li","Lihe Zhang","Huchuan Lu"],"abstract":"In the realm of high-resolution (HR), fine-grained image segmentation, the primary challenge is balancing broad contextual awareness with the precision required for detailed object delineation, capturing intricate details and the finest edges of objects. Diffusion models, trained on vast datasets comprising billions of image-text pairs, such as SD V2.1, have revolutionized text-to-image synthesis by delivering exceptional quality, fine detail resolution, and strong contextual awareness, making them an attractive solution for high-resolution image segmentation. To this end, we propose DiffDIS, a diffusion-driven segmentation model that taps into the potential of the pre-trained U-Net within diffusion models, specifically designed for high-resolution, fine-grained object segmentation. By leveraging the robust generalization capabilities and rich, versatile image representation prior of the SD models, coupled with a task-specific stable one-step denoising approach, we significantly reduce the inference time while preserving high-fidelity, detailed generation. Additionally, we introduce an auxiliary edge generation task to not only enhance the preservation of fine details of the object boundaries, but reconcile the probabilistic nature of diffusion with the deterministic demands of segmentation. With these refined strategies in place, DiffDIS serves as a rapid object mask generation model, specifically optimized for generating detailed binary maps at high resolutions, while demonstrating impressive accuracy and swift processing. Experiments on the DIS5K dataset demonstrate the superiority of DiffDIS, achieving state-of-the-art results through a streamlined inference process. Our code will be made publicly available.","url_abs":"https://arxiv.org/abs/2410.10105v1","url_pdf":"https://arxiv.org/pdf/2410.10105v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"high-precision-dichotomous-image-segmentation","repo_url":"https://github.com/qianyu-dlut/DiffDIS","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"dichotomous-image-segmentation","task_name":"Dichotomous Image Segmentation"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"object","task_name":"Object"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"concatenated-skip-connection","method_name":"Concatenated Skip Connection"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"u-net","method_name":"U-Net"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.10105","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.10105"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/qianyu-dlut/DiffDIS","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"unverified":2},"by_repo_kind":{"listed":{"samples":4,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"db479265ebdbd5ee","entry":"get_activation","repo":"qianyu-dlut/DiffDIS","repo_kind":"listed","path":"diffusers-0.30.2/models/activations.py","file_url":"https://github.com/qianyu-dlut/DiffDIS/blob/HEAD/diffusers-0.30.2/models/activations.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"db479265ebdbd5ee"}},{"code_sha256_prefix":"0b2a3c6cb50d6a19","entry":"jax_memory_efficient_attention","repo":"qianyu-dlut/DiffDIS","repo_kind":"listed","path":"diffusers-0.30.2/models/attention_flax.py","file_url":"https://github.com/qianyu-dlut/DiffDIS/blob/HEAD/diffusers-0.30.2/models/attention_flax.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0b2a3c6cb50d6a19"}},{"code_sha256_prefix":"b8ef71b151604e2c","entry":"pyramid_noise_like","repo":"qianyu-dlut/DiffDIS","repo_kind":"listed","path":"core/.ipynb_checkpoints/marigold_pipeline-checkpoint.py","file_url":"https://github.com/qianyu-dlut/DiffDIS/blob/HEAD/core/.ipynb_checkpoints/marigold_pipeline-checkpoint.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b8ef71b151604e2c"}},{"code_sha256_prefix":"da94debb8019ad46","entry":"zero_module","repo":"qianyu-dlut/DiffDIS","repo_kind":"listed","path":"diffusers-0.30.2/models/attention.py","file_url":"https://github.com/qianyu-dlut/DiffDIS/blob/HEAD/diffusers-0.30.2/models/attention.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da94debb8019ad46"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}