{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2509-25940","title":"Steer Away From Mode Collisions: Improving Composition In Diffusion Models","arxiv_id":"2509.25940","date":"2025-09-30","proceeding":"ICLR","authors":["Debottam Dutta","Jianchong Chen","Rajalaxmi Rajagopalan","Yu-Lin Wei","Romit Roy Choudhury"],"abstract":"We propose to improve multi-concept prompt fidelity in text-to-image diffusion models. We begin with common failure cases - prompts like \"a cat and a dog\" that sometimes yields images where one concept is missing, faint, or colliding awkwardly with another. We hypothesize that this happens when the diffusion model drifts into mixed modes that over-emphasize a single concept it learned strongly during training. Instead of re-training, we introduce a corrective sampling strategy that steers away from regions where the joint prompt behavior overlaps too strongly with any single concept in the prompt. The goal is to steer towards \"pure\" joint modes where all concepts can coexist with balanced visual presence. We further show that existing multi-concept guidance schemes can operate in unstable weight regimes that amplify imbalance; we characterize favorable regions and adapt sampling to remain within them. Our approach, CO3, is plug-and-play, requires no model tuning, and complements standard classifier-free guidance. Experiments on diverse multi-concept prompts indicate improvements in concept coverage, balance and robustness, with fewer dropped or distorted concepts compared to standard baselines and prior compositional methods. Results suggest that lightweight corrective guidance can substantially mitigate brittle semantic alignment behavior in modern diffusion systems. Code is available at https://github.com/debottam-dutta7/co3","url_abs":"https://arxiv.org/abs/2509.25940","url_pdf":"https://arxiv.org/pdf/2509.25940","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2509.25940","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2509.25940"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/debottam-dutta7/co3","reach":{"status":"ok"}}],"summary":{"ran_honours":1,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":5,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"d3d9b5fd6b42f66c","entry":"tokenize_prompt","repo":"debottam-dutta7/co3","repo_kind":"found_in_text","path":"composers/utils/ptp_utils.py","file_url":"https://github.com/debottam-dutta7/co3/blob/HEAD/composers/utils/ptp_utils.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d3d9b5fd6b42f66c"}},{"code_sha256_prefix":"905ed9d10d63506c","entry":"find_subsequence_indices","repo":"debottam-dutta7/co3","repo_kind":"found_in_text","path":"composers/utils/ptp_utils.py","file_url":"https://github.com/debottam-dutta7/co3/blob/HEAD/composers/utils/ptp_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"905ed9d10d63506c"}},{"code_sha256_prefix":"c968831e4a00aa32","entry":"get_result_path","repo":"debottam-dutta7/co3","repo_kind":"found_in_text","path":"sample_co3.py","file_url":"https://github.com/debottam-dutta7/co3/blob/HEAD/sample_co3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c968831e4a00aa32"}},{"code_sha256_prefix":"01c6e5b73656deb5","entry":"rescale_noise_cfg","repo":"debottam-dutta7/co3","repo_kind":"found_in_text","path":"composers/Co3.py","file_url":"https://github.com/debottam-dutta7/co3/blob/HEAD/composers/Co3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"01c6e5b73656deb5"}},{"code_sha256_prefix":"42f35256bd885673","entry":"text_under_image","repo":"debottam-dutta7/co3","repo_kind":"found_in_text","path":"composers/utils/ptp_utils.py","file_url":"https://github.com/debottam-dutta7/co3/blob/HEAD/composers/utils/ptp_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"42f35256bd885673"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_api"},"syntology_extracted_results":null}