{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/why-masking-diffusion-works-condition-on-the","title":"Why Masking Diffusion Works: Condition on the Jump Schedule for Improved Discrete Diffusion","arxiv_id":"2506.08316","date":"2025-06-10","proceeding":null,"authors":["Alan N. Amin","Nate Gruver","Andrew Gordon Wilson"],"abstract":"Discrete diffusion models, like continuous diffusion models, generate high-quality samples by gradually undoing noise applied to datapoints with a Markov process. Gradual generation in theory comes with many conceptual benefits; for example, inductive biases can be incorporated into the noising Markov process, and access to improved sampling algorithms. In practice, however, the consistently best performing discrete diffusion model is, surprisingly, masking diffusion, which does not denoise gradually. Here we explain the superior performance of masking diffusion by noting that it makes use of a fundamental difference between continuous and discrete Markov processes: discrete Markov processes evolve by discontinuous jumps at a fixed rate and, unlike other discrete diffusion models, masking diffusion builds in the known distribution of jump times and only learns where to jump to. We show that we can similarly bake in the known distribution of jump times into any discrete diffusion model. The resulting models - schedule-conditioned discrete diffusion (SCUD) - generalize classical discrete diffusion and masking diffusion. By applying SCUD to models with noising processes that incorporate inductive biases on images, text, and protein data, we build models that outperform masking.","url_abs":"https://arxiv.org/abs/2506.08316v1","url_pdf":"https://arxiv.org/pdf/2506.08316v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"why-masking-diffusion-works-condition-on-the","repo_url":"https://github.com/alannawzadamin/scud","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2506.08316","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2506.08316"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/andrew-cr/tauLDR","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/AlanNawzadAmin/SCUD","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/alannawzadamin/scud","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":3,"ran":7,"unverified":6},"by_repo_kind":{"official":{"samples":16,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0325c917fceb7495","entry":"convert_to_probs","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0325c917fceb7495"}},{"code_sha256_prefix":"340e4d9099615dcc","entry":"get_a_b_func_sc","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"340e4d9099615dcc"}},{"code_sha256_prefix":"dc3cbb6c4c03d2c2","entry":"get_gif","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc3cbb6c4c03d2c2"}},{"code_sha256_prefix":"708ec5714fd16adf","entry":"get_inf_gen","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"708ec5714fd16adf"}},{"code_sha256_prefix":"171b7d239afea3df","entry":"get_text","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"171b7d239afea3df"}},{"code_sha256_prefix":"2ba39f54891a0f2e","entry":"hash_matrix","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ba39f54891a0f2e"}},{"code_sha256_prefix":"e8d679e578149494","entry":"kls","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e8d679e578149494"}},{"code_sha256_prefix":"828ffbe52bb6c5b1","entry":"newton_root_finder","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"828ffbe52bb6c5b1"}},{"code_sha256_prefix":"8bd5456946e5396e","entry":"sample_n_transitions_cont","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8bd5456946e5396e"}},{"code_sha256_prefix":"113fa009b87737b7","entry":"try_load","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"113fa009b87737b7"}},{"code_sha256_prefix":"350372f89ed37c5f","entry":"ContinuousTimeDiffusion","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"350372f89ed37c5f"}},{"code_sha256_prefix":"a47877ec65e2b4e1","entry":"DiffusionTrainer","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a47877ec65e2b4e1"}},{"code_sha256_prefix":"90974b46a044c53a","entry":"SCUD","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"90974b46a044c53a"}},{"code_sha256_prefix":"7245f56fde77ea57","entry":"get_a_b_func_cont","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7245f56fde77ea57"}},{"code_sha256_prefix":"f0b1e6873435a4df","entry":"get_a_b_func_mi","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f0b1e6873435a4df"}},{"code_sha256_prefix":"00ed359ed5a206e4","entry":"get_betas","repo":"alannawzadamin/scud","repo_kind":"official","path":"scud/scud.py","file_url":"https://github.com/alannawzadamin/scud/blob/HEAD/scud/scud.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"00ed359ed5a206e4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}