{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2602-06953","title":"DAWN: Dependency-Aware Fast Inference for Diffusion LLMs","arxiv_id":"2602.06953","date":"2026-02-06","proceeding":null,"authors":["Lizhuo Luo","Zhuoran Shi","Jiajun Luo","Zhi Wang","Shen Ren","Wenya Wang","Tianwei Zhang"],"abstract":"Diffusion large language models (dLLMs) have shown advantages in text generation, particularly due to their inherent ability for parallel decoding. However, constrained by the quality--speed trade-off, existing inference solutions adopt conservative parallel strategies, leaving substantial efficiency potential underexplored. A core challenge is that parallel decoding assumes each position can be filled independently, but tokens are often semantically coupled. Thus, the correct choice at one position constrains valid choices at others. Without modeling these inter-token dependencies, parallel strategies produce deteriorated outputs. Motivated by this insight, we propose DAWN, a training-free, dependency-aware decoding method for fast dLLM inference. DAWN extracts token dependencies and leverages two key motivations: (1) positions dependent on unmasked certain positions become more reliable, (2) simultaneously unmasking strongly coupled uncertain positions induces errors. Given those findings, DAWN leverages a dependency graph to select more reliable unmasking positions at each iteration, achieving high parallelism with negligible loss in generation quality. Extensive experiments across multiple models and datasets demonstrate that DAWN speedups the inference by 1.80-8.06x over baselines while preserving the generation quality. Code is released at https://github.com/lizhuo-luo/DAWN.","url_abs":"https://arxiv.org/abs/2602.06953","url_pdf":"https://arxiv.org/pdf/2602.06953","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2602.06953","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2602.06953"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/lizhuo-luo/DAWN","reach":null}],"summary":{"ran_draft_wrong":4,"ran":1,"ran_fixture":1,"unverified":11},"by_repo_kind":{"found_in_text":{"samples":17,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c083e60f5001bd38","entry":"get_pairs","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/tokenization_dream.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/tokenization_dream.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c083e60f5001bd38"}},{"code_sha256_prefix":"a1a9545f89348999","entry":"refine_text","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/sanitize.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/sanitize.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a1a9545f89348999"}},{"code_sha256_prefix":"b99eea6376d1e212","entry":"rotate_half","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/modeling_dream.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/modeling_dream.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b99eea6376d1e212"}},{"code_sha256_prefix":"1891fed3a1008763","entry":"sample_tokens","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/generation_utils.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/generation_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1891fed3a1008763"}},{"code_sha256_prefix":"d78ba22cffe4710b","entry":"top_k_logits","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/generation_utils.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/generation_utils.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d78ba22cffe4710b"}},{"code_sha256_prefix":"8139ba2bcf3eb84b","entry":"top_p_logits","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/generation_utils.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/generation_utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8139ba2bcf3eb84b"}},{"code_sha256_prefix":"ac6507e437413e71","entry":"apply_rotary_pos_emb","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/modeling_dream.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/modeling_dream.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac6507e437413e71"}},{"code_sha256_prefix":"dfc107aa05e78b6d","entry":"attn_avg","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/modeling_dream.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/modeling_dream.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dfc107aa05e78b6d"}},{"code_sha256_prefix":"b8100a269ea0a0fc","entry":"build_state","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"demo/viz.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/demo/viz.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b8100a269ea0a0fc"}},{"code_sha256_prefix":"bfd66364f5c97c6c","entry":"detect_attn_sinks","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/gdllm_utils.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/gdllm_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bfd66364f5c97c6c"}},{"code_sha256_prefix":"b53232e0e49f5901","entry":"detect_attn_sinks_","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/gdllm_utils.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/gdllm_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b53232e0e49f5901"}},{"code_sha256_prefix":"044f03d955ca1151","entry":"extract_longest_valid_code","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/sanitize.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/sanitize.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"044f03d955ca1151"}},{"code_sha256_prefix":"316093b5a11a1386","entry":"frames_from_snapshots","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"demo/viz.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/demo/viz.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"316093b5a11a1386"}},{"code_sha256_prefix":"1e9e8d1e3c7a52db","entry":"get_backend","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"demo/registry.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/demo/registry.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e9e8d1e3c7a52db"}},{"code_sha256_prefix":"10811457e1fd0935","entry":"make_decode_token","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"demo/viz.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/demo/viz.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"10811457e1fd0935"}},{"code_sha256_prefix":"cc33a03c053c97c6","entry":"select_parallel_tokens_conflict_mis","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/model/gdllm_utils.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/model/gdllm_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cc33a03c053c97c6"}},{"code_sha256_prefix":"d7d30a99e0029e36","entry":"syntax_check","repo":"lizhuo-luo/DAWN","repo_kind":"found_in_text","path":"dream/sanitize.py","file_url":"https://github.com/lizhuo-luo/DAWN/blob/HEAD/dream/sanitize.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d7d30a99e0029e36"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}