{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-02091","title":"DFlare: Scaling Up Draft Capacity for Block Diffusion Speculative Decoding","arxiv_id":"2606.02091","date":"2026-06-01","proceeding":null,"authors":["Jiebin Zhang","Zhenghan Yu","Song Liu","Eugene J. Yu","Zheng Li","Dawei Zhu","Jiangshan Duo","Weimin Xiong","Yifan Song","Guanghua Yu","Jianchen Zhu","Sujian Li"],"abstract":"Block diffusion speculative decoding accelerates LLM inference by predicting all tokens within a block simultaneously for the target model to verify in parallel. Predicting an entire block at once requires a sufficiently capable draft model and effective utilization of the target model's internal knowledge. However, the state-of-the-art method DFlash constrains all draft layers to share a single fused representation derived from only a few target layers, limiting per-layer expressiveness and hindering further scaling of draft capacity. In this paper, we present \\modelname, which flares out the narrow conditioning bottleneck of DFlash through a lightweight layer-wise fusion mechanism: each draft layer attends to its own learnable combination of a broad set of target layers at negligible overhead, simultaneously injecting richer target knowledge and providing every draft layer with a distinct input. This enhanced per-layer expressiveness enables scaling the draft model to deeper architectures with consistent gains. We further scale training data from 800K to 2.4M samples to fully exploit the enlarged capacity. On six benchmarks spanning mathematical reasoning, code generation, and conversation, \\modelname attains average wall-clock speedups of 5.52x on Qwen3-4B, 5.46x on Qwen3-8B, and 3.91x on GPT-OSS-20B, improving over DFlash by roughly 11\\%, 8\\%, and 5\\% respectively. Our code is available at https://github.com/Tencent/AngelSlim.","url_abs":"https://arxiv.org/abs/2606.02091","url_pdf":"https://arxiv.org/pdf/2606.02091","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.02091","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.02091"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Tencent/AngelSlim","reach":null}],"summary":{"ran_honours":1,"ran":1,"ran_fixture":1,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":7,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"2d2d004937ed1fe9","entry":"build_target_layer_ids","repo":"Tencent/AngelSlim","repo_kind":"found_in_text","path":"angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","file_url":"https://github.com/Tencent/AngelSlim/blob/HEAD/angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"2d2d004937ed1fe9"}},{"code_sha256_prefix":"40bd342b726505cc","entry":"extract_context_feature","repo":"Tencent/AngelSlim","repo_kind":"found_in_text","path":"angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","file_url":"https://github.com/Tencent/AngelSlim/blob/HEAD/angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"40bd342b726505cc"}},{"code_sha256_prefix":"ab21ebd92ac6698e","entry":"sample","repo":"Tencent/AngelSlim","repo_kind":"found_in_text","path":"angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","file_url":"https://github.com/Tencent/AngelSlim/blob/HEAD/angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"ab21ebd92ac6698e"}},{"code_sha256_prefix":"3a9487142fd7bc6e","entry":"DraftModelFactory","repo":"Tencent/AngelSlim","repo_kind":"found_in_text","path":"angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","file_url":"https://github.com/Tencent/AngelSlim/blob/HEAD/angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"3a9487142fd7bc6e"}},{"code_sha256_prefix":"bc85f6abc637cb16","entry":"Qwen3DFlareAttention","repo":"Tencent/AngelSlim","repo_kind":"found_in_text","path":"angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","file_url":"https://github.com/Tencent/AngelSlim/blob/HEAD/angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"bc85f6abc637cb16"}},{"code_sha256_prefix":"2001eaded712a758","entry":"Qwen3DFlareDecoderLayer","repo":"Tencent/AngelSlim","repo_kind":"found_in_text","path":"angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","file_url":"https://github.com/Tencent/AngelSlim/blob/HEAD/angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"2001eaded712a758"}},{"code_sha256_prefix":"6bd6b90b75aec11e","entry":"QwenDFlareDraftModel","repo":"Tencent/AngelSlim","repo_kind":"found_in_text","path":"angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","file_url":"https://github.com/Tencent/AngelSlim/blob/HEAD/angelslim/compressor/speculative/train/models/draft/qwen_dflare.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"6bd6b90b75aec11e"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}