{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-17868","title":"VidLaDA: Bidirectional Diffusion Large Language Models for Efficient Video Understanding","arxiv_id":"2601.17868","date":"2026-01-25","proceeding":"ICML","authors":["Zhihao He","Tieyuan Chen","Kangyu Wang","Ziran Qin","Yang Shao","Chaofan Gan","Shijie Li","Zuxuan Wu","Weiyao Lin"],"abstract":"Current Video Large Language Models (Video LLMs) typically encode frames via a vision encoder and employ an autoregressive (AR) LLM for understanding and generation. However, this AR paradigm inevitably faces a dual efficiency bottleneck: strictly unidirectional attention compromises understanding efficiency by hindering global spatiotemporal aggregation, while serial decoding restricts generation efficiency. To address this, we propose VidLaDA, a Video LLM based on Diffusion Language Models (DLMs) that leverages bidirectional attention to unlock comprehensive spatiotemporal modeling and decode tokens in parallel. To further mitigate the computational overhead of diffusion decoding, we introduce MARS-Cache, an acceleration strategy that prunes redundancy by combining asynchronous visual cache refreshing with frame-wise chunk attention. Experiments show VidLaDA rivals state-of-the-art AR baselines (e.g., Qwen2.5-VL and LLaVA-Video) and outperforms DLM baselines, with MARS-Cache delivering over 12x speedup without compromising accuracy. Code and checkpoints are open-sourced at https://github.com/ziHoHe/VidLaDA.","url_abs":"https://arxiv.org/abs/2601.17868","url_pdf":"https://arxiv.org/pdf/2601.17868","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2601.17868","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.17868"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/ziHoHe/VidLaDA","reach":null}],"summary":{"ran_fixture":3,"ran_draft_wrong":2,"unverified":8},"by_repo_kind":{"found_in_text":{"samples":13,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"30d7eec482ebf6b1","entry":"repeat_kv","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/llada_v_prepare/files/modeling_llada.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/llada_v_prepare/files/modeling_llada.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":2,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"30d7eec482ebf6b1"}},{"code_sha256_prefix":"bac65c3dafaec040","entry":"apply_rotary_pos_emb","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/llada_v_prepare/files/modeling_llada.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/llada_v_prepare/files/modeling_llada.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bac65c3dafaec040"}},{"code_sha256_prefix":"b0a851cae92754ff","entry":"extract_patches","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/llava/mm_utils.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/llava/mm_utils.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b0a851cae92754ff"}},{"code_sha256_prefix":"b99eea6376d1e212","entry":"rotate_half","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/llada_v_prepare/files/modeling_llada.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/llada_v_prepare/files/modeling_llada.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b99eea6376d1e212"}},{"code_sha256_prefix":"7606525af238fb64","entry":"unpad_image","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/llava/model/llava_arch.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/llava/model/llava_arch.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7606525af238fb64"}},{"code_sha256_prefix":"3c8823948724e269","entry":"auto_pad_images","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/llava/mm_utils.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/llava/mm_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3c8823948724e269"}},{"code_sha256_prefix":"c32b636f13ed9ee5","entry":"convert_to_scalar","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/trl/core.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/trl/core.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c32b636f13ed9ee5"}},{"code_sha256_prefix":"21c36f0bbf177093","entry":"find_closest_simple_ratio","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/create_mix_data.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/create_mix_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"21c36f0bbf177093"}},{"code_sha256_prefix":"a51ae45a1f6c0b5b","entry":"flatten_dict","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/trl/core.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/trl/core.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a51ae45a1f6c0b5b"}},{"code_sha256_prefix":"d99baa5425e99407","entry":"rename_keys_in_state_dict","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/llada_v_prepare/rename_checkpoint.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/llada_v_prepare/rename_checkpoint.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d99baa5425e99407"}},{"code_sha256_prefix":"c80358dff96c25ce","entry":"resize_and_center_crop","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/llava/mm_utils.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/llava/mm_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c80358dff96c25ce"}},{"code_sha256_prefix":"b20705b0dfd77ffc","entry":"safe_load_tokenizer","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/llava/conversation.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/llava/conversation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b20705b0dfd77ffc"}},{"code_sha256_prefix":"2c3da386578af970","entry":"top_k_top_p_filtering","repo":"ziHoHe/VidLaDA","repo_kind":"found_in_text","path":"train/trl/core.py","file_url":"https://github.com/ziHoHe/VidLaDA/blob/HEAD/train/trl/core.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2c3da386578af970"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}