{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/difflight-a-partial-rewards-conditioned","title":"DiffLight: A Partial Rewards Conditioned Diffusion Model for Traffic Signal Control with Missing Data","arxiv_id":"2410.22938","date":"2024-10-30","proceeding":null,"authors":["Hanyang Chen","Yang Jiang","Shengnan Guo","Xiaowei Mao","Youfang Lin","Huaiyu Wan"],"abstract":"The application of reinforcement learning in traffic signal control (TSC) has been extensively researched and yielded notable achievements. However, most existing works for TSC assume that traffic data from all surrounding intersections is fully and continuously available through sensors. In real-world applications, this assumption often fails due to sensor malfunctions or data loss, making TSC with missing data a critical challenge. To meet the needs of practical applications, we introduce DiffLight, a novel conditional diffusion model for TSC under data-missing scenarios in the offline setting. Specifically, we integrate two essential sub-tasks, i.e., traffic data imputation and decision-making, by leveraging a Partial Rewards Conditioned Diffusion (PRCD) model to prevent missing rewards from interfering with the learning process. Meanwhile, to effectively capture the spatial-temporal dependencies among intersections, we design a Spatial-Temporal transFormer (STFormer) architecture. In addition, we propose a Diffusion Communication Mechanism (DCM) to promote better communication and control performance under data-missing scenarios. Extensive experiments on five datasets with various data-missing scenarios demonstrate that DiffLight is an effective controller to address TSC with missing data. The code of DiffLight is released at https://github.com/lokol5579/DiffLight-release.","url_abs":"https://arxiv.org/abs/2410.22938v2","url_pdf":"https://arxiv.org/pdf/2410.22938v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"difflight-a-partial-rewards-conditioned","repo_url":"https://github.com/lokol5579/DiffLight-release","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-3.0"}}],"tasks":[{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"imputation","task_name":"Imputation"},{"task_slug":"traffic-data-imputation","task_name":"Traffic Data Imputation"},{"task_slug":"traffic-signal-control","task_name":"Traffic Signal Control"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.22938","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.22938"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/lokol5579/DiffLight-release","reach":{"status":"ok","spdx":"GPL-3.0"}}],"summary":{"unverified":4},"by_repo_kind":{"official":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"09c8479d9a5b3e06","entry":"extract","repo":"lokol5579/DiffLight-release","repo_kind":"official","path":"models/diffusion/helpers.py","file_url":"https://github.com/lokol5579/DiffLight-release/blob/HEAD/models/diffusion/helpers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"09c8479d9a5b3e06"}},{"code_sha256_prefix":"89ca501b3a3e10c7","entry":"get_metrics","repo":"lokol5579/DiffLight-release","repo_kind":"official","path":"summary.py","file_url":"https://github.com/lokol5579/DiffLight-release/blob/HEAD/summary.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"89ca501b3a3e10c7"}},{"code_sha256_prefix":"b713c3e92717b2c6","entry":"mask_loss_mean","repo":"lokol5579/DiffLight-release","repo_kind":"official","path":"models/diffusion/helpers.py","file_url":"https://github.com/lokol5579/DiffLight-release/blob/HEAD/models/diffusion/helpers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b713c3e92717b2c6"}},{"code_sha256_prefix":"d21aa3b56dbd7f14","entry":"max_min_norm","repo":"lokol5579/DiffLight-release","repo_kind":"official","path":"models/diffusion/helpers.py","file_url":"https://github.com/lokol5579/DiffLight-release/blob/HEAD/models/diffusion/helpers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"d21aa3b56dbd7f14"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}