{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/data-generation-scheme-for-thermal-modality","title":"Data Generation Scheme for Thermal Modality with Edge-Guided Adversarial Conditional Diffusion Model","arxiv_id":"2408.03748","date":"2024-08-07","proceeding":null,"authors":["Guoqing Zhu","Honghu Pan","Qiang Wang","Chao Tian","Chao Yang","Zhenyu He"],"abstract":"In challenging low light and adverse weather conditions,thermal vision algorithms,especially object detection,have exhibited remarkable potential,contrasting with the frequent struggles encountered by visible vision algorithms. Nevertheless,the efficacy of thermal vision algorithms driven by deep learning models remains constrained by the paucity of available training data samples. To this end,this paper introduces a novel approach termed the edge guided conditional diffusion model. This framework aims to produce meticulously aligned pseudo thermal images at the pixel level,leveraging edge information extracted from visible images. By utilizing edges as contextual cues from the visible domain,the diffusion model achieves meticulous control over the delineation of objects within the generated images. To alleviate the impacts of those visible-specific edge information that should not appear in the thermal domain,a two-stage modality adversarial training strategy is proposed to filter them out from the generated images by differentiating the visible and thermal modality. Extensive experiments on LLVIP demonstrate ECDM s superiority over existing state-of-the-art approaches in terms of image generation quality.","url_abs":"https://arxiv.org/abs/2408.03748v1","url_pdf":"https://arxiv.org/pdf/2408.03748v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"data-generation-scheme-for-thermal-modality","repo_url":"https://github.com/lengmo1996/ECDM","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2408.03748","atlas_url":"https://app.syntology.ai/?focus=2408.03748","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.03748"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lengmo1996/ECDM","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":4,"ran":4,"ran_violates":3,"ran_fixture":2,"ran_honours":2,"unverified":1},"by_repo_kind":{"official":{"samples":16,"ran":15,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":16,"samples":[{"code_sha256_prefix":"c3a6b977022957cb","entry":"Normalize","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/modules/diffusionmodules/simple_unet.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/modules/diffusionmodules/simple_unet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c3a6b977022957cb"}},{"code_sha256_prefix":"9e47ade220c9b3ae","entry":"contour_extraction","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/models/diffusion/ecdm_second_stage.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/models/diffusion/ecdm_second_stage.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9e47ade220c9b3ae"}},{"code_sha256_prefix":"424012cb37b31172","entry":"default","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/modules/attention.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/modules/attention.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"424012cb37b31172"}},{"code_sha256_prefix":"4cb732f513d69dfd","entry":"disabled_train","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/models/diffusion/ddpm_condition.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/models/diffusion/ddpm_condition.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4cb732f513d69dfd"}},{"code_sha256_prefix":"aa5486a3650902d8","entry":"exists","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/modules/attention.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/modules/attention.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"aa5486a3650902d8"}},{"code_sha256_prefix":"ca1185ad84a317c9","entry":"get_norm_layer","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/models/patchgan.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/models/patchgan.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ca1185ad84a317c9"}},{"code_sha256_prefix":"cb49209c125de1b4","entry":"get_timestep_embedding","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/modules/diffusionmodules/simple_unet.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/modules/diffusionmodules/simple_unet.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cb49209c125de1b4"}},{"code_sha256_prefix":"b1368330cf0f5642","entry":"isimage","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/util.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b1368330cf0f5642"}},{"code_sha256_prefix":"d72762b700feee6f","entry":"ismap","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/util.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d72762b700feee6f"}},{"code_sha256_prefix":"3bd7e0cdbd131fdb","entry":"make_beta_schedule","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/modules/diffusionmodules/util.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/modules/diffusionmodules/util.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3bd7e0cdbd131fdb"}},{"code_sha256_prefix":"3ee640131c9d4362","entry":"make_ddim_sampling_parameters","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/modules/diffusionmodules/util.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/modules/diffusionmodules/util.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ee640131c9d4362"}},{"code_sha256_prefix":"0ea4e960ea54514c","entry":"make_ddim_timesteps","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/modules/diffusionmodules/util.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/modules/diffusionmodules/util.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0ea4e960ea54514c"}},{"code_sha256_prefix":"3137073275f8c21a","entry":"nonlinearity","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/modules/diffusionmodules/simple_unet.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/modules/diffusionmodules/simple_unet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3137073275f8c21a"}},{"code_sha256_prefix":"d48d8354986e3b0e","entry":"uniform_on_device","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/models/diffusion/ddpm_condition.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/models/diffusion/ddpm_condition.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d48d8354986e3b0e"}},{"code_sha256_prefix":"9a299fe5ae09e407","entry":"uniq","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/modules/attention.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/modules/attention.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9a299fe5ae09e407"}},{"code_sha256_prefix":"f9bd2e83191afad1","entry":"log_txt_as_img","repo":"lengmo1996/ECDM","repo_kind":"official","path":"ecdm/util.py","file_url":"https://github.com/lengmo1996/ECDM/blob/HEAD/ecdm/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f9bd2e83191afad1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}