{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/advancing-pose-guided-image-synthesis-with","title":"Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Models","arxiv_id":"2310.06313","date":"2023-10-10","proceeding":null,"authors":["Fei Shen","Hu Ye","Jun Zhang","Cong Wang","Xiao Han","Wei Yang"],"abstract":"Recent work has showcased the significant potential of diffusion models in pose-guided person image synthesis. However, owing to the inconsistency in pose between the source and target images, synthesizing an image with a distinct pose, relying exclusively on the source image and target pose information, remains a formidable challenge. This paper presents Progressive Conditional Diffusion Models (PCDMs) that incrementally bridge the gap between person images under the target and source poses through three stages. Specifically, in the first stage, we design a simple prior conditional diffusion model that predicts the global features of the target image by mining the global alignment relationship between pose coordinates and image appearance. Then, the second stage establishes a dense correspondence between the source and target images using the global features from the previous stage, and an inpainting conditional diffusion model is proposed to further align and enhance the contextual features, generating a coarse-grained person image. In the third stage, we propose a refining conditional diffusion model to utilize the coarsely generated image from the previous stage as a condition, achieving texture restoration and enhancing fine-detail consistency. The three-stage PCDMs work progressively to generate the final high-quality and high-fidelity synthesized image. Both qualitative and quantitative results demonstrate the consistency and photorealism of our proposed PCDMs under challenging scenarios.The code and model will be available at https://github.com/tencent-ailab/PCDMs.","url_abs":"https://arxiv.org/abs/2310.06313v4","url_pdf":"https://arxiv.org/pdf/2310.06313v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"advancing-pose-guided-image-synthesis-with","repo_url":"https://github.com/tencent-ailab/PCDMs","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"}],"methods":[{"method_slug":"align","method_name":"ALIGN"},{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"pixel-prediction","method_name":"Inpainting"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.06313","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.06313"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/tencent-ailab/PCDMs","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":4,"ran_violates":1,"ran_honours":1,"ran_fixture":1,"ran_draft_wrong":2,"unverified":2},"by_repo_kind":{"official":{"samples":11,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f8eeae62669a07ad","entry":"compare_l1","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f8eeae62669a07ad"}},{"code_sha256_prefix":"85ce775a2ab90703","entry":"compare_mae","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/metrics.py","link_basis":"plan_row","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"85ce775a2ab90703"}},{"code_sha256_prefix":"4b208faf97544161","entry":"count_model_params","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"stage1_train_prior_model.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/stage1_train_prior_model.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4b208faf97544161"}},{"code_sha256_prefix":"b7231ccec461621e","entry":"get_image_list","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b7231ccec461621e"}},{"code_sha256_prefix":"d2b9faa80b2570e4","entry":"image_grid","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"stage2_batchtest_inpaint_model.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/stage2_batchtest_inpaint_model.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d2b9faa80b2570e4"}},{"code_sha256_prefix":"82d0673e4138da7c","entry":"read_coordinates_file","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"stage1_batchtest_prior_model.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/stage1_batchtest_prior_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"82d0673e4138da7c"}},{"code_sha256_prefix":"bea2d776a332f2b0","entry":"rescale_noise_cfg","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"src/pipelines/PCDMs_pipeline.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/src/pipelines/PCDMs_pipeline.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bea2d776a332f2b0"}},{"code_sha256_prefix":"3338a5b299ea25ec","entry":"retrieve_timesteps","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"src/pipelines/PCDMs_pipeline.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/src/pipelines/PCDMs_pipeline.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3338a5b299ea25ec"}},{"code_sha256_prefix":"652f1c8927e235d3","entry":"split_list_into_chunks","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"stage1_batchtest_prior_model.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/stage1_batchtest_prior_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"652f1c8927e235d3"}},{"code_sha256_prefix":"d3e6b5403c89389e","entry":"load_training_checkpoint","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"stage1_train_prior_model.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/stage1_train_prior_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d3e6b5403c89389e"}},{"code_sha256_prefix":"d81381b327c76edd","entry":"zero_module","repo":"tencent-ailab/PCDMs","repo_kind":"official","path":"stage3_batchtest_refined_model.py","file_url":"https://github.com/tencent-ailab/PCDMs/blob/HEAD/stage3_batchtest_refined_model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d81381b327c76edd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}