{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/act-adversarial-consistency-models","title":"ACT-Diffusion: Efficient Adversarial Consistency Training for One-step Diffusion Models","arxiv_id":"2311.14097","date":"2023-11-23","proceeding":"CVPR 2024 1","authors":["Fei Kong","Jinhao Duan","Lichao Sun","Hao Cheng","Renjing Xu","HengTao Shen","Xiaofeng Zhu","Xiaoshuang Shi","Kaidi Xu"],"abstract":"Though diffusion models excel in image generation, their step-by-step denoising leads to slow generation speeds. Consistency training addresses this issue with single-step sampling but often produces lower-quality generations and requires high training costs. In this paper, we show that optimizing consistency training loss minimizes the Wasserstein distance between target and generated distributions. As timestep increases, the upper bound accumulates previous consistency training losses. Therefore, larger batch sizes are needed to reduce both current and accumulated losses. We propose Adversarial Consistency Training (ACT), which directly minimizes the Jensen-Shannon (JS) divergence between distributions at each timestep using a discriminator. Theoretically, ACT enhances generation quality, and convergence. By incorporating a discriminator into the consistency training framework, our method achieves improved FID scores on CIFAR10 and ImageNet 64$\\times$64 and LSUN Cat 256$\\times$256 datasets, retains zero-shot image inpainting capabilities, and uses less than $1/6$ of the original batch size and fewer than $1/2$ of the model parameters and training steps compared to the baseline method, this leads to a substantial reduction in resource consumption. Our code is available:https://github.com/kong13661/ACT","url_abs":"https://arxiv.org/abs/2311.14097v3","url_pdf":"https://arxiv.org/pdf/2311.14097v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"act-adversarial-consistency-models","repo_url":"https://github.com/kong13661/act","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"image-inpainting","task_name":"Image Inpainting"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"pixel-prediction","method_name":"Inpainting"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.14097","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.14097"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kong13661/act","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":10,"unverified":2},"by_repo_kind":{"official":{"samples":12,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"85dfec63f564779e","entry":"L1Loss","repo":"kong13661/act","repo_kind":"official","path":"models/loss.py","file_url":"https://github.com/kong13661/act/blob/HEAD/models/loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"85dfec63f564779e"}},{"code_sha256_prefix":"6a2a61c24b01a1a8","entry":"L2Loss","repo":"kong13661/act","repo_kind":"official","path":"models/loss.py","file_url":"https://github.com/kong13661/act/blob/HEAD/models/loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6a2a61c24b01a1a8"}},{"code_sha256_prefix":"946e3c947022f1b7","entry":"L2Loss_ph","repo":"kong13661/act","repo_kind":"official","path":"models/loss.py","file_url":"https://github.com/kong13661/act/blob/HEAD/models/loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"946e3c947022f1b7"}},{"code_sha256_prefix":"20c5c05708bdfa87","entry":"create_path_decorator","repo":"kong13661/act","repo_kind":"official","path":"path_utils.py","file_url":"https://github.com/kong13661/act/blob/HEAD/path_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"20c5c05708bdfa87"}},{"code_sha256_prefix":"ade5f33fab3df5b9","entry":"get_database_meta_from_funcion_signature","repo":"kong13661/act","repo_kind":"official","path":"common.py","file_url":"https://github.com/kong13661/act/blob/HEAD/common.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ade5f33fab3df5b9"}},{"code_sha256_prefix":"cfdd09203b275a9f","entry":"get_params_to_record_from_funcion_signature","repo":"kong13661/act","repo_kind":"official","path":"common.py","file_url":"https://github.com/kong13661/act/blob/HEAD/common.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cfdd09203b275a9f"}},{"code_sha256_prefix":"72fc04827d75b5b8","entry":"get_type","repo":"kong13661/act","repo_kind":"official","path":"common.py","file_url":"https://github.com/kong13661/act/blob/HEAD/common.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"72fc04827d75b5b8"}},{"code_sha256_prefix":"75f6b4b2d3a0cd47","entry":"loads_pyarrow","repo":"kong13661/act","repo_kind":"official","path":"convert_imagenet_lmdb.py","file_url":"https://github.com/kong13661/act/blob/HEAD/convert_imagenet_lmdb.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"75f6b4b2d3a0cd47"}},{"code_sha256_prefix":"1d8a8391fc4d7389","entry":"translate_mat","repo":"kong13661/act","repo_kind":"official","path":"augmentation.py","file_url":"https://github.com/kong13661/act/blob/HEAD/augmentation.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1d8a8391fc4d7389"}},{"code_sha256_prefix":"6f6832bdac56cd3b","entry":"upfirdn2d_native","repo":"kong13661/act","repo_kind":"official","path":"augmentation.py","file_url":"https://github.com/kong13661/act/blob/HEAD/augmentation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6f6832bdac56cd3b"}},{"code_sha256_prefix":"51738010a21f76a1","entry":"raw_reader","repo":"kong13661/act","repo_kind":"official","path":"convert_imagenet_lmdb.py","file_url":"https://github.com/kong13661/act/blob/HEAD/convert_imagenet_lmdb.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"51738010a21f76a1"}},{"code_sha256_prefix":"b514c1d4d0c0e302","entry":"read_txt","repo":"kong13661/act","repo_kind":"official","path":"convert_imagenet_lmdb.py","file_url":"https://github.com/kong13661/act/blob/HEAD/convert_imagenet_lmdb.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b514c1d4d0c0e302"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}