{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/enhancing-consistency-based-image-generation","title":"Enhancing Consistency-Based Image Generation via Adversarialy-Trained Classification and Energy-Based Discrimination","arxiv_id":"2405.16260","date":"2024-05-25","proceeding":null,"authors":["Shelly Golan","Roy Ganz","Michael Elad"],"abstract":"The recently introduced Consistency models pose an efficient alternative to diffusion algorithms, enabling rapid and good quality image synthesis. These methods overcome the slowness of diffusion models by directly mapping noise to data, while maintaining a (relatively) simpler training. Consistency models enable a fast one- or few-step generation, but they typically fall somewhat short in sample quality when compared to their diffusion origins. In this work we propose a novel and highly effective technique for post-processing Consistency-based generated images, enhancing their perceptual quality. Our approach utilizes a joint classifier-discriminator model, in which both portions are trained adversarially. While the classifier aims to grade an image based on its assignment to a designated class, the discriminator portion of the very same network leverages the softmax values to assess the proximity of the input image to the targeted data manifold, thereby serving as an Energy-based Model. By employing example-specific projected gradient iterations under the guidance of this joint machine, we refine synthesized images and achieve an improved FID scores on the ImageNet 64x64 dataset for both Consistency-Training and Consistency-Distillation techniques.","url_abs":"https://arxiv.org/abs/2405.16260v2","url_pdf":"https://arxiv.org/pdf/2405.16260v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"enhancing-consistency-based-image-generation","repo_url":"https://github.com/Shelley-Golan/Boosting-via-Joint-Model","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"}],"methods":[{"method_slug":"cm","method_name":"Consistency Models"},{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2405.16260","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.16260"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Shelley-Golan/Boosting-via-Joint-Model","reach":{"status":"ok"}}],"summary":{"ran":4,"unverified":1},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"6d57c3097e379953","entry":"calc_l2distsq","repo":"Shelley-Golan/Boosting-via-Joint-Model","repo_kind":"official","path":"adversaries.py","file_url":"https://github.com/Shelley-Golan/Boosting-via-Joint-Model/blob/HEAD/adversaries.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6d57c3097e379953"}},{"code_sha256_prefix":"096e065144e00e11","entry":"replicate_input","repo":"Shelley-Golan/Boosting-via-Joint-Model","repo_kind":"official","path":"adversaries.py","file_url":"https://github.com/Shelley-Golan/Boosting-via-Joint-Model/blob/HEAD/adversaries.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"096e065144e00e11"}},{"code_sha256_prefix":"706e45721616b050","entry":"replicate_input_withgrad","repo":"Shelley-Golan/Boosting-via-Joint-Model","repo_kind":"official","path":"adversaries.py","file_url":"https://github.com/Shelley-Golan/Boosting-via-Joint-Model/blob/HEAD/adversaries.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"706e45721616b050"}},{"code_sha256_prefix":"ac5778eda563af68","entry":"sample_q","repo":"Shelley-Golan/Boosting-via-Joint-Model","repo_kind":"official","path":"boost.py","file_url":"https://github.com/Shelley-Golan/Boosting-via-Joint-Model/blob/HEAD/boost.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ac5778eda563af68"}},{"code_sha256_prefix":"77f0832f31e683f7","entry":"get_data","repo":"Shelley-Golan/Boosting-via-Joint-Model","repo_kind":"official","path":"data.py","file_url":"https://github.com/Shelley-Golan/Boosting-via-Joint-Model/blob/HEAD/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"77f0832f31e683f7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}