{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/long-and-short-guidance-in-score-identity","title":"Long and Short Guidance in Score identity Distillation for One-Step Text-to-Image Generation","arxiv_id":"2406.01561","date":"2024-06-03","proceeding":null,"authors":["Mingyuan Zhou","Zhendong Wang","Huangjie Zheng","Hai Huang"],"abstract":"Diffusion-based text-to-image generation models trained on extensive text-image pairs have shown the capacity to generate photorealistic images consistent with textual descriptions. However, a significant limitation of these models is their slow sample generation, which requires iterative refinement through the same network. In this paper, we enhance Score identity Distillation (SiD) by developing long and short classifier-free guidance (LSG) to efficiently distill pretrained Stable Diffusion models without using real training data. SiD aims to optimize a model-based explicit score matching loss, utilizing a score-identity-based approximation alongside the proposed LSG for practical computation. By training exclusively with fake images synthesized with its one-step generator, SiD equipped with LSG rapidly improves FID and CLIP scores, achieving state-of-the-art FID performance while maintaining a competitive CLIP score. Specifically, its data-free distillation of Stable Diffusion 1.5 achieves a record low FID of 8.15 on the COCO-2014 validation set, with a CLIP score of 0.304 at an LSG scale of 1.5, and an FID of 9.56 with a CLIP score of 0.313 at an LSG scale of 2. Our code and distilled one-step text-to-image generators are available at https://github.com/mingyuanzhou/SiD-LSG.","url_abs":"https://arxiv.org/abs/2406.01561v3","url_pdf":"https://arxiv.org/pdf/2406.01561v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"long-and-short-guidance-in-score-identity","repo_url":"https://github.com/mingyuanzhou/sid-lsg","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"long-and-short-guidance-in-score-identity","repo_url":"https://github.com/mingyuanzhou/sid","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"text-to-image-generation-1","task_name":"Text to Image Generation"},{"task_slug":"text-to-image-generation","task_name":"Text-to-Image Generation"}],"methods":[{"method_slug":"clip","method_name":"CLIP"},{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/text-to-image-generation-on-coco","task":"Text-to-Image Generation","dataset":"COCO (Common Objects in Context)","model":"SiD-LSG (Data-free distillation, zero-shot FID)","rank_in_archive_order":21,"of":69,"metrics":{"FID":"8.15","Zero shot FID":"8.15"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.01561","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.01561"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/mingyuanzhou/SiD-LSG","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mingyuanzhou/sid-lsg","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mingyuanzhou/sid","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_honours":3,"ran_fixture":2,"ran":9,"ran_draft_wrong":4,"unverified":6},"by_repo_kind":{"official":{"samples":22,"ran":16,"repositories":1},"community":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"9cd07419f7c926f8","entry":"parse_tuple","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"cocodataset_tool.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/cocodataset_tool.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":2,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9cd07419f7c926f8"}},{"code_sha256_prefix":"a3aaa665cb2c6e2a","entry":"compute_clip_score","repo":"mingukkang/gigagan","repo_kind":"community","path":"evaluation/evaluation.py","file_url":"https://github.com/mingukkang/gigagan/blob/HEAD/evaluation/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"DEP_MISSING","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a3aaa665cb2c6e2a"}},{"code_sha256_prefix":"790b320b90341326","entry":"compute_distances","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"metrics/sid_precision_recall.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/metrics/sid_precision_recall.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"790b320b90341326"}},{"code_sha256_prefix":"b4e975940805a660","entry":"encode_prompt","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"training/sid_sd_util.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/training/sid_sd_util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b4e975940805a660"}},{"code_sha256_prefix":"a2b45afa097b55b6","entry":"file_ext","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"cocodataset_tool.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/cocodataset_tool.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a2b45afa097b55b6"}},{"code_sha256_prefix":"0021e29612552771","entry":"find_latest_checkpoint","repo":"mingyuanzhou/sid-lsg","repo_kind":"official","path":"sid_train.py","file_url":"https://github.com/mingyuanzhou/sid-lsg/blob/HEAD/sid_train.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0021e29612552771"}},{"code_sha256_prefix":"674eca7b9e1b6439","entry":"format_time","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"dnnlib/util.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/dnnlib/util.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"674eca7b9e1b6439"}},{"code_sha256_prefix":"32af001972a0699f","entry":"format_time_brief","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"dnnlib/util.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/dnnlib/util.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"32af001972a0699f"}},{"code_sha256_prefix":"147acc22e758c8e5","entry":"is_valid_metric","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"metrics/sid_metric_main.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/metrics/sid_metric_main.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"147acc22e758c8e5"}},{"code_sha256_prefix":"dd1dc700e87f36cc","entry":"maybe_min","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"cocodataset_tool.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/cocodataset_tool.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"dd1dc700e87f36cc"}},{"code_sha256_prefix":"cacd4f6ec202d9b4","entry":"parse_int_list","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"sid_metrics.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/sid_metrics.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cacd4f6ec202d9b4"}},{"code_sha256_prefix":"07b21b35ecb4815c","entry":"parse_tuple","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"dataset_tool.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/dataset_tool.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"07b21b35ecb4815c"}},{"code_sha256_prefix":"e574c21e7f007b61","entry":"register_metric","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"metrics/sid_metric_main.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/metrics/sid_metric_main.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e574c21e7f007b61"}},{"code_sha256_prefix":"2ff552e801a5c835","entry":"safe_load","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"metrics/sid_metric_utils.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/metrics/sid_metric_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2ff552e801a5c835"}},{"code_sha256_prefix":"4eb9bd36235b00bf","entry":"setup_snapshot_image_grid","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"training/sid_training_loop.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/training/sid_training_loop.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4eb9bd36235b00bf"}},{"code_sha256_prefix":"baad057101faa00e","entry":"split_list","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"training/sid_training_loop.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/training/sid_training_loop.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"baad057101faa00e"}},{"code_sha256_prefix":"11687d1d3ed1d3db","entry":"tensor2pil","repo":"mingukkang/gigagan","repo_kind":"community","path":"evaluation/evaluation.py","file_url":"https://github.com/mingukkang/gigagan/blob/HEAD/evaluation/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"11687d1d3ed1d3db"}},{"code_sha256_prefix":"a7ee9e9cfc473967","entry":"tokenize_captions","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"training/sid_sd_util.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/training/sid_sd_util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a7ee9e9cfc473967"}},{"code_sha256_prefix":"9d31d2c4cd16bb2d","entry":"ask_yes_no","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"dnnlib/util.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/dnnlib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9d31d2c4cd16bb2d"}},{"code_sha256_prefix":"4df77172213d4bd0","entry":"compute_fid_and_clip","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"metrics/sid_fid_and_clip.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/metrics/sid_fid_and_clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4df77172213d4bd0"}},{"code_sha256_prefix":"e687131b851cf012","entry":"compute_pr","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"metrics/sid_precision_recall.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/metrics/sid_precision_recall.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e687131b851cf012"}},{"code_sha256_prefix":"c127dc46d6966547","entry":"get_feature_detector_name","repo":"mingyuanzhou/SiD-LSG","repo_kind":"official","path":"metrics/sid_metric_utils.py","file_url":"https://github.com/mingyuanzhou/SiD-LSG/blob/HEAD/metrics/sid_metric_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c127dc46d6966547"}},{"code_sha256_prefix":"8c9557ae76612b77","entry":"sid_sd_sampler","repo":"mingyuanzhou/sid-lsg","repo_kind":"official","path":"training/sid_sd_util.py","file_url":"https://github.com/mingyuanzhou/sid-lsg/blob/HEAD/training/sid_sd_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8c9557ae76612b77"}},{"code_sha256_prefix":"abdafc09a34957ba","entry":"upcast_vae","repo":"mingyuanzhou/sid-lsg","repo_kind":"official","path":"training/sid_sd_util.py","file_url":"https://github.com/mingyuanzhou/sid-lsg/blob/HEAD/training/sid_sd_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"abdafc09a34957ba"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}