{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/fabric-personalizing-diffusion-models-with","title":"FABRIC: Personalizing Diffusion Models with Iterative Feedback","arxiv_id":"2307.10159","date":"2023-07-19","proceeding":null,"authors":["Dimitri von Rütte","Elisabetta Fedele","Jonathan Thomm","Lukas Wolf"],"abstract":"In an era where visual content generation is increasingly driven by machine learning, the integration of human feedback into generative models presents significant opportunities for enhancing user experience and output quality. This study explores strategies for incorporating iterative human feedback into the generative process of diffusion-based text-to-image models. We propose FABRIC, a training-free approach applicable to a wide range of popular diffusion models, which exploits the self-attention layer present in the most widely used architectures to condition the diffusion process on a set of feedback images. To ensure a rigorous assessment of our approach, we introduce a comprehensive evaluation methodology, offering a robust mechanism to quantify the performance of generative visual models that integrate human feedback. We show that generation results improve over multiple rounds of iterative feedback through exhaustive analysis, implicitly optimizing arbitrary user preferences. The potential applications of these findings extend to fields such as personalized content creation and customization.","url_abs":"https://arxiv.org/abs/2307.10159v1","url_pdf":"https://arxiv.org/pdf/2307.10159v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"fabric-personalizing-diffusion-models-with","repo_url":"https://github.com/sd-fabric/fabric","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.10159","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.10159"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sd-fabric/fabric","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":8},"by_repo_kind":{"official":{"samples":8,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c987f79e0a41069a","entry":"display_images","repo":"sd-fabric/fabric","repo_kind":"official","path":"fabric/utils.py","file_url":"https://github.com/sd-fabric/fabric/blob/HEAD/fabric/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c987f79e0a41069a"}},{"code_sha256_prefix":"02a719df3b20d1e3","entry":"feedback_scores","repo":"sd-fabric/fabric","repo_kind":"official","path":"fabric/evaluation/target_image_feedback.py","file_url":"https://github.com/sd-fabric/fabric/blob/HEAD/fabric/evaluation/target_image_feedback.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"02a719df3b20d1e3"}},{"code_sha256_prefix":"5bf5d2264ae2443e","entry":"get_free_gpu","repo":"sd-fabric/fabric","repo_kind":"official","path":"fabric/utils.py","file_url":"https://github.com/sd-fabric/fabric/blob/HEAD/fabric/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5bf5d2264ae2443e"}},{"code_sha256_prefix":"c2a0d9d99789c623","entry":"get_images","repo":"sd-fabric/fabric","repo_kind":"official","path":"fabric/evaluation/utils.py","file_url":"https://github.com/sd-fabric/fabric/blob/HEAD/fabric/evaluation/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c2a0d9d99789c623"}},{"code_sha256_prefix":"6b18247105039e14","entry":"get_prompts","repo":"sd-fabric/fabric","repo_kind":"official","path":"fabric/evaluation/utils.py","file_url":"https://github.com/sd-fabric/fabric/blob/HEAD/fabric/evaluation/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6b18247105039e14"}},{"code_sha256_prefix":"05d476ec9da3019d","entry":"make_out_folder","repo":"sd-fabric/fabric","repo_kind":"official","path":"fabric/evaluation/utils.py","file_url":"https://github.com/sd-fabric/fabric/blob/HEAD/fabric/evaluation/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"05d476ec9da3019d"}},{"code_sha256_prefix":"d6e2f15572d7b8af","entry":"tile_images","repo":"sd-fabric/fabric","repo_kind":"official","path":"fabric/utils.py","file_url":"https://github.com/sd-fabric/fabric/blob/HEAD/fabric/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d6e2f15572d7b8af"}},{"code_sha256_prefix":"e0cc7bea45b3299a","entry":"word_dropout","repo":"sd-fabric/fabric","repo_kind":"official","path":"fabric/iterative.py","file_url":"https://github.com/sd-fabric/fabric/blob/HEAD/fabric/iterative.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e0cc7bea45b3299a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}