{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/tradiffusion-trajectory-based-training-free","title":"TraDiffusion: Trajectory-Based Training-Free Image Generation","arxiv_id":"2408.09739","date":"2024-08-19","proceeding":null,"authors":["Mingrui Wu","Oucheng Huang","Jiayi Ji","Jiale Li","Xinyue Cai","Huafeng Kuang","Jianzhuang Liu","Xiaoshuai Sun","Rongrong Ji"],"abstract":"In this work, we propose a training-free, trajectory-based controllable T2I approach, termed TraDiffusion. This novel method allows users to effortlessly guide image generation via mouse trajectories. To achieve precise control, we design a distance awareness energy function to effectively guide latent variables, ensuring that the focus of generation is within the areas defined by the trajectory. The energy function encompasses a control function to draw the generation closer to the specified trajectory and a movement function to diminish activity in areas distant from the trajectory. Through extensive experiments and qualitative assessments on the COCO dataset, the results reveal that TraDiffusion facilitates simpler, more natural image control. Moreover, it showcases the ability to manipulate salient regions, attributes, and relationships within the generated images, alongside visual input based on arbitrary or enhanced trajectories.","url_abs":"https://arxiv.org/abs/2408.09739v1","url_pdf":"https://arxiv.org/pdf/2408.09739v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"tradiffusion-trajectory-based-training-free","repo_url":"https://github.com/och-mac/tradiffusion","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2408.09739","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.09739"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/och-mac/tradiffusion","reach":{"status":"ok"}}],"summary":{"ran":2,"unverified":3},"by_repo_kind":{"official":{"samples":5,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"529c68d68a7fba80","entry":"compute_ca_loss_masks","repo":"och-mac/tradiffusion","repo_kind":"official","path":"utils.py","file_url":"https://github.com/och-mac/tradiffusion/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"529c68d68a7fba80"}},{"code_sha256_prefix":"a57d2a7e92fbddd5","entry":"find_tensor_positions","repo":"och-mac/tradiffusion","repo_kind":"official","path":"utils.py","file_url":"https://github.com/och-mac/tradiffusion/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a57d2a7e92fbddd5"}},{"code_sha256_prefix":"6385eb1bcdf2344e","entry":"concat_images","repo":"och-mac/tradiffusion","repo_kind":"official","path":"utils.py","file_url":"https://github.com/och-mac/tradiffusion/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6385eb1bcdf2344e"}},{"code_sha256_prefix":"249a089f948c8cb4","entry":"get_down_block","repo":"och-mac/tradiffusion","repo_kind":"official","path":"my_model/unet_2d_blocks.py","file_url":"https://github.com/och-mac/tradiffusion/blob/HEAD/my_model/unet_2d_blocks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"249a089f948c8cb4"}},{"code_sha256_prefix":"c3f3e72710fb5556","entry":"get_up_block","repo":"och-mac/tradiffusion","repo_kind":"official","path":"my_model/unet_2d_blocks.py","file_url":"https://github.com/och-mac/tradiffusion/blob/HEAD/my_model/unet_2d_blocks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c3f3e72710fb5556"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}