{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/didi-diffusion-guided-diversity-for-offline","title":"DIDI: Diffusion-Guided Diversity for Offline Behavioral Generation","arxiv_id":"2405.14790","date":"2024-05-23","proceeding":null,"authors":["Jinxin Liu","Xinghong Guo","Zifeng Zhuang","Donglin Wang"],"abstract":"In this paper, we propose a novel approach called DIffusion-guided DIversity (DIDI) for offline behavioral generation. The goal of DIDI is to learn a diverse set of skills from a mixture of label-free offline data. We achieve this by leveraging diffusion probabilistic models as priors to guide the learning process and regularize the policy. By optimizing a joint objective that incorporates diversity and diffusion-guided regularization, we encourage the emergence of diverse behaviors while maintaining the similarity to the offline data. Experimental results in four decision-making domains (Push, Kitchen, Humanoid, and D4RL tasks) show that DIDI is effective in discovering diverse and discriminative skills. We also introduce skill stitching and skill interpolation, which highlight the generalist nature of the learned skill space. Further, by incorporating an extrinsic reward function, DIDI enables reward-guided behavior generation, facilitating the learning of diverse and optimal behaviors from sub-optimal data.","url_abs":"https://arxiv.org/abs/2405.14790v1","url_pdf":"https://arxiv.org/pdf/2405.14790v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"didi-diffusion-guided-diversity-for-offline","repo_url":"https://github.com/huey0528/icml24didi","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"jax","reach":{"status":"ok"}}],"tasks":[{"task_slug":"d4rl","task_name":"D4RL"},{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"diversity","task_name":"Diversity"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2405.14790","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.14790"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/huey0528/icml24didi","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":1,"ran_honours":1,"ran":2,"unverified":9},"by_repo_kind":{"official":{"samples":13,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":13,"samples":[{"code_sha256_prefix":"b3d593fb33f79ac5","entry":"apply_conditioning","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/models/helpers.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b3d593fb33f79ac5"}},{"code_sha256_prefix":"b6113e0f43155a33","entry":"cosine_beta_schedule","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/models/helpers.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b6113e0f43155a33"}},{"code_sha256_prefix":"69e493e37778664c","entry":"load_environment","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/d4rl.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/d4rl.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"69e493e37778664c"}},{"code_sha256_prefix":"bf6c5a9297d78f74","entry":"process_maze2d_episode","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/d4rl.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/d4rl.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bf6c5a9297d78f74"}},{"code_sha256_prefix":"5347209028588046","entry":"add_deltas","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/preprocessing.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/preprocessing.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5347209028588046"}},{"code_sha256_prefix":"785632d29b87adad","entry":"atleast_2d","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/buffer.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/buffer.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"785632d29b87adad"}},{"code_sha256_prefix":"3ca83b3e96824f00","entry":"atleast_2d","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/normalization.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/normalization.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ca83b3e96824f00"}},{"code_sha256_prefix":"2fd70118265255f8","entry":"empirical_cdf","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/normalization.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/normalization.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2fd70118265255f8"}},{"code_sha256_prefix":"09c8479d9a5b3e06","entry":"extract","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/models/helpers.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/models/helpers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"09c8479d9a5b3e06"}},{"code_sha256_prefix":"505d6b06c543b4fb","entry":"flatten","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/normalization.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/normalization.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"505d6b06c543b4fb"}},{"code_sha256_prefix":"6b688f0cd038f65e","entry":"get_dataset","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/d4rl.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/d4rl.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6b688f0cd038f65e"}},{"code_sha256_prefix":"65e5c27060559602","entry":"get_policy_preprocess_fn","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/preprocessing.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/preprocessing.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"65e5c27060559602"}},{"code_sha256_prefix":"54442074c20e0e8f","entry":"get_preprocess_fn","repo":"huey0528/icml24didi","repo_kind":"official","path":"diffuser/datasets/preprocessing.py","file_url":"https://github.com/huey0528/icml24didi/blob/HEAD/diffuser/datasets/preprocessing.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"54442074c20e0e8f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}