{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/diffusion-bridge-autoencoders-for","title":"Diffusion Bridge AutoEncoders for Unsupervised Representation Learning","arxiv_id":"2405.17111","date":"2024-05-27","proceeding":null,"authors":["Yeongmin Kim","Kwanghyeon Lee","Minsang Park","Byeonghu Na","Il-Chul Moon"],"abstract":"Diffusion-based representation learning has achieved substantial attention due to its promising capabilities in latent representation and sample generation. Recent studies have employed an auxiliary encoder to identify a corresponding representation from a sample and to adjust the dimensionality of a latent variable z. Meanwhile, this auxiliary structure invokes information split problem because the diffusion and the auxiliary encoder would divide the information from the sample into two representations for each model. Particularly, the information modeled by the diffusion becomes over-regularized because of the static prior distribution on xT. To address this problem, we introduce Diffusion Bridge AuteEncoders (DBAE), which enable z-dependent endpoint xT inference through a feed-forward architecture. This structure creates an information bottleneck at z, so xT becomes dependent on z in its generation. This results in two consequences: 1) z holds the full information of samples, and 2) xT becomes a learnable distribution, not static any further. We propose an objective function for DBAE to enable both reconstruction and generative modeling, with their theoretical justification. Empirical evidence supports the effectiveness of the intended design in DBAE, which notably enhances downstream inference quality, reconstruction, and disentanglement. Additionally, DBAE generates high-fidelity samples in the unconditional generation.","url_abs":"https://arxiv.org/abs/2405.17111v1","url_pdf":"https://arxiv.org/pdf/2405.17111v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"disentanglement","task_name":"Disentanglement"},{"task_slug":"representation-learning","task_name":"Representation Learning"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2405.17111","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.17111"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/openai/guided-diffusion","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/ckczzj/PDAE","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/yue-zhongqi/diti","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/aailab-kaist/DBAE","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/ericyeats/nashae-beamsynthesis","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/GaParmar/clean-fid","reach":null}],"summary":{"ran":6,"ran_draft_wrong":6,"ran_honours":3,"ran_fixture":2,"unverified":10},"by_repo_kind":{"found_in_text":{"samples":27,"ran":17,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"94462cd3ef4ce032","entry":"DDIM","repo":"yue-zhongqi/diti","repo_kind":"found_in_text","path":"model/diffusion/gaussian_diffusion.py","file_url":"https://github.com/yue-zhongqi/diti/blob/HEAD/model/diffusion/gaussian_diffusion.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"94462cd3ef4ce032"}},{"code_sha256_prefix":"f7487b6d19383fd2","entry":"DDIM","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f7487b6d19383fd2"}},{"code_sha256_prefix":"5a2cb2800ec7d0de","entry":"UpBlock","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"ddbm/unet.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/ddbm/unet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5a2cb2800ec7d0de"}},{"code_sha256_prefix":"e6a9932fddabc671","entry":"apply_to_sample","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e6a9932fddabc671"}},{"code_sha256_prefix":"cfd76fd0d89574a4","entry":"approx_standard_normal_cdf","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"ddbm/losses.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/ddbm/losses.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cfd76fd0d89574a4"}},{"code_sha256_prefix":"6154e3744ece5728","entry":"create_window","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"eval_reconstruction.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/eval_reconstruction.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6154e3744ece5728"}},{"code_sha256_prefix":"cd33283d615fb3d7","entry":"discretized_gaussian_log_likelihood","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"ddbm/losses.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/ddbm/losses.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cd33283d615fb3d7"}},{"code_sha256_prefix":"c56b7ef16f309a45","entry":"gaussian","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"eval_reconstruction.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/eval_reconstruction.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c56b7ef16f309a45"}},{"code_sha256_prefix":"874a2882475bf3de","entry":"get_workdir","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"dbae_infer_class.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/dbae_infer_class.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"874a2882475bf3de"}},{"code_sha256_prefix":"e2f262ec3f30d30c","entry":"load_databatch","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"datasets/imagenet.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/datasets/imagenet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e2f262ec3f30d30c"}},{"code_sha256_prefix":"23a955cb5ab536ed","entry":"load_yaml","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"23a955cb5ab536ed"}},{"code_sha256_prefix":"5999a3c31acadfe9","entry":"move_to_cuda","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5999a3c31acadfe9"}},{"code_sha256_prefix":"cf2798b666b231ca","entry":"normal_kl","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"ddbm/losses.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/ddbm/losses.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cf2798b666b231ca"}},{"code_sha256_prefix":"acd70fe09760a8b6","entry":"save_image","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"acd70fe09760a8b6"}},{"code_sha256_prefix":"9b1ad82621dea0cf","entry":"set_worker_seed_builder","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9b1ad82621dea0cf"}},{"code_sha256_prefix":"1b3468f8f7313851","entry":"soft_clamp5","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"ddbm/unet.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/ddbm/unet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1b3468f8f7313851"}},{"code_sha256_prefix":"d41a4250066bce93","entry":"weight_init","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"ddbm/edm_unet.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/ddbm/edm_unet.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d41a4250066bce93"}},{"code_sha256_prefix":"59d0f7c7bd4e6720","entry":"BaseTrainer","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"59d0f7c7bd4e6720"}},{"code_sha256_prefix":"b9372fbb285f6852","entry":"GaussianDiffusion","repo":"yue-zhongqi/diti","repo_kind":"found_in_text","path":"model/diffusion/gaussian_diffusion.py","file_url":"https://github.com/yue-zhongqi/diti/blob/HEAD/model/diffusion/gaussian_diffusion.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b9372fbb285f6852"}},{"code_sha256_prefix":"c7bd746e2c86ba6c","entry":"GaussianDiffusion","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c7bd746e2c86ba6c"}},{"code_sha256_prefix":"690c2ec6cac49099","entry":"RepresentationLearningTrainer","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"690c2ec6cac49099"}},{"code_sha256_prefix":"d9fa2e8aae38ad38","entry":"get_t","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"datasets/imagenet.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/datasets/imagenet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d9fa2e8aae38ad38"}},{"code_sha256_prefix":"05a2d13828b0fcb0","entry":"init_distributed_mode","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"05a2d13828b0fcb0"}},{"code_sha256_prefix":"7f266a03bbbc3136","entry":"save_yaml","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7f266a03bbbc3136"}},{"code_sha256_prefix":"0081e6dcf509161e","entry":"set_seed","repo":"ckczzj/PDAE","repo_kind":"found_in_text","path":"trainer/train_representation_learning.py","file_url":"https://github.com/ckczzj/PDAE/blob/HEAD/trainer/train_representation_learning.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0081e6dcf509161e"}},{"code_sha256_prefix":"9151c793f90473f0","entry":"ssim","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"eval_reconstruction.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/eval_reconstruction.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9151c793f90473f0"}},{"code_sha256_prefix":"4ebc0e09cb353eac","entry":"unpickle","repo":"aailab-kaist/DBAE","repo_kind":"found_in_text","path":"datasets/imagenet.py","file_url":"https://github.com/aailab-kaist/DBAE/blob/HEAD/datasets/imagenet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4ebc0e09cb353eac"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}