{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/simple-and-effective-vae-training-with","title":"Simple and Effective VAE Training with Calibrated Decoders","arxiv_id":"2006.13202","date":"2020-06-23","proceeding":null,"authors":["Oleh Rybkin","Kostas Daniilidis","Sergey Levine"],"abstract":"Variational autoencoders (VAEs) provide an effective and simple method for modeling complex distributions. However, training VAEs often requires considerable hyperparameter tuning to determine the optimal amount of information retained by the latent variable. We study the impact of calibrated decoders, which learn the uncertainty of the decoding distribution and can determine this amount of information automatically, on the VAE performance. While many methods for learning calibrated decoders have been proposed, many of the recent papers that employ VAEs rely on heuristic hyperparameters and ad-hoc modifications instead. We perform the first comprehensive comparative analysis of calibrated decoder and provide recommendations for simple and effective VAE training. Our analysis covers a range of image and video datasets and several single-image and sequential VAE models. We further propose a simple but novel modification to the commonly used Gaussian decoder, which computes the prediction variance analytically. We observe empirically that using heuristic modifications is not necessary with our method. Project website is at https://orybkin.github.io/sigma-vae/","url_abs":"https://arxiv.org/abs/2006.13202v3","url_pdf":"https://arxiv.org/pdf/2006.13202v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"simple-and-effective-vae-training-with","repo_url":"https://github.com/orybkin/sigma-vae","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok"}}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2006.13202","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.13202"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/orybkin/sigma-vae","reach":{"status":"ok"}}],"summary":{"ran":2,"ran_draft_wrong":3,"ran_honours":1,"unverified":1},"by_repo_kind":{"community":{"samples":7,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"b48f592cc5b0f4c7","entry":"Flatten","repo":"orybkin/sigma-vae-pytorch","repo_kind":"community","path":"model.py","file_url":"https://github.com/orybkin/sigma-vae-pytorch/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b48f592cc5b0f4c7"}},{"code_sha256_prefix":"0097f92921cb5c04","entry":"UnFlatten","repo":"orybkin/sigma-vae-pytorch","repo_kind":"community","path":"model.py","file_url":"https://github.com/orybkin/sigma-vae-pytorch/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0097f92921cb5c04"}},{"code_sha256_prefix":"85038890e349231c","entry":"gaussian_nll","repo":"orybkin/sigma-vae-pytorch","repo_kind":"community","path":"model.py","file_url":"https://github.com/orybkin/sigma-vae-pytorch/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"85038890e349231c"}},{"code_sha256_prefix":"b67c41c224081421","entry":"gaussian_nll","repo":"orybkin/sigma-vae-pytorch","repo_kind":"community","path":"model.py","file_url":"https://github.com/orybkin/sigma-vae-pytorch/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b67c41c224081421"}},{"code_sha256_prefix":"afbe2793658279b7","entry":"softclip","repo":"orybkin/sigma-vae-pytorch","repo_kind":"community","path":"model.py","file_url":"https://github.com/orybkin/sigma-vae-pytorch/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"afbe2793658279b7"}},{"code_sha256_prefix":"ede71767cb8a75e1","entry":"softclip","repo":"orybkin/sigma-vae-pytorch","repo_kind":"community","path":"model.py","file_url":"https://github.com/orybkin/sigma-vae-pytorch/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ede71767cb8a75e1"}},{"code_sha256_prefix":"0fa76b9a6fc9475e","entry":"ConvVAE","repo":"orybkin/sigma-vae-pytorch","repo_kind":"community","path":"model.py","file_url":"https://github.com/orybkin/sigma-vae-pytorch/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0fa76b9a6fc9475e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}