{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/handling-incomplete-heterogeneous-data-using","title":"Handling Incomplete Heterogeneous Data using VAEs","arxiv_id":"1807.03653","date":"2018-07-10","proceeding":null,"authors":["Alfredo Nazabal","Pablo M. Olmos","Zoubin Ghahramani","Isabel Valera"],"abstract":"Variational autoencoders (VAEs), as well as other generative models, have been shown to be efficient and accurate for capturing the latent structure of vast amounts of complex high-dimensional data. However, existing VAEs can still not directly handle data that are heterogenous (mixed continuous and discrete) or incomplete (with missing data at random), which is indeed common in real-world applications. In this paper, we propose a general framework to design VAEs suitable for fitting incomplete heterogenous data. The proposed HI-VAE includes likelihood models for real-valued, positive real valued, interval, categorical, ordinal and count data, and allows accurate estimation (and potentially imputation) of missing data. Furthermore, HI-VAE presents competitive predictive performance in supervised tasks, outperforming supervised models when trained on incomplete data.","url_abs":"https://arxiv.org/abs/1807.03653v4","url_pdf":"https://arxiv.org/pdf/1807.03653v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"handling-incomplete-heterogeneous-data-using","repo_url":"https://github.com/probabilistic-learning/HI-VAE","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"handling-incomplete-heterogeneous-data-using","repo_url":"https://github.com/adrianjav/heterogeneous_vaes","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"handling-incomplete-heterogeneous-data-using","repo_url":"https://github.com/nfdi4health/docker-vambn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"AGPL-3.0"}}],"tasks":[{"task_slug":"imputation","task_name":"Imputation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1807.03653","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1807.03653"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/probabilistic-learning/HI-VAE","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/adrianjav/heterogeneous_vaes","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nfdi4health/docker-vambn","reach":{"status":"ok","spdx":"AGPL-3.0"}}],"summary":{"unverified":11},"by_repo_kind":{"official":{"samples":11,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3d429bcfc3c677e8","entry":"batch_normalization","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"VAE_functions.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/VAE_functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3d429bcfc3c677e8"}},{"code_sha256_prefix":"a9d7aa7274a5abf9","entry":"cost_function","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"model_HIVAE_factorized.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/model_HIVAE_factorized.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a9d7aa7274a5abf9"}},{"code_sha256_prefix":"3692070b96d5bea1","entry":"getArgs","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"parser_arguments.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/parser_arguments.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3692070b96d5bea1"}},{"code_sha256_prefix":"54df9b43971857da","entry":"loglik_cat","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"loglik_models_missing_normalize.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/loglik_models_missing_normalize.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"54df9b43971857da"}},{"code_sha256_prefix":"7e1aac4d69cb3072","entry":"loglik_pos","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"loglik_models_missing_normalize.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/loglik_models_missing_normalize.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7e1aac4d69cb3072"}},{"code_sha256_prefix":"fc6abe9dbfd369fb","entry":"loglik_real","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"loglik_models_missing_normalize.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/loglik_models_missing_normalize.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fc6abe9dbfd369fb"}},{"code_sha256_prefix":"21e35880e258189a","entry":"next_batch","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"read_functions.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/read_functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"21e35880e258189a"}},{"code_sha256_prefix":"b4ed17fa0cc84438","entry":"place_holder_types","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"VAE_functions.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/VAE_functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b4ed17fa0cc84438"}},{"code_sha256_prefix":"1b8f49db2dcb26be","entry":"read_data","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"read_functions.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/read_functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1b8f49db2dcb26be"}},{"code_sha256_prefix":"dc957f51387e37d9","entry":"s_proposal_multinomial","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"VAE_functions.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/VAE_functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc957f51387e37d9"}},{"code_sha256_prefix":"34a3b61666205c08","entry":"samples_concatenation","repo":"probabilistic-learning/HI-VAE","repo_kind":"official","path":"read_functions.py","file_url":"https://github.com/probabilistic-learning/HI-VAE/blob/HEAD/read_functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"34a3b61666205c08"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}