{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/lost-in-latent-space-disentangled-models-and","title":"Lost in Latent Space: Disentangled Models and the Challenge of Combinatorial Generalisation","arxiv_id":"2204.02283","date":"2022-04-05","proceeding":null,"authors":["Milton L. Montero","Jeffrey S. Bowers","Rui Ponte Costa","Casimir J. H. Ludwig","Gaurav Malhotra"],"abstract":"Recent research has shown that generative models with highly disentangled representations fail to generalise to unseen combination of generative factor values. These findings contradict earlier research which showed improved performance in out-of-training distribution settings when compared to entangled representations. Additionally, it is not clear if the reported failures are due to (a) encoders failing to map novel combinations to the proper regions of the latent space or (b) novel combinations being mapped correctly but the decoder/downstream process is unable to render the correct output for the unseen combinations. We investigate these alternatives by testing several models on a range of datasets and training settings. We find that (i) when models fail, their encoders also fail to map unseen combinations to correct regions of the latent space and (ii) when models succeed, it is either because the test conditions do not exclude enough examples, or because excluded generative factors determine independent parts of the output image. Based on these results, we argue that to generalise properly, models not only need to capture factors of variation, but also understand how to invert the generative process that was used to generate the data.","url_abs":"https://arxiv.org/abs/2204.02283v2","url_pdf":"https://arxiv.org/pdf/2204.02283v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"lost-in-latent-space-disentangled-models-and","repo_url":"https://github.com/mmrl/lost-in-latent-space","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2204.02283","atlas_url":"https://app.syntology.ai/?focus=2204.02283","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.02283"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mmrl/lost-in-latent-space","reach":null}],"summary":{"ran_draft_wrong":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"db39df64f1c46af3","entry":"load_raw","repo":"mmrl/lost-in-latent-space","repo_kind":"official","path":"src/dataset/dsprites.py","file_url":"https://github.com/mmrl/lost-in-latent-space/blob/HEAD/src/dataset/dsprites.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"db39df64f1c46af3"}},{"code_sha256_prefix":"55eee286922d97ea","entry":"loss_string","repo":"mmrl/lost-in-latent-space","repo_kind":"official","path":"scripts/experiments/composition.py","file_url":"https://github.com/mmrl/lost-in-latent-space/blob/HEAD/scripts/experiments/composition.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"55eee286922d97ea"}},{"code_sha256_prefix":"4f681be2354ad0bb","entry":"metrics_string","repo":"mmrl/lost-in-latent-space","repo_kind":"official","path":"scripts/experiments/composition.py","file_url":"https://github.com/mmrl/lost-in-latent-space/blob/HEAD/scripts/experiments/composition.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4f681be2354ad0bb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}