{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/multi-object-representation-learning-with","title":"Multi-Object Representation Learning with Iterative Variational Inference","arxiv_id":"1903.00450","date":"2019-03-01","proceeding":null,"authors":["Klaus Greff","Raphaël Lopez Kaufman","Rishabh Kabra","Nick Watters","Chris Burgess","Daniel Zoran","Loic Matthey","Matthew Botvinick","Alexander Lerchner"],"abstract":"Human perception is structured around objects which form the basis for our higher-level cognition and impressive systematic generalization abilities. Yet most work on representation learning focuses on feature learning without even considering multiple objects, or treats segmentation as an (often supervised) preprocessing step. Instead, we argue for the importance of learning to segment and represent objects jointly. We demonstrate that, starting from the simple assumption that a scene is composed of multiple entities, it is possible to learn to segment images into interpretable objects with disentangled representations. Our method learns -- without supervision -- to inpaint occluded parts, and extrapolates to scenes with more objects and to unseen objects with novel feature combinations. We also show that, due to the use of iterative variational inference, our system is able to learn multi-modal posteriors for ambiguous inputs and extends naturally to sequences.","url_abs":"https://arxiv.org/abs/1903.00450v3","url_pdf":"https://arxiv.org/pdf/1903.00450v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"multi-object-representation-learning-with","repo_url":"https://github.com/deepmind/deepmind-research","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":null},{"paper_slug":"multi-object-representation-learning-with","repo_url":"https://github.com/BorealisAI/PROVIDE","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"multi-object-representation-learning-with","repo_url":"https://github.com/BorealisAI/Spatio-Temporal","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"multi-object-representation-learning-with","repo_url":"https://github.com/MichaelKevinKelly/IODINE","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"multi-object-representation-learning-with","repo_url":"https://github.com/pemami4911/IODINE.pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"multi-object-representation-learning-with","repo_url":"https://github.com/zhixuan-lin/IODINE","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"object","task_name":"Object"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"systematic-generalization","task_name":"Systematic Generalization"},{"task_slug":"unsupervised-object-segmentation","task_name":"Unsupervised Object Segmentation"},{"task_slug":"variational-inference","task_name":"Variational Inference"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1903.00450","atlas_url":"https://app.syntology.ai/?focus=1903.00450","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1903.00450"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/deepmind/deepmind-research","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhixuan-lin/IODINE","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/BorealisAI/Spatio-Temporal","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/BorealisAI/PROVIDE","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pemami4911/IODINE.pytorch","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MichaelKevinKelly/IODINE","reach":{"status":"ok"}}],"summary":{"ran":2,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"listed":{"samples":6,"ran":3,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"585f3727981bb5df","entry":"adjusted_rand_index","repo":"pemami4911/IODINE.pytorch","repo_kind":"listed","path":"lib/metrics.py","file_url":"https://github.com/pemami4911/IODINE.pytorch/blob/HEAD/lib/metrics.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"585f3727981bb5df"}},{"code_sha256_prefix":"f396c5c7325b9097","entry":"gaussian_likelihood","repo":"zhixuan-lin/IODINE","repo_kind":"listed","path":"lib/modeling/iodine.py","file_url":"https://github.com/zhixuan-lin/IODINE/blob/HEAD/lib/modeling/iodine.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f396c5c7325b9097"}},{"code_sha256_prefix":"e4622838fa883584","entry":"mvn","repo":"pemami4911/IODINE.pytorch","repo_kind":"listed","path":"lib/utils.py","file_url":"https://github.com/pemami4911/IODINE.pytorch/blob/HEAD/lib/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e4622838fa883584"}},{"code_sha256_prefix":"4b24cc3d787209ad","entry":"gaussian_log_likelihood","repo":"zhixuan-lin/IODINE","repo_kind":"listed","path":"lib/modeling/iodine.py","file_url":"https://github.com/zhixuan-lin/IODINE/blob/HEAD/lib/modeling/iodine.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4b24cc3d787209ad"}},{"code_sha256_prefix":"dbbbca9a6ee4050e","entry":"std_mvn","repo":"pemami4911/IODINE.pytorch","repo_kind":"listed","path":"lib/utils.py","file_url":"https://github.com/pemami4911/IODINE.pytorch/blob/HEAD/lib/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dbbbca9a6ee4050e"}},{"code_sha256_prefix":"f063d80ee3c977d0","entry":"truncated_normal_initializer","repo":"pemami4911/IODINE.pytorch","repo_kind":"listed","path":"lib/utils.py","file_url":"https://github.com/pemami4911/IODINE.pytorch/blob/HEAD/lib/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f063d80ee3c977d0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}