{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/unsupervised-object-learning-via-common-fate-1","title":"Unsupervised Object Learning via Common Fate","arxiv_id":"2110.06562","date":"2021-10-13","proceeding":null,"authors":["Matthias Tangemann","Steffen Schneider","Julius von Kügelgen","Francesco Locatello","Peter Gehler","Thomas Brox","Matthias Kümmerer","Matthias Bethge","Bernhard Schölkopf"],"abstract":"Learning generative object models from unlabelled videos is a long standing problem and required for causal scene modeling. We decompose this problem into three easier subtasks, and provide candidate solutions for each of them. Inspired by the Common Fate Principle of Gestalt Psychology, we first extract (noisy) masks of moving objects via unsupervised motion segmentation. Second, generative models are trained on the masks of the background and the moving objects, respectively. Third, background and foreground models are combined in a conditional \"dead leaves\" scene model to sample novel scene configurations where occlusions and depth layering arise naturally. To evaluate the individual stages, we introduce the Fishbowl dataset positioned between complex real-world scenes and common object-centric benchmarks of simplistic objects. We show that our approach allows learning generative models that generalize beyond the occlusions present in the input videos, and represent scenes in a modular fashion that allows sampling plausible scenes outside the training distribution by permitting, for instance, object numbers or densities not observed in the training set.","url_abs":"https://arxiv.org/abs/2110.06562v2","url_pdf":"https://arxiv.org/pdf/2110.06562v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"unsupervised-object-learning-via-common-fate-1","repo_url":"https://github.com/mtangemann/common_fate_object_learning","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"motion-segmentation","task_name":"Motion Segmentation"},{"task_slug":"object","task_name":"Object"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2110.06562","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2110.06562"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mtangemann/common_fate_object_learning","reach":null}],"summary":{"ran_honours":1,"ran_draft_wrong":1,"ran_fixture":1,"ran_violates":1},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8026147d950bf149","entry":"get_bounding_box","repo":"mtangemann/common_fate_object_learning","repo_kind":"official","path":"extract_object_crops.py","file_url":"https://github.com/mtangemann/common_fate_object_learning/blob/HEAD/extract_object_crops.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8026147d950bf149"}},{"code_sha256_prefix":"d2ff154f6fbbb8a9","entry":"load_config","repo":"mtangemann/common_fate_object_learning","repo_kind":"official","path":"object_model.py","file_url":"https://github.com/mtangemann/common_fate_object_learning/blob/HEAD/object_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d2ff154f6fbbb8a9"}},{"code_sha256_prefix":"d29467384662a18f","entry":"reject_bounding_box","repo":"mtangemann/common_fate_object_learning","repo_kind":"official","path":"extract_object_crops.py","file_url":"https://github.com/mtangemann/common_fate_object_learning/blob/HEAD/extract_object_crops.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d29467384662a18f"}},{"code_sha256_prefix":"65cb5c6a7587174b","entry":"reject_random","repo":"mtangemann/common_fate_object_learning","repo_kind":"official","path":"extract_object_crops.py","file_url":"https://github.com/mtangemann/common_fate_object_learning/blob/HEAD/extract_object_crops.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"65cb5c6a7587174b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}