{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/bridging-the-gap-to-real-world-object-centric","title":"Bridging the Gap to Real-World Object-Centric Learning","arxiv_id":"2209.14860","date":"2022-09-29","proceeding":null,"authors":["Maximilian Seitzer","Max Horn","Andrii Zadaianchuk","Dominik Zietlow","Tianjun Xiao","Carl-Johann Simon-Gabriel","Tong He","Zheng Zhang","Bernhard Schölkopf","Thomas Brox","Francesco Locatello"],"abstract":"Humans naturally decompose their environment into entities at the appropriate level of abstraction to act in the world. Allowing machine learning algorithms to derive this decomposition in an unsupervised way has become an important line of research. However, current methods are restricted to simulated data or require additional information in the form of motion or depth in order to successfully discover objects. In this work, we overcome this limitation by showing that reconstructing features from models trained in a self-supervised manner is a sufficient training signal for object-centric representations to arise in a fully unsupervised way. Our approach, DINOSAUR, significantly out-performs existing image-based object-centric learning models on simulated data and is the first unsupervised object-centric model that scales to real-world datasets such as COCO and PASCAL VOC. DINOSAUR is conceptually simple and shows competitive performance compared to more involved pipelines from the computer vision literature.","url_abs":"https://arxiv.org/abs/2209.14860v2","url_pdf":"https://arxiv.org/pdf/2209.14860v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"bridging-the-gap-to-real-world-object-centric","repo_url":"https://github.com/amazon-science/object-centric-learning-framework","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"bridging-the-gap-to-real-world-object-centric","repo_url":"https://github.com/gkakogeorgiou/spot","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"bridging-the-gap-to-real-world-object-centric","repo_url":"https://github.com/martius-lab/videosaur","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"bridging-the-gap-to-real-world-object-centric","repo_url":"https://github.com/gorkaydemir/DINOSAUR","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"object","task_name":"Object"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2209.14860","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2209.14860"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/martius-lab/videosaur","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/amazon-science/object-centric-learning-framework","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gkakogeorgiou/spot","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gorkaydemir/DINOSAUR","reach":null}],"summary":{"unverified":6},"by_repo_kind":{"listed":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"59deab4f06803df3","entry":"build_grid_of_positions","repo":"amazon-science/object-centric-learning-framework","repo_kind":"listed","path":"ocl/decoding.py","file_url":"https://github.com/amazon-science/object-centric-learning-framework/blob/HEAD/ocl/decoding.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"59deab4f06803df3"}},{"code_sha256_prefix":"aa28e265b647f54d","entry":"collate_with_autopadding","repo":"amazon-science/object-centric-learning-framework","repo_kind":"listed","path":"ocl/datasets.py","file_url":"https://github.com/amazon-science/object-centric-learning-framework/blob/HEAD/ocl/datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"aa28e265b647f54d"}},{"code_sha256_prefix":"86591dc9671756b6","entry":"collate_with_batch_size","repo":"amazon-science/object-centric-learning-framework","repo_kind":"listed","path":"ocl/datasets.py","file_url":"https://github.com/amazon-science/object-centric-learning-framework/blob/HEAD/ocl/datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"86591dc9671756b6"}},{"code_sha256_prefix":"1d2c0e37157e1caf","entry":"get_activation_fn","repo":"amazon-science/object-centric-learning-framework","repo_kind":"listed","path":"ocl/neural_networks/convenience.py","file_url":"https://github.com/amazon-science/object-centric-learning-framework/blob/HEAD/ocl/neural_networks/convenience.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1d2c0e37157e1caf"}},{"code_sha256_prefix":"52aee8abab13a6f4","entry":"get_savi_decoder_backbone","repo":"amazon-science/object-centric-learning-framework","repo_kind":"listed","path":"ocl/decoding.py","file_url":"https://github.com/amazon-science/object-centric-learning-framework/blob/HEAD/ocl/decoding.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"52aee8abab13a6f4"}},{"code_sha256_prefix":"96e3bb95cafb508e","entry":"get_slotattention_decoder_backbone","repo":"amazon-science/object-centric-learning-framework","repo_kind":"listed","path":"ocl/decoding.py","file_url":"https://github.com/amazon-science/object-centric-learning-framework/blob/HEAD/ocl/decoding.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"96e3bb95cafb508e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}