{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/object-centric-learning-with-slot-mixture","title":"Object-Centric Learning with Slot Mixture Module","arxiv_id":"2311.04640","date":"2023-11-08","proceeding":null,"authors":["Daniil Kirilenko","Vitaliy Vorobyov","Alexey K. Kovalev","Aleksandr I. Panov"],"abstract":"Object-centric architectures usually apply a differentiable module to the entire feature map to decompose it into sets of entity representations called slots. Some of these methods structurally resemble clustering algorithms, where the cluster's center in latent space serves as a slot representation. Slot Attention is an example of such a method, acting as a learnable analog of the soft k-means algorithm. Our work employs a learnable clustering method based on the Gaussian Mixture Model. Unlike other approaches, we represent slots not only as centers of clusters but also incorporate information about the distance between clusters and assigned vectors, leading to more expressive slot representations. Our experiments demonstrate that using this approach instead of Slot Attention improves performance in object-centric scenarios, achieving state-of-the-art results in the set property prediction task.","url_abs":"https://arxiv.org/abs/2311.04640v2","url_pdf":"https://arxiv.org/pdf/2311.04640v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"object-centric-learning-with-slot-mixture","repo_url":"https://github.com/airi-institute/smm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"clustering","task_name":"Clustering"},{"task_slug":"object","task_name":"Object"},{"task_slug":"property-prediction","task_name":"Property Prediction"}],"methods":[{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.04640","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.04640"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/airi-institute/smm","reach":null}],"summary":{"ran":2,"unverified":3},"by_repo_kind":{"official":{"samples":5,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"ca05fae56d0a5950","entry":"CrossAttention","repo":"airi-institute/smm","repo_kind":"official","path":"modules/smm.py","file_url":"https://github.com/airi-institute/smm/blob/HEAD/modules/smm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ca05fae56d0a5950"}},{"code_sha256_prefix":"5a087161bf26fc33","entry":"FeedForward","repo":"airi-institute/smm","repo_kind":"official","path":"modules/smm.py","file_url":"https://github.com/airi-institute/smm/blob/HEAD/modules/smm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5a087161bf26fc33"}},{"code_sha256_prefix":"62c19c9f7ad564f1","entry":"BasicTransformerBlock","repo":"airi-institute/smm","repo_kind":"official","path":"modules/smm.py","file_url":"https://github.com/airi-institute/smm/blob/HEAD/modules/smm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"62c19c9f7ad564f1"}},{"code_sha256_prefix":"69c2d0f3a396e225","entry":"SelfAttentionGMM","repo":"airi-institute/smm","repo_kind":"official","path":"modules/smm.py","file_url":"https://github.com/airi-institute/smm/blob/HEAD/modules/smm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"69c2d0f3a396e225"}},{"code_sha256_prefix":"ab809b20aab65634","entry":"Transformer","repo":"airi-institute/smm","repo_kind":"official","path":"modules/smm.py","file_url":"https://github.com/airi-institute/smm/blob/HEAD/modules/smm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ab809b20aab65634"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}