Papers › Contrastive Training of Complex-Valued Autoencoders for Object Discovery

Contrastive Training of Complex-Valued Autoencoders for Object Discovery

24 May 2023NeurIPS 2023 11arXiv:2305.15001archive 2025-07-28

Aleksandar Stanić, Anand Gopalakrishnan, Kazuki Irie, Jürgen Schmidhuber

Current state-of-the-art object-centric models use slots and attention-based routing for binding. However, this class of models has several conceptual limitations: the number of slots is hardwired; all slots have equal capacity; training has high computational cost; there are no object-level relational factors within slots. Synchrony-based models in principle can address these limitations by using complex-valued activations which store binding information in their phase components. However, working examples of such synchrony-based models have been developed only very recently, and are still limited to toy grayscale datasets and simultaneous storage of less than three objects in practice. Here we introduce architectural modifications and a novel contrastive learning method that greatly improve the state-of-the-art synchrony-based model. For the first time, we obtain a class of synchrony-based models capable of discovering objects in an unsupervised manner in multi-object color datasets and simultaneously representing more than three objects.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2305.15001")

Code

Syntology Ran 29 of 38 code samples harvested from 1 repository linked to this paper; 9 have no recorded run. Of those that ran: 4 ran · honoured contract; 1 ran · violated contract; 14 ran · our draft was wrong; 4 ran · fixture could not drive it; 6 ran with no contract checked.

By repository: official repository: 38 samples from 1 repository, 29 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

agopal42/ctcae officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

38 samples harvested; 29 ran; 4 honoured the contract we drafted; 9 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

4ran · honoured contract
1ran · violated contract
14ran · our draft was wrong
4ran · fixture could not drive it
6ran
9unverified

Licence: 0 of the 38 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from agopal42/ctcae. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

ComplexConv2d agopal42/ctcae/models/ctcae_model.py official repository ran MIT (permissive) · b94524beed8991fd · report
ComplexConvTranspose2d agopal42/ctcae/models/ctcae_model.py official repository ran MIT (permissive) · 87f9df0c5ba0263b · report
ComplexConvUpsample2d agopal42/ctcae/models/ctcae_model.py official repository ran MIT (permissive) · 32fbb448bc6bee93 · report
ComplexLinear agopal42/ctcae/models/ctcae_model.py official repository ran MIT (permissive) · 89bd4fbb5bfe4b2e · report
ComplexUpsample agopal42/ctcae/models/ctcae_model.py official repository ran MIT (permissive) · 2d311e2e21a3dbbf · report
Conv2dTF agopal42/ctcae/models/ctcae_model.py official repository ran fingerprinted MIT (permissive) · e7d7eb775a61658c · report
append_black_right_separator agopal42/ctcae/models/ctcae_model.py official repository ran · fixture could not drive it fingerprinted MIT (permissive) · e38855884ac1991b · report
append_border_pixels agopal42/ctcae/models/ctcae_model.py official repository ran · fixture could not drive it MIT (permissive) · d3123efe45c58cc9 · report
apply_kmeans agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong MIT (permissive) · 8f2a3483310f84a5 · report
apply_layer agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong MIT (permissive) · 193817cd55076b39 · report
batch_to_rowwise_image agopal42/ctcae/models/ctcae_model.py official repository ran · violated contract MIT (permissive) · bfcf0002f0908e3b · report
calc_ari_score agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong fingerprinted MIT (permissive) · 8fbf469567396916 · report
calculate_cluster_metrics agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong MIT (permissive) · 82c5b64172909c18 · report
clip_and_rescale agopal42/ctcae/models/ctcae_model.py official repository ran · honoured contract fingerprinted MIT (permissive) · e30f758e4571b29b · report
color_hex_to_float agopal42/ctcae/models/ctcae_model.py official repository ran · honoured contract MIT (permissive) · 6d8ef248dfd50c0e · report
color_hex_to_int agopal42/ctcae/models/ctcae_model.py official repository ran · honoured contract MIT (permissive) · 0f73b6f5607dbfc0 · report
combined_labels_to_colormap agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong fingerprinted MIT (permissive) · b1411375ee85340e · report
get_anchors_positive_and_negative_pairs agopal42/ctcae/models/ctcae_model.py official repository ran · fixture could not drive it fingerprinted MIT (permissive) · d8c2b4c45997c4de · report
get_ari_for_n_objects agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong fingerprinted MIT (permissive) · 94ad841b3183e122 · report
get_conv_biases agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong fingerprinted MIT (permissive) · 48ac46b5f4b9ad19 · report
get_conv_layers_shapes agopal42/ctcae/models/ctcae_model.py official repository ran · honoured contract MIT (permissive) · 336163d2a29c0496 · report
get_stable_angle agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong MIT (permissive) · 09227b2bfcaed35e · report
init_conv_norms agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong MIT (permissive) · d910d2285daa4de1 · report
init_magnitude_bias agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong fingerprinted MIT (permissive) · d97fbc4d2b3f3597 · report
init_phase_bias agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong fingerprinted MIT (permissive) · 201529a35cce67ab · report
phase_to_cartesian_coordinates agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong fingerprinted MIT (permissive) · f53d25628716495f · report
resize_image_batch agopal42/ctcae/models/ctcae_model.py official repository ran · fixture could not drive it MIT (permissive) · 456f8ca4ca4808a4 · report
spherical_to_cartesian_coordinates agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong fingerprinted MIT (permissive) · f10f65f89cbbf0d1 · report
tensor_to_wandb_image agopal42/ctcae/models/ctcae_model.py official repository ran · our draft was wrong MIT (permissive) · 419682da2a94001b · report
CAEMetricsRecorder agopal42/ctcae/models/ctcae_model.py official repository unverified MIT (permissive) · c4b48ec9eac36ca1 · report
ComplexAutoEncoderV2 agopal42/ctcae/models/ctcae_model.py official repository unverified MIT (permissive) · 9e50df740846fc6b · report
ComplexConvDecoder agopal42/ctcae/models/ctcae_model.py official repository unverified MIT (permissive) · a9b5cc6c540885a0 · report
ComplexEncoder agopal42/ctcae/models/ctcae_model.py official repository unverified MIT (permissive) · a1c42747d2fcef56 · report
append_mutiple_radial_plot_tuples agopal42/ctcae/models/ctcae_model.py official repository unverified MIT (permissive) · bf4c0805a187d0c9 · report
append_single_radial_plot_tuple agopal42/ctcae/models/ctcae_model.py official repository unverified MIT (permissive) · 54c7e6a22859d9a0 · report
canvas_to_numpy agopal42/ctcae/models/ctcae_model.py official repository unverified MIT (permissive) · 42afe1af390dce9a · report
create_image_grids_for_logging agopal42/ctcae/models/ctcae_model.py official repository unverified MIT (permissive) · f2983ab9dcaa0a6d · report
create_phase_colorcoded_groupings_and_radial_plots agopal42/ctcae/models/ctcae_model.py official repository unverified MIT (permissive) · 3e77d62b6f031b43 · report

Tasks

Contrastive LearningObjectObject Discovery

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Contrastive Learning

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections