Browse State-of-the-Art › Systematic Generalization
Systematic Generalization
77 papers with code · 0 benchmarks · 7 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
7 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 126 · with a code link: 77 · where Syntology ran a sample: 36 (33 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (36 of 126 tagged: 33 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 126, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
1 Mar 2019 6 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)Human perception is structured around objects which form the basis for our higher-level cognition and impressive systematic generalization abilities.
-
16 Aug 2019 5 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)The recent success of natural language understanding (NLU) systems has been troubled by results highlighting the failure of these models to generalize in a systematic and robust way.
-
8 Oct 2020 4 repositories listedEnvironments with procedurally generated content serve as important benchmarks for testing systematic generalization in deep reinforcement learning.
-
11 Mar 2020 4 repositories listedIn this paper, we introduce a new benchmark, gSCAN, for evaluating compositional generalization in situated language understanding.
-
24 Nov 2021 3 repositories listed Syntology official (archive's flag): 3 ran · 11 ran (of which 8 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 10 pointer-only (licence)Object-centric representations are a promising path toward more systematic generalization by providing flexible abstractions upon which compositional world models can be built.
-
24 Jun 2020 3 repositories listed Syntology official (archive's flag): 1 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 3 pointer-only (licence)Here, we present the NetHack Learning Environment (NLE), a scalable, procedurally generated, stochastic, rich, and challenging environment for RL research based on the popular single-player terminal-based roguelike…
-
12 Dec 2019 3 repositories listed Syntology official (archive's flag): 2 ran · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 2 pointer-only (licence)In this work, we study how systematic the generalization of such models is, that is to which extent they are capable of handling novel combinations of known linguistic constructs.
-
6 Mar 2024 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)Abstract visual reasoning is a characteristically human ability, allowing the identification of relational patterns that are abstracted away from object features, and the systematic generalization of those patterns to…
-
31 May 2023 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)Neuro-Symbolic (NeSy) predictive models hold the promise of improved compliance with given constraints, systematic generalization, and interpretability, as they allow to infer labels that are consistent with some prior…
-
6 Oct 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 8 harvested samples)We show that a wide spectrum of robot manipulation tasks can be expressed with multimodal prompts, interleaving textual and visual tokens.
-
25 Sep 2021 2 repositories listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 1 pointer-only (licence)We analyze the grounded SCAN (gSCAN) benchmark, which was recently proposed to study systematic generalization for grounded language understanding.
-
26 Aug 2021 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)Our models improve accuracy from 50% to 85% on the PCFG productivity split, and from 35% to 81% on COGS.
-
30 Sep 2020 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We observe that models that are not trained to generate proofs are better at generalizing to problems based on longer proofs.
-
11 Sep 2020 2 repositories listedSystematic Generalization refers to a learning algorithm's ability to extrapolate learned behavior to unseen situations that are distinct but semantically similar to its training data.
-
14 Mar 2020 2 repositories listedHumans can systematically generalize to novel compositions of existing concepts.
-
30 Nov 2018 2 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)Numerous models for grounded language understanding have been recently proposed, including (i) generic models that can be easily adapted to any given task and (ii) intuitively appealing modular models that require…
-
2 Apr 2025 1 repository listedTo this end, we introduce SYGAR-a dataset designed to evaluate the capacity of models to systematically generalize from known geometric transformations (e. g., translation, rotation) of two-dimensional objects to novel…
-
7 Feb 2025 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 4 pointer-only (licence)1) Structural Advantage: CoT training internalizes reasoning into a two-stage generalizing circuit, where the number of stages corresponds to the explicit reasoning steps during training.
-
Inductive Biases for Zero-shot Systematic Generalization in Language-informed Reinforcement Learning25 Jan 2025 1 repository listedHowever, to transfer these properties of language to the decision-making process, it is necessary to establish a proper language grounding mechanism.
-
29 Nov 2024 1 repository listedGrounding the instruction in the environment is a key step in solving language-guided goal-reaching reinforcement learning problems.
-
12 Oct 2024 1 repository listedOn a test set composed of all possible isomers of binary transition metal complexes, the best MBE models achieve mean absolute errors of 2.
-
23 Sep 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 11 harvested samples)Our results shed light on the difficulty of module specialization, what is required for modules to successfully specialize, and the necessity of modular architectures to achieve systematicity.
-
24 Jul 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples)A common solution is to instead rely on neuro-symbolic methods, which are capable of reasoning in a systematic way by design.
-
18 Jun 2024 1 repository listedThe game ends when all edges have been considered, resulting in a certain graph G_T, and f(G_T) is the final score of the game; RL is then used to maximize this score.
-
11 Jun 2024 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 3 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified (of 14 harvested samples)To address this decomposition problem, we propose a Discrete Dictionary-based Decomposition (D3) layer designed to enhance the decomposition capabilities of TPR-based models.
-
11 Jun 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)Learning modular object-centric representations is crucial for systematic generalization.
-
3 Jun 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)In recent research, Tensor Product Representation (TPR) is applied for the systematic generalization task of deep neural networks by learning the compositional structure of data.
-
26 May 2024 1 repository listedFor routing function, we tailor two innovative routing functions according to the granularity: TensorPoly-I which directs to each rank within the entangled tensor while TensorPoly-II offers a finer-grained routing…
-
1 May 2024 1 repository listedLearning compositional representation is a key aspect of object-centric learning as it enables flexible systematic generalization and supports complex visual reasoning.
-
27 Feb 2024 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 2 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 13 harvested samples)Through carefully designed intervention experiments on five math tasks, we confirm that transformers are performing case-based reasoning, no matter whether scratchpad is used, which aligns with the previous observations…
-
26 Jan 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
1 Oct 2023 1 repository listed
-
28 Sep 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
15 Sep 2023 1 repository listed
-
29 Jun 2023 1 repository listed
-
5 Jun 2023 1 repository listed
-
4 Jun 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
17 May 2023 1 repository listed
-
7 Mar 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
23 Feb 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
28 Nov 2022 1 repository listed
-
3 Oct 2022 1 repository listed
-
24 Aug 2022 1 repository listed
-
16 Jul 2022 1 repository listed
-
19 May 2022 1 repository listed
-
24 Apr 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
9 Mar 2022 1 repository listed
-
22 Feb 2022 1 repository listed
-
27 Jan 2022 1 repository listed
-
1 Dec 2021 1 repository listed
-
28 Nov 2021 1 repository listed
-
17 Oct 2021 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
14 Oct 2021 1 repository listed
-
14 Oct 2021 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 5 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)
-
8 Oct 2021 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
28 Sep 2021 1 repository listed
-
2 Sep 2021 1 repository listed
-
1 Aug 2021 1 repository listed
-
1 Jul 2021 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
15 Jun 2021 1 repository listed
-
7 Jun 2021 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)
-
6 Jun 2021 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
2 Jun 2021 1 repository listed
-
21 May 2021 1 repository listed
-
10 Feb 2021 1 repository listed
-
1 Jan 2021 1 repository listed
-
23 Oct 2020 1 repository listed
-
6 Oct 2020 1 repository listed Syntology 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
5 Oct 2020 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
6 Aug 2020 1 repository listed
-
1 Jul 2020 1 repository listed
-
Neural Natural Language Inference Models Partially Embed Theories of Lexical Entailment and Negation30 Apr 2020 1 repository listed
-
24 Oct 2019 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Behavioural vs. Representational Systematicity in End-to-End Models: An Opinionated Survey4 Jun 2025 0 repositories listed
-
Systematic Generalization in Language Models Scales with Information Entropy19 May 2025 0 repositories listed
-
Florenz: Scaling Laws for Systematic Generalization in Vision-Language Models12 Mar 2025 0 repositories listed
-
Enhancing NLP Robustness and Generalization through LLM-Generated Contrast Sets: A Scalable Framework for Systematic Evaluation and Adversarial Training9 Mar 2025 0 repositories listed
-
Towards Conscious Service Robots25 Jan 2025 0 repositories listed
-
Data Distributional Properties As Inductive Bias for Systematic Generalization1 Jan 2025 0 repositories listed
-
Is Multiple Object Tracking a Matter of Specialization?1 Nov 2024 0 repositories listed
-
Neural networks that overcome classic challenges through practice14 Oct 2024 0 repositories listed
-
Compositional Models for Estimating Causal Effects25 Jun 2024 0 repositories listed
-
What makes Models Compositional? A Theoretical View: With Supplement2 May 2024 0 repositories listed
-
Composing Pre-Trained Object-Centric Representations for Robotics From "What" and "Where" Foundation Models20 Apr 2024 0 repositories listed
-
A Neural Rewriting System to Solve Algorithmic Problems27 Feb 2024 0 repositories listed
-
Benchmarking GPT-4 on Algorithmic Problems: A Systematic Evaluation of Prompting Strategies27 Feb 2024 0 repositories listed
-
Unsupervised Discovery of Object-Centric Neural Fields12 Feb 2024 0 repositories listed
-
Interpretability Illusions in the Generalization of Simplified Models6 Dec 2023 0 repositories listed
-
Generating Interpretable Networks using Hypernetworks5 Dec 2023 0 repositories listed
-
Imagine the Unseen World: A Benchmark for Systematic Generalization in Visual World Models15 Nov 2023 0 repositories listed
-
1 Aug 2023 0 repositories listed
-
23 May 2023 0 repositories listed
-
SlotDiffusion: Object-Centric Generative Modeling with Diffusion Models18 May 2023 0 repositories listed
-
On the Generalization of Learned Structured Representations25 Apr 2023 0 repositories listed
-
An Investigation into Pre-Training Object-Centric Representations for Reinforcement Learning9 Feb 2023 0 repositories listed
-
A Short Survey of Systematic Generalization22 Nov 2022 0 repositories listed
Syntology lines on 38 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections