Compositional Generalization (AVG)

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

3 shown of 3 papers with code (4 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Systematic Generalization on gSCAN: What is Nearly Solved and What is Next?
  25 Sep 2021 2 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  We analyze the grounded SCAN (gSCAN) benchmark, which was recently proposed to study systematic generalization for grounded language understanding.
• NeSyCoCo: A Neuro-Symbolic Concept Composer for Compositional Generalization
  20 Dec 2024 1 repository listed
  Compositional generalization is crucial for artificial intelligence agents to solve complex vision-language reasoning tasks.
• When Can Transformers Ground and Compose: Insights from Compositional Generalization Benchmarks
  23 Oct 2022 1 repository listed Syntology ran 0 of 8 samples · 8 unverified
  On analyzing the task, we find that identifying the target location in the grid world is the main challenge for the models.

Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.