Browse State-of-the-Art › Zero-shot Generalization
Zero-shot Generalization
301 papers with code · 1 benchmark · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| CALVIN (5 rows) | GR-MG | GR-MG: Leveraging Partially Annotated Data via Multi-Modal... | code | Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 2 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 572 · with a code link: 301 · where Syntology ran a sample: 128 (116 with a run with no instrument failure, 12 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (128 of 572 tagged: 116 with a run with no instrument failure, 12 where every run was a failure of Syntology's instrument)
Page 1 of 6: papers 1 to 100 of 572, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
15 Oct 2021 8 repositories listed Syntology official (archive's flag): 6 ran · 13 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 1 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 15 harvested samples) · 3 pointer-only (licence)Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020).
-
31 Oct 2017 7 repositories listedHumans can understand and produce new utterances effortlessly, thanks to their compositional skills.
-
23 Feb 2023 6 repositories listed Syntology official (archive's flag): 1 ran · 12 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 9 where Syntology's instrument failed) · 4 unverified (of 16 harvested samples) · 10 pointer-only (licence)Finally, ZoeD-M12-NK is the first model that can jointly train on multiple datasets (NYU Depth v2 and KITTI) without a significant drop in performance and achieve unprecedented zero-shot generalization performance to…
-
4 Dec 2023 4 repositories listed Syntology official (archive's flag): 9 ran · 22 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 3 violated, 14 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 26 harvested samples) · 5 pointer-only (licence)Monocular depth estimation is a fundamental computer vision task.
-
12 Jun 2020 4 repositories listed Syntology official: harvested, nothing ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples)End-to-end training of neural network solvers for graph combinatorial optimization problems such as the Travelling Salesperson Problem (TSP) have seen a surge of interest recently, but remain intractable and inefficient…
-
12 Sep 2019 4 repositories listedIn this work, we introduce the the Schema-Guided Dialogue (SGD) dataset, containing over 16k multi-domain conversations spanning 16 domains.
-
4 Jun 2019 4 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)While multi-agent interactions can be naturally modeled as a graph, the environment has traditionally been considered as a black box.
-
9 Mar 2025 3 repositories listedTraditional methods for reasoning segmentation rely on supervised fine-tuning with categorical labels and simple descriptions, limiting its out-of-domain generalization and lacking explicit reasoning processes.
-
3 Apr 2024 3 repositories listed Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)We present Visual AutoRegressive modeling (VAR), a new generation paradigm that redefines the autoregressive learning on images as coarse-to-fine "next-scale prediction" or "next-resolution prediction", diverging from…
-
8 Feb 2024 3 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)Unlike past methods that learn to route among specialized models, PHATGOOSE explores the possibility that zero-shot generalization will be improved if different experts can be adaptively chosen for each token and at…
-
In this paper, we extend the scope of this effectiveness by showing that visual robot manipulation can significantly benefit from large-scale video generative pre-training.
-
17 May 2023 3 repositories listed Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 3 pointer-only (licence)Tested on 14 previously unseen datasets, the One-Prompt Model showcases superior zero-shot segmentation capabilities, outperforming a wide range of related methods.
-
21 Dec 2022 3 repositories listedTo address this issue, we propose Img2Prompt, a plug-and-play module that provides the prompts that can bridge the aforementioned modality and task disconnections, so that LLMs can perform zero-shot VQA tasks without…
-
22 Mar 2022 3 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Multiple domains like vision, natural language, and audio are witnessing tremendous progress by leveraging Transformers for large scale pre-training followed by task specific fine tuning.
-
8 Jul 2020 3 repositories listed Syntology official (archive's flag): 3 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 3 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 2 pointer-only (licence)In this work, we focus on an analogical reasoning task that contains rich compositional structures, Raven's Progressive Matrices (RPM).
-
5 Nov 2019 3 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)We study compositional generalization, viz., the problem of zero-shot generalization to novel compositions of concepts in a domain.
-
29 Oct 2019 3 repositories listedWe introduce the Convolutional Conditional Neural Process (ConvCNP), a new member of the Neural Process family that models translation equivariance in the data.
-
3 Jul 2025 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)We introduce DeSTA2.
-
15 Apr 2025 2 repositories listed Syntology official (archive's flag): 16 ran · 16 ran (of which 9 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 6 where Syntology's instrument failed) · 15 unverified (of 31 harvested samples) · 31 pointer-only (licence)Unsupervised reinforcement learning (RL) aims at pre-training agents that can solve a wide range of downstream tasks in complex environments.
-
Efficient Alignment of Unconditioned Action Prior for Language-conditioned Pick and Place in Clutter12 Mar 2025 2 repositories listedWe study the task of language-conditioned pick and place in clutter, where a robot should grasp a target object in open clutter and move it to a specified place.
-
17 Jan 2025 2 repositories listed Syntology official (archive's flag): 35 ran · 36 ran (of which 23 constructed an object rather than computing a result; 26 with no instrument failure: 1 honoured, 1 violated, 24 with no contract checked; 10 where Syntology's instrument failed) · 10 unverified (of 46 harvested samples) · 46 pointer-only (licence)However, achieving strong zero-shot generalization - a hallmark of foundation models in other computer vision tasks - remains challenging for stereo matching.
-
9 Jan 2025 2 repositories listedDetecting object-level changes between two images across possibly different views is a core task in many applications that involve visual inspection or camera surveillance.
-
7 Jan 2025 2 repositories listedDespite the considerable performance improvements of face recognition algorithms in recent years, the same scientific advances responsible for this progress can also be used to create efficient ways to attack them…
-
20 Dec 2024 2 repositories listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 1 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 5 pointer-only (licence)Diffusion Transformers (DiT) have become a leading architecture in image generation.
-
24 Sep 2024 2 repositories listed Syntology official (archive's flag): 16 ran · 16 ran (of which 6 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 7 where Syntology's instrument failed) · 10 unverified (of 26 harvested samples) · 26 pointer-only (licence)Instruction tuning has emerged as an effective strategy for achieving zero-shot generalization by finetuning pretrained models on diverse multimodal tasks.
-
31 Jul 2024 2 repositories listedTo address this gap, this work conducts a systematic review on SAM for videos in the era of foundation models.
-
4 Jun 2024 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 1 pointer-only (licence)We consider the task of active geo-localization (AGL) in which an agent uses a sequence of visual cues observed during aerial navigation to find a target specified through multiple possible modalities.
-
2 May 2024 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)Learning to solve vehicle routing problems (VRPs) has garnered much attention.
-
14 Mar 2024 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 12 harvested samples)Segment anything models (SAMs) are gaining attention for their zero-shot generalization capability in segmenting objects of unseen classes and in unseen domains when properly prompted.
-
12 Mar 2024 2 repositories listedRSBuilding is designed to enhance cross-scene generalization and task universality.
-
21 Feb 2024 2 repositories listed
-
4 Feb 2024 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)
-
25 Nov 2023 2 repositories listed
-
5 Nov 2023 2 repositories listed
-
31 Jul 2023 2 repositories listed
-
27 May 2023 2 repositories listed Syntology official (archive's flag): 7 ran · 9 ran (of which 1 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
19 May 2023 2 repositories listed Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 3 honoured, 1 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 1 pointer-only (licence)
-
18 May 2023 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 5 pointer-only (licence)
-
12 Apr 2023 2 repositories listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 5 pointer-only (licence)
-
30 Mar 2023 2 repositories listed
-
28 Feb 2023 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
21 Jan 2023 2 repositories listed Syntology community repositories only · 5 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
6 Oct 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 8 harvested samples)
-
4 Aug 2022 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 3 harvested samples) · 3 pointer-only (licence)
-
14 Jul 2022 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples)
-
30 Jun 2022 2 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
22 Jun 2021 2 repositories listed
-
1 Jun 2021 2 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 3 pointer-only (licence)
-
3 Nov 2020 2 repositories listed Syntology official (archive's flag): 18 ran · 18 ran (of which 14 constructed an object rather than computing a result; 16 with no instrument failure: 2 honoured, 0 violated, 14 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 21 harvested samples) · 20 pointer-only (licence)
-
2 Feb 2020 2 repositories listed
-
4 Apr 2019 2 repositories listed
-
14 Jun 2017 2 repositories listed
-
13 Jun 2017 2 repositories listed
-
26 Jun 2025 1 repository listed
-
25 Jun 2025 1 repository listed
-
24 Jun 2025 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
13 Jun 2025 1 repository listed
-
6 Jun 2025 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
4 Jun 2025 1 repository listed
-
30 May 2025 1 repository listed
-
30 May 2025 1 repository listed
-
26 May 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
26 May 2025 1 repository listed
-
23 May 2025 1 repository listed
-
21 May 2025 1 repository listed
-
21 May 2025 1 repository listed
-
19 May 2025 1 repository listed
-
17 May 2025 1 repository listed
-
16 May 2025 1 repository listed
-
14 May 2025 1 repository listed
-
13 May 2025 1 repository listed
-
10 May 2025 1 repository listed
-
8 May 2025 1 repository listed
-
5 May 2025 1 repository listed
-
28 Apr 2025 1 repository listed
-
16 Apr 2025 1 repository listed
-
15 Apr 2025 1 repository listed
-
10 Apr 2025 1 repository listed
-
6 Apr 2025 1 repository listed
-
3 Apr 2025 1 repository listed
-
3 Apr 2025 1 repository listed
-
28 Mar 2025 1 repository listed
-
24 Mar 2025 1 repository listed
-
24 Mar 2025 1 repository listed
-
20 Mar 2025 1 repository listed
-
20 Mar 2025 1 repository listed
-
19 Mar 2025 1 repository listed
-
13 Mar 2025 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 0 violated, 4 with no contract checked; 7 where Syntology's instrument failed) · 5 unverified (of 18 harvested samples) · 6 pointer-only (licence)
-
11 Mar 2025 1 repository listed
-
10 Mar 2025 1 repository listed
-
8 Mar 2025 1 repository listed
-
3 Mar 2025 1 repository listed
-
2 Mar 2025 1 repository listed
-
2 Mar 2025 1 repository listed Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
19 Feb 2025 1 repository listed
-
17 Feb 2025 1 repository listed
-
LR0.FM: Low-Res Benchmark and Improving Robustness for Zero-Shot Classification in Foundation Models6 Feb 2025 1 repository listed
-
16 Jan 2025 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 5 pointer-only (licence)
Syntology lines on 41 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections