Browse State-of-the-Art › Zero-Shot Object Detection
Zero-Shot Object Detection
39 papers with code · 7 benchmarks · 6 datasets archive 2025-07-28
Zero-shot object detection (ZSD) is the task of object detection where no visual training data is available for some of the target object classes.
( Image credit: Zero-Shot Object Detection: Learning to Simultaneously Recognize and Localize Novel Concepts )
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
7 leaderboard tables shown for this task, 7 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 1 newer paper was judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): LVIS v1.0 val (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
6 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 57 · with a code link: 39 · where Syntology ran a sample: 15 (14 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (15 of 57 tagged: 14 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 57 of 57, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
9 Mar 2023 10 repositories listed Syntology official (archive's flag): 1 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 5 harvested samples)To effectively fuse language and vision modalities, we conceptually divide a closed-set detector into three phases and propose a tight fusion solution, which includes a feature enhancer, a language-guided query…
-
19 Apr 2022 9 repositories listed Syntology official (archive's flag): 5 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 20 harvested samples) · 2 pointer-only (licence)In general, these language-augmented visual models demonstrate strong transferability to a variety of datasets and tasks.
-
15 Aug 2021 6 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)In this paper, we identify that the problem is that the binary classifiers in existing proposal methods tend to overfit to the training categories.
-
28 Apr 2021 4 repositories listedOn COCO, ViLD outperforms the previous state-of-the-art by 4.
-
14 Apr 2021 4 repositories listedWe follow this motivation and propose a new task set named zero-shot instance segmentation (ZSI).
-
17 May 2025 3 repositories listed Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 15 harvested samples)Large vision-language models exhibit inherent capabilities to handle diverse visual perception tasks.
-
16 May 2024 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)Empirical results demonstrate the effectiveness of Grounding DINO 1.
-
30 Jan 2024 3 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)The You Only Look Once (YOLO) series of detectors have established themselves as efficient and practical tools.
-
16 Jun 2023 3 repositories listedHowever, with OWL-ST, we can scale to over 1B examples, yielding further large improvement: With an L/14 architecture, OWL-ST improves AP on LVIS rare classes, for which the model has seen no human box annotations, from…
-
7 Dec 2021 3 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)The unification brings two benefits: 1) it allows GLIP to learn from both detection and grounding data to improve both tasks and bootstrap a good grounding model; 2) GLIP can leverage massive image-text pairs by…
-
22 Nov 2018 3 repositories listedThis setting gives rise to the need for correct alignment between visual and semantic concepts, so that the unseen objects can be identified using only their semantic attributes.
-
21 Mar 2024 2 repositories listedRecognizing the complementary strengths and weaknesses of both text and visual prompts, we introduce T-Rex2 that synergizes both prompts within a single model through contrastive learning.
-
11 Mar 2024 2 repositories listedEnd-to-end transformer-based detectors (DETRs) have shown exceptional performance in both closed-set and open-vocabulary object detection (OVD) tasks through the integration of language modalities.
-
21 Mar 2023 2 repositories listedWe propose a new setting for detecting unseen objects called Zero-shot Annotation object Detection (ZAD).
-
19 Oct 2020 2 repositories listedThe existing zero-shot detection approaches project visual features to the semantic domain for seen objects, hoping to map unseen objects to their corresponding semantics during inference.
-
16 May 2018 2 repositories listedObject detection is considered as one of the most challenging problems in computer vision, since it requires correct prediction of both classes and locations of objects in images.
-
18 Apr 2025 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)To assess model performance, we create a ground truth dataset by denoising and extending the foundational COOOL (Challenge-of-Out-of-Label) anomaly detection benchmark dataset with complete natural language descriptions…
-
4 Mar 2025 1 repository listedWe propose a zero-shot method that combines background subtraction, zero-shot object detection, filtering, and segmentation to leverage this dataset.
-
9 Dec 2024 1 repository listedObject detection in art is a valuable tool for the digital humanities, as it allows for faster identification of objects in artistic and historical images compared to humans.
-
3 Dec 2024 1 repository listed Syntology 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)While adversarial attacks on object detection models are well-studied for 2D images, their impact on 3D models remains underexplored.
-
21 Nov 2024 1 repository listedDINO-X employs the same Transformer-based encoder-decoder architecture as Grounding DINO 1.
-
10 Jul 2024 1 repository listedTo address these challenges, we propose a novel unified open-vocabulary detection method called OV-DINO, which is pre-trained on diverse large-scale datasets with language-aware selective fusion in a unified framework.
-
28 May 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 2 pointer-only (licence)However, existing open-vocabulary detectors trained on base category data tend to assign higher confidence to trained categories and confuse novel categories with the background.
-
19 Mar 2024 1 repository listedWe present DetToolChain, a novel prompting paradigm, to unleash the zero-shot object detection ability of multimodal large language models (MLLMs), such as GPT-4V and Gemini.
-
14 Feb 2024 1 repository listedThe complexity of food semantic attributes further makes it more difficult for current ZSD methods to distinguish various food categories.
-
7 Oct 2023 1 repository listedTo tackle this, we propose the Semantic Separable Diffusion Synthesizer (SeeDS) framework for Zero-Shot Food Detection (ZSFD).
-
22 Aug 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; the one sample that ran constructed an object rather than computing a result (of 4 harvested samples)The first key contribution of this work is to demonstrate through systematic evaluations that as the pairwise complexity of the training dataset increases, standard VLMs struggle to learn region-attribute relationships…
-
30 May 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)To address the learning inertia problem brought by the frozen detector, a vision conditioned masked language prediction strategy is proposed.
-
6 Apr 2023 1 repository listedIn this work, we are interested in open sets where the number of classes is unknown, varying, and without pre-knowledge about the objects' types.
-
26 Mar 2023 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 1 pointer-only (licence)However, previous unsupervised deep learning BGS algorithms perform poorly in sophisticated scenarios such as shadows or night lights, and they cannot detect objects outside the pre-defined categories.
-
12 Dec 2022 1 repository listed
-
15 Feb 2022 1 repository listed
-
1 Jan 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
22 Nov 2021 1 repository listed
-
24 Sep 2021 1 repository listed
-
9 Oct 2020 1 repository listed
-
19 Jan 2020 1 repository listed Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
Finding the Reflection Point: Unpadding Images to Remove Data Augmentation Artifacts in Large Open Source Image Datasets for Machine Learning4 Apr 2025 0 repositories listed
-
The Power of One: A Single Example is All it Takes for Segmentation in VLMs13 Mar 2025 0 repositories listed
-
1 Mar 2025 0 repositories listed
-
13 Dec 2024 0 repositories listed
-
Segment Anything Model for automated image data annotation: empirical studies using text prompts from Grounding DINO27 Jun 2024 0 repositories listed
-
Eating Smart: Advancing Health Informatics with the Grounding DINO based Dietary Assistant App2 Jun 2024 0 repositories listed
-
Multimodal Data Curation via Object Detection and Filter Ensembles5 Jan 2024 0 repositories listed
-
Zero-Shot Visual Classification with Guided Cropping12 Sep 2023 0 repositories listed
-
Meta-ZSDETR: Zero-shot DETR with Meta-learning18 Aug 2023 0 repositories listed
-
Frustratingly Simple but Effective Zero-shot Detection and Segmentation: Analysis and a Strong Baseline14 Feb 2023 0 repositories listed
-
Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting16 Apr 2022 0 repositories listed
-
On Hyperbolic Embeddings in 2D Object Detection15 Mar 2022 0 repositories listed
-
A Survey of Deep Learning for Low-Shot Object Detection6 Dec 2021 0 repositories listed
-
Zero-shot detection of daily objects in YCB video dataset29 Sep 2021 0 repositories listed
-
4 Sep 2021 0 repositories listed
-
Transductive Learning for Zero-Shot Object Detection1 Oct 2019 0 repositories listed
-
Image Captioning with Unseen Objects31 Jul 2019 0 repositories listed
-
Zero-Shot Object Detection12 Apr 2018 0 repositories listed
Syntology lines on 17 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections