Browse State-of-the-Art › Visual Prompting
Visual Prompting
60 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Visual Prompting is the task of streamlining computer vision processes by harnessing the power of prompts, inspired by the breakthroughs of text prompting in NLP. This innovative approach involves using a few visual prompts to swiftly convert an unlabeled dataset into a deployed model, significantly reducing development time for both individual projects and enterprise solutions.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 127 · with a code link: 60 · where Syntology ran a sample: 26 (19 with a run with no instrument failure, 7 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (26 of 127 tagged: 19 with a run with no instrument failure, 7 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 127, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
5 Apr 2023 32 repositories listed Syntology official (archive's flag): 1 ran · 20 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 1 honoured, 2 violated, 11 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified (of 23 harvested samples) · 2 pointer-only (licence)We introduce the Segment Anything (SA) project: a new task, model, and dataset for image segmentation.
-
1 Dec 2023 4 repositories listedFurthermore, we present ViP-Bench, a comprehensive benchmark to assess the capability of models in understanding visual prompts across multiple dimensions, enabling future research in this domain.
-
17 Oct 2023 4 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)We present Set-of-Mark (SoM), a new visual prompting method, to unleash the visual grounding abilities of large multimodal models (LMMs), such as GPT-4V.
-
22 Nov 2023 3 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 6 pointer-only (licence)In-context prompting in large language models (LLMs) has become a prevalent approach to improve zero-shot capabilities, but this idea is less explored in the vision domain.
-
29 Aug 2023 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)This empirical investigation underscores the need for a nuanced understanding beyond mere accuracy in sparse and quantized settings, thereby paving the way for further exploration in Visual Prompting techniques tailored…
-
29 May 2023 2 repositories listedWe take inspiration from the widely-used pre-training and then prompt tuning protocols in NLP and propose a new visual prompting model, named Explicit Visual Prompting (EVP).
-
12 Oct 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)In this work, we leverage visual prompting (VP) to improve adversarial robustness of a fixed, pre-trained model at testing time.
-
7 Jun 2025 1 repository listedMSD-CoT progressively disentangles image captions to eliminate semantic ambiguity, while RDVP injects spatial constraints into visual prompting and independently samples visual prompts for foreground and background…
-
7 May 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)Vision GNN (ViG) demonstrates superior performance by representing images as graph structures, providing a more natural way to capture irregular semantic patterns beyond traditional grid or sequence-based…
-
5 May 2025 1 repository listedExtensive experiments across various benchmarks demonstrate that TCPA significantly enhances the diversity and discriminative power of the extracted features.
-
25 Mar 2025 1 repository listedTo address the challenges of missing the useful future context, we develop a novel framework, named Online-MMSI-VLM, that leverages two complementary strategies: multi-party conversation forecasting and social-aware…
-
10 Mar 2025 1 repository listedLane topology extraction involves detecting lanes and traffic elements and determining their relationships, a key perception task for mapless autonomous driving.
-
8 Mar 2025 1 repository listedDepth ambiguity is a fundamental challenge in spatial scene understanding, especially in transparent scenes where single-depth estimates fail to capture full 3D structure.
-
2 Feb 2025 1 repository listedVisual prompting has gained popularity as a method for adapting pre-trained models to specific tasks, particularly in the realm of parameter-efficient tuning.
-
26 Jan 2025 1 repository listedThe stories and characters that captivate us as we grow up shape unique fantasy worlds, with images serving as the primary medium for visually experiencing these realms.
-
2 Jan 2025 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)To address this, we introduce GPT4Scene, a novel visual prompting paradigm in VLM training and inference that helps build the global-local relationship, significantly improving the 3D spatial understanding of indoor…
-
12 Dec 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)To prevent the loss of discriminative information during state space propagation, SVP employs lightweight selective prompters for token-wise prompt generation, ensuring adaptive activation of the update and forget gates…
-
4 Dec 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Building upon this pipeline, we proposed Inst-IT, a solution to enhance LMMs in Instance understanding via explicit visual prompt Instruction Tuning.
-
18 Nov 2024 1 repository listedGraphical User Interface (GUI) grounding plays a crucial role in enhancing the capabilities of Vision-Language Model (VLM) agents.
-
29 Oct 2024 1 repository listedAdditionally, we demonstrate that performance when using automated methods can be improved by up to 68% via a finetuning approach.
-
27 Sep 2024 1 repository listedPiVOT proposes a prompt generation network with the pre-trained foundation model CLIP to automatically generate and refine visual prompts, enabling the transfer of foundation model knowledge for tracking.
-
25 Sep 2024 1 repository listed Syntology official (archive's flag): 6 ran · 8 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples) · 2 pointer-only (licence)To fill this gap, in this work, we propose a new prompting technique named Attention Prompting on Image, which just simply overlays a text-query-guided attention heatmap on the original input image and effectively…
-
3 Sep 2024 1 repository listedAdapting pre-trained models to new tasks can exhibit varying effectiveness across datasets.
-
30 Aug 2024 1 repository listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Video action localization aims to find the timings of specific actions from a long video.
-
6 Aug 2024 1 repository listedWith growing interest in recent years, medical visual question answering (Med-VQA) has rapidly evolved, with multimodal large language models (MLLMs) emerging as an alternative to classical model architectures.
-
18 Jul 2024 1 repository listedSpecifically, a shared visual encoding method is developed to establish the spatial pattern interpretation relationships between the multi-scale representations of input images and various visual prompts.
-
15 Jul 2024 1 repository listedWe design a visual prompt that directs MLLMs to utilize visualized sensor data alongside the target sensory task descriptions.
-
11 Jul 2024 1 repository listedWe hypothesize that automatic evaluation can be improved by collecting a targeted UI feedback dataset and then using this dataset to enhance the performance of general-purpose LLMs.
-
15 Jun 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 1 pointer-only (licence)Continual Test-Time Adaptation (CTTA) seeks to adapt a source pre-trained model to continually changing, unlabeled target domains.
-
12 Jun 2024 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 4 honoured, 0 violated, 2 with no contract checked; 6 where Syntology's instrument failed) · 4 unverified (of 16 harvested samples) · 1 pointer-only (licence)Vision Transformers (ViTs) have demonstrated remarkable capabilities in learning representations, but their performance is compromised when applied to unseen domains.
-
5 Jun 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified (of 13 harvested samples) · 3 pointer-only (licence)
-
9 May 2024 1 repository listed Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 1 violated, 1 with no contract checked; 9 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
19 Apr 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 2 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 1 pointer-only (licence)
-
17 Apr 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
17 Apr 2024 1 repository listed
-
8 Apr 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 9 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
29 Mar 2024 1 repository listed
-
19 Feb 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
1 Jan 2024 1 repository listed
-
20 Dec 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
14 Dec 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
13 Dec 2023 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 9 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 4 pointer-only (licence)
-
5 Dec 2023 1 repository listed
-
3 Dec 2023 1 repository listed
-
19 Nov 2023 1 repository listed
-
12 Oct 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
26 Jul 2023 1 repository listed
-
21 Jun 2023 1 repository listed
-
7 Jun 2023 1 repository listed
-
1 Jun 2023 1 repository listed
-
18 Apr 2023 1 repository listed
-
26 Mar 2023 1 repository listed
-
22 Mar 2023 1 repository listed
-
20 Mar 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
14 Mar 2023 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
9 Mar 2023 1 repository listed Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 4 pointer-only (licence)
-
20 Dec 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
21 Nov 2022 1 repository listed
-
1 Sep 2022 1 repository listed
-
31 Mar 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thought4 Jun 2025 0 repositories listed
-
Grid-LOGAT: Grid Based Local and Global Area Transcription for Video Question Answering30 May 2025 0 repositories listed
-
A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysis29 May 2025 0 repositories listed
-
DINO-R1: Incentivizing Reasoning Capability in Vision Foundation Models29 May 2025 0 repositories listed
-
VP Lab: a PEFT-Enabled Visual Prompting Laboratory for Semantic Segmentation21 May 2025 0 repositories listed
-
Black-Box Visual Prompt Engineering for Mitigating Object Hallucination in Large Vision Language Models30 Apr 2025 0 repositories listed
-
Zoomer: Adaptive Image Focus Optimization for Black-box MLLM30 Apr 2025 0 repositories listed
-
RadSAM: Segmenting 3D radiological images with a 2D promptable model29 Apr 2025 0 repositories listed
-
Visual and textual prompts for enhancing emotion recognition in video24 Apr 2025 0 repositories listed
-
NVSMask3D: Hard Visual Prompting with Camera Pose Interpolation for 3D Open Vocabulary Instance Segmentation20 Apr 2025 0 repositories listed
-
Visual Prompting for One-shot Controllable Video Editing without Inversion19 Apr 2025 0 repositories listed
-
EarthGPT-X: Enabling MLLMs to Flexibly and Comprehensively Understand Multi-Source Remote Sensing Imagery17 Apr 2025 0 repositories listed
-
Is Temporal Prompting All We Need For Limited Labeled Action Recognition?2 Apr 2025 0 repositories listed
-
Prompt-Guided Attention Head Selection for Focus-Oriented Image Retrieval2 Apr 2025 0 repositories listed
-
VP-NTK: Exploring the Benefits of Visual Prompting in Differentially Private Data Synthesis20 Mar 2025 0 repositories listed
-
3DAxisPrompt: Promoting the 3D Grounding and Reasoning in GPT-4o17 Mar 2025 0 repositories listed
-
KUDA: Keypoints to Unify Dynamics Learning and Visual Prompting for Open-Vocabulary Robotic Manipulation13 Mar 2025 0 repositories listed
-
Towards Universal Text-driven CT Image Segmentation8 Mar 2025 0 repositories listed
-
The Role of Background Information in Reducing Object Hallucination in Vision-Language Models: Insights from Cutoff API Prompting21 Feb 2025 0 repositories listed
-
From PowerPoint UI Sketches to Web-Based Applications: Pattern-Driven Code Generation for GIS Dashboard Development Using Knowledge-Augmented LLMs, Context-Aware Visual Prompting, and the React Framework12 Feb 2025 0 repositories listed
-
Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling4 Feb 2025 0 repositories listed
-
Personalization Toolkit: Training Free Personalization of Large Vision Language Models4 Feb 2025 0 repositories listed
-
MedFocusCLIP : Improving few shot classification in medical datasets using pixel wise attention7 Jan 2025 0 repositories listed
-
Query Efficient Black-Box Visual Prompting with Subspace Learning1 Jan 2025 0 repositories listed
-
Visual Prompting with Iterative Refinement for Design Critique Generation22 Dec 2024 0 repositories listed
-
Test-time Correction with Human Feedback: An Online 3D Detection System via Visual Prompting10 Dec 2024 0 repositories listed
-
MLLM-Search: A Zero-Shot Approach to Finding People using Multimodal Large Language Models27 Nov 2024 0 repositories listed
-
Prompting the Unseen: Detecting Hidden Backdoors in Black-Box Models14 Nov 2024 0 repositories listed
-
WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learning8 Nov 2024 0 repositories listed
-
Ferret-UI 2: Mastering Universal User Interface Understanding Across Platforms24 Oct 2024 0 repositories listed
-
Visual Prompting in LLMs for Enhancing Emotion Recognition3 Oct 2024 0 repositories listed
-
GSON: A Group-based Social Navigation Framework with Large Multimodal Model26 Sep 2024 0 repositories listed
-
Cycle-Consistency Uncertainty Estimation for Visual Prompting based One-Shot Defect Segmentation21 Sep 2024 0 repositories listed
-
End-to-end Open-vocabulary Video Visual Relationship Detection using Multi-modal Prompting19 Sep 2024 0 repositories listed
-
Visual Prompting in Multimodal Large Language Models: A Survey5 Sep 2024 0 repositories listed
-
Rethinking Sparse Lexical Representations for Image Retrieval in the Age of Rising Multi-Modal Large Language Models29 Aug 2024 0 repositories listed
-
Coarse Correspondences Boost Spatial-Temporal Reasoning in Multimodal Language Model1 Aug 2024 0 repositories listed
-
Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM31 Jul 2024 0 repositories listed
-
Affordance-Guided Reinforcement Learning via Visual Prompting14 Jul 2024 0 repositories listed
-
DegustaBot: Zero-Shot Visual Preference Estimation for Personalized Multi-Object Rearrangement11 Jul 2024 0 repositories listed
Syntology lines on 28 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections