Methods › Computer Vision › Vision and Language Pre-Trained Models › BLIP
BLIP: Bootstrapping Language-Image Pre-training
BLIP
Introduced by Junnan Li et al. in BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Vision-Language Pre-training (VLP) has advanced the performance for many vision-language tasks. However, most existing pre-trained models only excel in either understanding-based tasks or generation-based tasks. Furthermore, performance improvement has been largely achieved by scaling up the dataset with noisy image-text pairs collected from the web, which is a suboptimal source of supervision. In this paper, we propose BLIP, a new VLP framework which transfers flexibly to both vision-language understanding and generation tasks. BLIP effectively utilizes the noisy web data by bootstrapping the captions, where a captioner generates synthetic captions and a filter removes the noisy ones. We achieve state-of-the-art results on a wide range of vision-language tasks, such as image-text retrieval (+2.7% in average recall@1), image captioning (+2.8% in CIDEr), and VQA (+1.6% in VQA score). BLIP also demonstrates strong generalization ability when directly transferred to video-language tasks in a zero-shot manner. Code, models, and datasets are released at https://github.com/salesforce/BLIP.
In Syntology repository known, no verified implementation (declared_code; repositories: 5 listed of 9 in the graph, strongest link: official). This answer is about arXiv:2201.12086, the paper the archive credits with this method.
Origin paper of this answer, arXiv:2201.12086 (its page on this site · its page on Syntology).
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 93 · with a code link: 44 · where Syntology ran a sample: 16 (13 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (16 of 93 tagged: 13 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 93 of 93, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Text-Visual Semantic Constrained AI-Generated Image Quality Assessment 14 Jul 2025 · 1 repository · arXiv:2507.10432
-
VisText-Mosquito: A Multimodal Dataset and Benchmark for AI-Based Mosquito Breeding Site Detection and Reasoning 17 Jun 2025 · 1 repository · arXiv:2506.14629
-
Fusing Cross-modal and Uni-modal Representations: A Kronecker Product Approach 10 Jun 2025 · 0 repositories · arXiv:2506.08645
-
A Narrative Review on Large AI Models in Lung Cancer Screening, Diagnosis, and Treatment Planning 8 Jun 2025 · 0 repositories · arXiv:2506.07236
-
When VLMs Meet Image Classification: Test Sets Renovation via Missing Label Identification 22 May 2025 · 0 repositories · arXiv:2505.16149
-
MedBLIP: Fine-tuning BLIP for Medical Image Captioning 20 May 2025 · 0 repositories · arXiv:2505.14726
-
From Complexity to Clarity: Transforming Chest X-ray Reports with Chained Prompting (Student Abstract) 11 Apr 2025 · 1 repository
-
From Complexity to Clarity: Transforming Chest X-ray Reports with Chained Prompting (Student Abstract) Authors 11 Apr 2025 · 1 repository
-
Learning Sparse Disentangled Representations for Multimodal Exclusion Retrieval 4 Apr 2025 · 0 repositories · arXiv:2504.03184
-
OMR-Diffusion:Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Intent Understanding 22 Mar 2025 · 0 repositories · arXiv:2503.17660
-
TDRI: Two-Phase Dialogue Refinement and Co-Adaptation for Interactive Image Generation 22 Mar 2025 · 0 repositories · arXiv:2503.17669
-
Are Large Language Models Good Data Preprocessors? 24 Feb 2025 · 0 repositories · arXiv:2502.16790
-
NanoVLMs: How small can we go and still make coherent Vision Language Models? 11 Feb 2025 · 0 repositories · arXiv:2502.07838
-
An Evaluation Framework for Product Images Background Inpainting based on Human Feedback and Product Consistency 23 Dec 2024 · 0 repositories · arXiv:2412.17504
-
Barking Up The Syntactic Tree: Enhancing VLM Training with Syntactic Losses 11 Dec 2024 · 0 repositories · arXiv:2412.08110
-
Attacks on multimodal models 2 Dec 2024 · 1 repository · arXiv:2412.01725
-
Understanding the World's Museums through Vision-Language Reasoning 2 Dec 2024 · 0 repositories · arXiv:2412.01370
-
Nearest Neighbor Normalization Improves Multimodal Retrieval 31 Oct 2024 · 1 repository · arXiv:2410.24114
-
Technical Report for Soccernet 2023 -- Dense Video Captioning 31 Oct 2024 · 0 repositories · arXiv:2411.00882
-
EfficientEQA: An Efficient Approach for Open Vocabulary Embodied Question Answering 26 Oct 2024 · 0 repositories · arXiv:2410.20263
-
Backdoor in Seconds: Unlocking Vulnerabilities in Large Pre-trained Models via Model Editing 23 Oct 2024 · 0 repositories · arXiv:2410.18267
-
Towards Zero-Shot Camera Trap Image Categorization 16 Oct 2024 · 0 repositories · arXiv:2410.12769
-
AnyAttack: Towards Large-scale Self-supervised Adversarial Attacks on Vision-language Models 7 Oct 2024 · 0 repositories · arXiv:2410.05346
-
VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks 7 Oct 2024 · 0 repositories · arXiv:2410.05160
-
MultiClimate: Multimodal Stance Detection on Climate Change Videos 26 Sep 2024 · 1 repository · arXiv:2409.18346Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
NeIn: Telling What You Don't Want 9 Sep 2024 · 0 repositories · arXiv:2409.06481
-
Evaluation and Comparison of Visual Language Models for Transportation Engineering Problems 3 Sep 2024 · 1 repository · arXiv:2409.02278
-
Medical Report Generation Is A Multi-label Classification Problem 30 Aug 2024 · 0 repositories · arXiv:2409.00250
-
Response Wide Shut: Surprising Observations in Basic Vision Language Model Capabilities 13 Aug 2024 · 0 repositories · arXiv:2408.06721
-
MOSAIC: Multimodal Multistakeholder-aware Visual Art Recommendation 31 Jul 2024 · 0 repositories · arXiv:2407.21758
-
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval 21 Jul 2024 · 1 repository · arXiv:2407.15051Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 9 pointer-only (licence)
-
CosmoCLIP: Generalizing Large Vision-Language Models for Astronomical Imaging 10 Jul 2024 · 0 repositories · arXiv:2407.07315
-
Black-box Model Ensembling for Textual and Visual Question Answering via Information Fusion 4 Jul 2024 · 1 repository · arXiv:2407.12841
-
Visual Robustness Benchmark for Visual Question Answering (VQA) 3 Jul 2024 · 1 repository · arXiv:2407.03386
-
The Surprising Effectiveness of Multimodal Large Language Models for Video Moment Retrieval 26 Jun 2024 · 1 repository · arXiv:2406.18113Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
What Do VLMs NOTICE? A Mechanistic Interpretability Pipeline for Gaussian-Noise-free Text-Image Corruption and Evaluation 24 Jun 2024 · 1 repository · arXiv:2406.16320
-
OSPC: Detecting Harmful Memes with Large Language Model as a Catalyst 14 Jun 2024 · 0 repositories · arXiv:2406.09779
-
Interpreting the structure of multi-object representations in vision encoders 13 Jun 2024 · 0 repositories · arXiv:2406.09067
-
BLIP: Facilitating the Exploration of Undesirable Consequences of Digital Technologies 10 May 2024 · 0 repositories · arXiv:2405.06783
-
Q-GroundCAM: Quantifying Grounding in Vision Language Models via GradCAM 29 Apr 2024 · 0 repositories · arXiv:2404.19128
-
AccidentBlip: Agent of Accident Warning based on MA-former 18 Apr 2024 · 0 repositories · arXiv:2404.12149
-
AAPMT: AGI Assessment Through Prompt and Metric Transformer 28 Mar 2024 · 1 repository · arXiv:2403.19101
-
The Solution for the CVPR 2023 1st foundation model challenge-Track2 26 Mar 2024 · 0 repositories · arXiv:2403.17702
-
Learning from Synthetic Data for Visual Grounding 20 Mar 2024 · 0 repositories · arXiv:2403.13804
-
TT-BLIP: Enhancing Fake News Detection Using BLIP and Tri-Transformer 19 Mar 2024 · 0 repositories · arXiv:2403.12481
-
Does the Performance of Text-to-Image Retrieval Models Generalize Beyond Captions-as-a-Query? 15 Mar 2024 · 1 repository
-
MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformer 5 Mar 2024 · 1 repository · arXiv:2403.02991Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics 24 Feb 2024 · 0 repositories · arXiv:2402.15654
-
CI w/o TN: Context Injection without Task Name for Procedure Planning 23 Feb 2024 · 0 repositories · arXiv:2402.15579
-
CIC: A Framework for Culturally-Aware Image Captioning 8 Feb 2024 · 0 repositories · arXiv:2402.05374
-
ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation 7 Feb 2024 · 1 repository · arXiv:2402.04492Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
cDVGAN: One Flexible Model for Multi-class Gravitational Wave Signal and Glitch Generation 29 Jan 2024 · 0 repositories · arXiv:2401.16356
-
Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks 25 Jan 2024 · 5 repositories · arXiv:2401.14159Syntology community repositories only · 15 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 8 where Syntology's instrument failed) · 0 unverified (of 15 harvested samples) · 5 pointer-only (licence)
-
SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval 24 Jan 2024 · 1 repository · arXiv:2401.13478Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
Bootstrapping OTS-Funcimg Pre-training Model (Botfip) -- A Comprehensive Symbolic Regression Framework 18 Jan 2024 · 0 repositories · arXiv:2401.09748
-
Filter & Align: Leveraging Human Knowledge to Curate Image-Text Data 11 Dec 2023 · 0 repositories · arXiv:2312.06726
-
Auto-Vocabulary Semantic Segmentation 7 Dec 2023 · 1 repository · arXiv:2312.04539
-
Sinkhorn Transformations for Single-Query Postprocessing in Text-Video Retrieval 14 Nov 2023 · 0 repositories · arXiv:2311.08143
-
Language Guided Visual Question Answering: Elevate Your Multimodal Language Model Using Knowledge-Enriched Prompts 31 Oct 2023 · 1 repository · arXiv:2310.20159Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Are Natural Domain Foundation Models Useful for Medical Image Classification? 30 Oct 2023 · 1 repository · arXiv:2310.19522
-
What's "up" with vision-language models? Investigating their struggle with spatial reasoning 30 Oct 2023 · 2 repositories · arXiv:2310.19785Syntology official (archive's flag): 3 ran · 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 8 pointer-only (licence)
-
Vision-by-Language for Training-Free Compositional Image Retrieval 13 Oct 2023 · 1 repository · arXiv:2310.09291Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples) · 2 pointer-only (licence)
-
Implicit Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis 21 Sep 2023 · 1 repository
-
DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusion 4 Sep 2023 · 0 repositories · arXiv:2309.01372
-
FIRE: Food Image to REcipe generation 28 Aug 2023 · 1 repository · arXiv:2308.14391Syntology official (archive's flag): 12 ran · 12 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP 27 Aug 2023 · 1 repository · arXiv:2308.14179
-
DLIP: Distilling Language-Image Pre-training 24 Aug 2023 · 0 repositories · arXiv:2308.12956
-
SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes 21 Aug 2023 · 0 repositories · arXiv:2308.10638
-
FigCaps-HF: A Figure-to-Caption Generative Framework and Benchmark with Human Feedback 20 Jul 2023 · 1 repository · arXiv:2307.10867Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Divide, Evaluate, and Refine: Evaluating and Improving Text-to-Image Alignment with Iterative VQA Feedback 10 Jul 2023 · 0 repositories · arXiv:2307.04749
-
ProbVLM: Probabilistic Adapter for Frozen Vision-Language Models 1 Jul 2023 · 1 repository · arXiv:2307.00398Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 15 harvested samples) · 2 pointer-only (licence)
-
Zero-shot Nuclei Detection via Visual-Language Pre-trained Models 30 Jun 2023 · 1 repository · arXiv:2306.17659
-
Training Multimedia Event Extraction With Generated Images and Captions 15 Jun 2023 · 0 repositories · arXiv:2306.08966
-
Recognize Anything: A Strong Image Tagging Model 6 Jun 2023 · 2 repositories · arXiv:2306.03514
-
Using Visual Cropping to Enhance Fine-Detail Question Answering of BLIP-Family Models 31 May 2023 · 0 repositories · arXiv:2306.00228
-
FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions 28 May 2023 · 1 repository · arXiv:2305.17718
-
On Evaluating Adversarial Robustness of Large Vision-Language Models 26 May 2023 · 1 repository · arXiv:2305.16934Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 2 pointer-only (licence)
-
Can Language Models Understand Physical Concepts? 23 May 2023 · 1 repository · arXiv:2305.14057
-
InstructVid2Vid: Controllable Video Editing with Natural Language Instructions 21 May 2023 · 0 repositories · arXiv:2305.12328
-
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation 18 May 2023 · 1 repository · arXiv:2305.11116
-
IIITD-20K: Dense captioning for Text-Image ReID 8 May 2023 · 1 repository · arXiv:2305.04497
-
The Role of Data Curation in Image Captioning 5 May 2023 · 1 repository · arXiv:2305.03610
-
RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Models 21 Apr 2023 · 1 repository · arXiv:2304.10727
-
Anything-3D: Towards Single-view Anything Reconstruction in the Wild 19 Apr 2023 · 1 repository · arXiv:2304.10261Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 1 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 3 pointer-only (licence)
-
Cross-Domain Image Captioning with Discriminative Finetuning 4 Apr 2023 · 1 repository · arXiv:2304.01662Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Is Multimodal Vision Supervision Beneficial to Language? 10 Feb 2023 · 1 repository · arXiv:2302.05016
-
Do DALL-E and Flamingo Understand Each Other? 23 Dec 2022 · 0 repositories · arXiv:2212.12249
-
Position-guided Text Prompt for Vision-Language Pre-training 19 Dec 2022 · 1 repository · arXiv:2212.09737Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Renmin University of China at TRECVID 2022: Improving Video Search by Feature Fusion and Negation Understanding 28 Nov 2022 · 0 repositories · arXiv:2211.15039
-
Inferring Past Human Actions in Homes with Abductive Reasoning 24 Oct 2022 · 1 repository · arXiv:2210.13984
-
LiteVL: Efficient Video-Language Learning with Enhanced Spatial-Temporal Modeling 21 Oct 2022 · 0 repositories · arXiv:2210.11929
-
Synthetic Blip Effects: Generalizing Synthetic Controls for the Dynamic Treatment Regime 20 Oct 2022 · 0 repositories · arXiv:2210.11003
-
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation 28 Jan 2022 · 9 repositories · arXiv:2201.12086
Tasks archive 2025-07-28
20 shown of 123 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections