Methods › Computer Vision › Image Generation Models › AltDiffusion

AltDiffusion

2 papers tagged archive 2025-07-28

Introduced by Zhongzhi Chen et al. in AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities

archive 2025-07-28 Description, source and code snippet are the archive's method entry.

In this work, we present a conceptually simple and effective method to train a strong bilingual multimodal representation model. Starting from the pretrained multimodal representation model CLIP released by OpenAI, we switched its text encoder with a pretrained multilingual text encoder XLM-R, and aligned both languages and image representations by a two-stage training schema consisting of teacher learning and contrastive learning. We validate our method through evaluations of a wide range of tasks. We set new state-of-the-art performances on a bunch of tasks including ImageNet-CN, Flicker30k- CN, and COCO-CN. Further, we obtain very close performances with CLIP on almost all tasks, suggesting that one can simply alter the text encoder in CLIP for extended capabilities such as multilingual understanding. Our models and code are available at https://github.com/FlagAI-Open/FlagAI.

Paper Source

Papers archive 2025-07-28

2 shown of 2, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.

AltDiffusion: A Multilingual Text-to-Image Diffusion Model
19 Aug 2023 · 1 repository · arXiv:2308.09991

Syntology ran 9 of 11 samples · 2 unverified · 11 pointer-only (licence)
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities
12 Nov 2022 · 2 repositories · arXiv:2211.06679

Syntology ran 2 of 11 samples · 9 unverified

Tasks archive 2025-07-28

17 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.

Task	Papers
Blocking	1
Concept Alignment	1
Contrastive Learning	1
Cross-Modal Retrieval	1
Image Classification	1
Image Retrieval	1
Image-to-Text Retrieval	1
Knowledge Distillation	1
Text-to-Image Generation	1
XLM-R	1
Zero-Shot Cross-Modal Retrieval	1
Zero-Shot Image Classification	1
Zero-Shot Transfer Image Classification	1
Zero-Shot Transfer Image Classification (CN)	1
Zero-shot Image Retrieval	1
Zero-shot Text Retrieval	1
model	1

Usage over time archive 2025-07-28

Papers per year the archive tags with this method, by the paper's archive date (2 dated). Bars are counts, not a trend claim.

Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).

Categories archive 2025-07-28

Image Generation Models

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections