Text-to-Image Generation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

17 leaderboard tables shown for this task, 17 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 17 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

25 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

7 subtasks in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 546 papers with code (1,085 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Show and Tell: A Neural Image Caption Generator
  17 Nov 2014 74 repositories listed Syntology ran 13 of 34 samples · 21 unverified · 6 pointer-only (licence)
  Experiments on several datasets show the accuracy of the model and the fluency of the language it learns solely from image descriptions.
• High-Resolution Image Synthesis with Latent Diffusion Models
  20 Dec 2021 41 repositories listed Syntology ran 19 of 28 samples · 9 unverified · 5 pointer-only (licence)
  By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond.
• Generative Adversarial Text to Image Synthesis
  17 May 2016 39 repositories listed Syntology ran 9 of 19 samples · 10 unverified · 6 pointer-only (licence)
  Automatic synthesis of realistic images from text would be interesting and useful, but current AI systems are still far from this goal.
• StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks
  10 Dec 2016 21 repositories listed Syntology ran 11 of 31 samples · 20 unverified · 1 pointer-only (licence)
  Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications.
• AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
  28 Nov 2017 20 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  In this paper, we propose an Attentional Generative Adversarial Network (AttnGAN) that allows attention-driven, multi-stage refinement for fine-grained text-to-image generation.
• StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks
  19 Oct 2017 16 repositories listed Syntology ran 10 of 31 samples · 21 unverified
  In this paper, we propose Stacked Generative Adversarial Networks (StackGAN) aiming at generating high-resolution photo-realistic images.
• Taming Transformers for High-Resolution Image Synthesis
  17 Dec 2020 13 repositories listed Syntology ran 6 of 6 samples · 0 unverified · 4 pointer-only (licence)
  We demonstrate how combining the effectiveness of the inductive bias of CNNs with the expressivity of transformers enables them to model and thereby synthesize high-resolution images.
• Zero-Shot Text-to-Image Generation
  24 Feb 2021 12 repositories listed Syntology ran 7 of 7 samples · 0 unverified · 3 pointer-only (licence)
  Text-to-image generation has traditionally focused on finding better modeling assumptions for training on a fixed dataset.
• An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion
  2 Aug 2022 9 repositories listed Syntology ran 10 of 13 samples · 3 unverified · 1 pointer-only (licence)
  Yet, it is unclear how such freedom can be exercised to generate images of specific unique concepts, modify their appearance, or compose them in new roles and novel scenes.
• MaskGIT: Masked Generative Image Transformer
  8 Feb 2022 9 repositories listed Syntology ran 14 of 21 samples · 7 unverified · 4 pointer-only (licence)
  At inference time, the model begins with generating all tokens of an image simultaneously, and then refines the image iteratively conditioned on the previous generation.
• Hierarchical Text-Conditional Image Generation with CLIP Latents
  13 Apr 2022 8 repositories listed Syntology ran 29 of 38 samples · 9 unverified · 1 pointer-only (licence)
  Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style.
• Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference
  6 Oct 2023 5 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  Inspired by Consistency Models (song et al.), we propose Latent Consistency Models (LCMs), enabling swift inference with minimal steps on any pre-trained LDMs, including Stable Diffusion (rombach et al).
• Muse: Text-To-Image Generation via Masked Generative Transformers
  2 Jan 2023 5 repositories listed Syntology ran 18 of 21 samples · 3 unverified · 9 pointer-only (licence)
  Compared to pixel-space diffusion models, such as Imagen and DALL-E 2, Muse is significantly more efficient due to the use of discrete tokens and requiring fewer sampling iterations; compared to autoregressive models,…
• TediGAN: Text-Guided Diverse Face Image Generation and Manipulation
  6 Dec 2020 5 repositories listed
  In this work, we propose TediGAN, a novel framework for multi-modal image generation and manipulation with textual descriptions.
• StyleDrop: Text-to-Image Generation in Any Style
  1 Jun 2023 4 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  Pre-trained large text-to-image models synthesize impressive images with an appropriate use of text prompts.
• MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing
  17 Apr 2023 4 repositories listed Syntology ran 4 of 7 samples · 3 unverified · 1 pointer-only (licence)
  Despite the success in large-scale text-to-image generation and text-conditioned image editing, existing methods still struggle to produce consistent generation and editing results.
• A Novel Sampling Scheme for Text- and Image-Conditional Image Synthesis in Quantized Latent Spaces
  14 Nov 2022 4 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  Recent advancements in the domain of text-to-image synthesis have culminated in a multitude of enhancements pertaining to quality, fidelity, and diversity.
• Autoregressive Image Generation using Residual Quantization
  3 Mar 2022 4 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  However, we postulate that previous VQ cannot shorten the code sequence and generate high-fidelity images together in terms of the rate-distortion trade-off.
• OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
  7 Feb 2022 4 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  In this work, we pursue a unified paradigm for multimodal pretraining to break the scaffolds of complex task/modality-specific customization.
• CogView: Mastering Text-to-Image Generation via Transformers
  26 May 2021 4 repositories listed Syntology ran 4 of 6 samples · 2 unverified
  Text-to-Image generation in the general domain has long been an open problem, which requires both a powerful generative model and cross-modal understanding.
• DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesis
  2 Apr 2019 4 repositories listed Syntology ran 4 of 5 samples · 1 unverified · 1 pointer-only (licence)
  If the initial image is not well initialized, the following processes can hardly refine the image to a satisfactory quality.
• Navigating the Synthetic Realm: Harnessing Diffusion-based Models for Laparoscopic Text-to-Image Generation
  5 Dec 2023 3 repositories listed
  We demonstrate the usage of state-of-the-art text-to-image architectures in the context of laparoscopic imaging with regard to the surgical removal of the gallbladder as an example.
• PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis
  30 Sep 2023 3 repositories listed Syntology ran 2 of 3 samples · 1 unverified · 2 pointer-only (licence)
  We hope PIXART-α will provide new insights to the AIGC community and startups to accelerate building their own high-quality yet low-cost generative models from scratch.
• ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Models
  25 May 2023 3 repositories listed Syntology ran 12 of 13 samples · 1 unverified
  We apply ProSpect in various personalized attribute-aware image generation applications, such as image-guided or text-driven manipulations of materials, style, and layout, achieving previously unattainable results from…
• BK-SDM: A Lightweight, Fast, and Cheap Version of Stable Diffusion
  25 May 2023 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Text-to-image (T2I) generation with Stable Diffusion models (SDMs) involves high computing demands due to billion-scale parameters.
• Training Diffusion Models with Reinforcement Learning
  22 May 2023 3 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  However, most use cases of diffusion models are not concerned with likelihoods, but instead with downstream objectives such as human-perceived image quality or drug effectiveness.
• ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generation
  12 Apr 2023 3 repositories listed Syntology ran 3 of 12 samples · 9 unverified · 2 pointer-only (licence)
  We present a comprehensive solution to learn and improve text-to-image models from human preference feedback.
• GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generation
  31 Mar 2023 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 1 pointer-only (licence)
  Recent breakthroughs in the field of language-guided image generation have yielded impressive achievements, enabling the creation of high-quality and diverse images based on user instructions.
• One Transformer Fits All Distributions in Multi-Modal Diffusion at Scale
  12 Mar 2023 3 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Inspired by the unified view, UniDiffuser learns all distributions simultaneously with a minimal modification to the original diffusion model -- perturbs data in all modalities instead of a single modality, inputs…
• Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC
  22 Feb 2023 3 repositories listed Syntology ran 4 of 24 samples · 20 unverified
  In this work, we build upon these ideas using the score-based interpretation of diffusion models, and explore alternative ways to condition, modify, and reuse diffusion models for tasks involving compositional…

Syntology lines on 28 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.