Story Visualization

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

28 shown of 28 papers with code (42 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Character-Centric Story Visualization via Visual Planning and Token Alignment
  16 Oct 2022 2 repositories listed Syntology ran 12 of 21 samples · 9 unverified
  This task requires machines to 1) understand long text inputs and 2) produce a globally consistent image sequence that illustrates the contents of the story.
• Character-Preserving Coherent Story Visualization
  1 Aug 2020 2 repositories listed
  Different from video generation that focuses on maintaining the continuity of generated images (frames), story visualization emphasizes preserving the global consistency of characters and scenes across different story…
• Consistent Story Generation with Asymmetry Zigzag Sampling
  11 Jun 2025 1 repository listed
  Text-to-image generation models have made significant progress in producing high-quality images from textual descriptions, yet they continue to struggle with maintaining subject consistency across multiple images, a…
• ViStoryBench: Comprehensive Benchmark Suite for Story Visualization
  30 May 2025 1 repository listed Syntology ran 1 of 2 samples · 1 unverified
  Story visualization, which aims to generate a sequence of visually coherent images aligning with a given narrative and reference images, has seen significant progress with recent advancements in generative models.
• StoryWeaver: A Unified World Model for Knowledge-Enhanced Story Character Customization
  10 Dec 2024 1 repository listed
  Story visualization has gained increasing attention in artificial intelligence.
• Story-Adapter: A Training-free Iterative Framework for Long Story Visualization
  8 Oct 2024 1 repository listed Syntology ran 2 of 7 samples · 5 unverified
  Specifically, we propose an iterative paradigm to refine each generated image, leveraging both the text prompt and all generated images from the previous iteration.
• ContextualStory: Consistent Visual Storytelling with Spatially-Enhanced and Storyline Context
  13 Jul 2024 1 repository listed
  Visual storytelling involves generating a sequence of coherent frames from a textual storyline while maintaining consistency in characters and scenes.
• Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Models
  2 Jul 2024 1 repository listed Syntology ran 3 of 4 samples · 1 unverified · 4 pointer-only (licence)
  Moreover, RCDMs can generate consistent stories with a single forward inference compared to autoregressive models.
• StoryImager: A Unified and Efficient Framework for Coherent Story Visualization and Completion
  9 Apr 2024 1 repository listed
  3) The story visualization and continuation models are trained and inferred independently, which is not user-friendly.
• Masked Generative Story Transformer with Character Guidance and Caption Augmentation
  13 Mar 2024 1 repository listed
  Story Visualization (SV) is a challenging generative vision task, that requires both visual quality and consistency between different frames in generated image sequences.
• Training-Free Consistent Text-to-Image Generation
  5 Feb 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Text-to-image models offer a new level of creative flexibility by allowing users to guide the image generation process through natural language.
• StoryGPT-V: Large Language Models as Consistent Story Visualizers
  4 Dec 2023 1 repository listed Syntology ran 9 of 15 samples · 6 unverified · 15 pointer-only (licence)
  Therefore, we introduce \textbf{StoryGPT-V}, which leverages the merits of the latent diffusion (LDM) and LLM to produce images with consistent and high-quality characters grounded on given story descriptions.
• AutoStory: Generating Diverse Storytelling Images with Minimal Human Effort
  19 Nov 2023 1 repository listed
  We empirically find that sparse control conditions, such as bounding boxes, are suitable for layout planning, while dense control conditions, e.
• The Chosen One: Consistent Characters in Text-to-Image Diffusion Models
  16 Nov 2023 1 repository listed
  Recent advances in text-to-image generation models have unlocked vast potential for visual creativity.
• StoryBench: A Multifaceted Benchmark for Continuous Story Visualization
  22 Aug 2023 1 repository listed Syntology ran 14 of 16 samples · 2 unverified
  To fill this gap, we collect comprehensive human annotations on three existing datasets, and introduce StoryBench: a new, challenging multi-task benchmark to reliably evaluate forthcoming text-to-video models.
• Story Visualization by Online Text Augmentation with Context Memory
  15 Aug 2023 1 repository listed
  Story visualization (SV) is a challenging text-to-image generation task for the difficulty of not only rendering visual details from the text descriptions but also encoding a long-term context across multiple sentences.
• Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Models
  1 Jun 2023 1 repository listed Syntology ran 0 of 3 samples · 3 unverified
  Generative models have recently exhibited exceptional capabilities in text-to-image generation, but still struggle to generate image sequences coherently.
• TaleCrafter: Interactive Story Visualization with Multiple Characters
  29 May 2023 1 repository listed
  Accurate Story visualization requires several necessary elements, such as identity consistency across frames, the alignment between plain text and visual content, and a reasonable layout of objects in images.
• Make-A-Story: Visual Memory Conditioned Consistent Story Generation
  23 Nov 2022 1 repository listed Syntology ran 0 of 8 samples · 8 unverified
  Our experiments for story generation on the MUGEN, the PororoSV and the FlintstonesSV dataset show that our method not only outperforms prior state-of-the-art in generating frames with high visual quality, which are…
• Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Models
  20 Nov 2022 1 repository listed
  Conditioned diffusion models have demonstrated state-of-the-art text-to-image synthesis capacity.
• StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuation
  13 Sep 2022 1 repository listed Syntology ran 2 of 3 samples · 1 unverified
  Hence, we first propose the task of story continuation, where the generated visual story is conditioned on a source image, allowing for better generalization to narratives with new characters.
• Word-Level Fine-Grained Story Visualization
  3 Aug 2022 1 repository listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story with a global consistency across dynamic scenes and characters.
• Modular StoryGAN with Background and Theme Awareness for Story Visualization
  2 Jun 2022 1 repository listed
  To measure the local and global consistency we introduced background and theme awareness, which are expected attributes of the solutions.
• Integrating Visuospatial, Linguistic, and Commonsense Structure into Story Visualization
  1 Nov 2021 1 repository listed
  Such information is even more important for story visualization since its inputs have an explicit narrative structure that needs to be translated into an image sequence (or visual story).
• Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualization
  21 Oct 2021 1 repository listed
  Prior work in this domain has shown that there is ample room for improvement in the generated image sequence in terms of visual quality, consistency and relevance.
• Improving Generation and Evaluation of Visual Stories via Semantic Consistency
  20 May 2021 1 repository listed Syntology ran 3 of 14 samples · 11 unverified
  Therefore, we also provide an exploration of evaluation metrics for the model, focused on aspects of the generated frames such as the presence/quality of generated characters, the relevance to captions, and the…
• StoryGAN: A Sequential Conditional GAN for Story Visualization
  6 Dec 2018 1 repository listed
  We therefore propose a new story-to-image-sequence generation model, StoryGAN, based on the sequential conditional GAN framework.
• Show Me a Story: Towards Coherent Neural Story Illustration
  1 Jun 2018 1 repository listed
  We propose an end-to-end network for the visual illustration of a sequence of sentences forming a story.

Syntology lines on 12 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.