Browse State-of-the-Art › Image Outpainting
Image Outpainting
23 papers with code · 3 benchmarks · 4 datasets archive 2025-07-28
Predicting the visual context of an image beyond its boundary.
Image credit: NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
Description from the archive archive 2025-07-28; Papers-with-Code links inside it are rewritten to this site.
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| LHQC (4 rows) | NUWA-Infinity w/o text | NUWA-Infinity: Autoregressive over Autoregressive Generation for... | code | — | Compare |
| MSCOCO (1 row) | NUWA-3D | Learning 3D Photography Videos via Self-supervised Diffusion on... | — | — | Compare |
| Places365-Standard (1 row) | Residual Encoder | Enhanced Residual Networks for Context-based Image Outpainting | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 47 · with a code link: 23 · where Syntology ran a sample: 8 (7 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (8 of 47 tagged: 7 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 47 of 47, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
17 Dec 2020 13 repositories listed Syntology official (archive's flag): 2 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 4 pointer-only (licence)We demonstrate how combining the effectiveness of the inductive bias of CNNs with the expressivity of transformers enables them to model and thereby synthesize high-resolution images.
-
8 Feb 2022 9 repositories listed Syntology community repositories only · 14 ran (of which 9 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 21 harvested samples) · 4 pointer-only (licence)At inference time, the model begins with generating all tokens of an image simultaneously, and then refines the image iteratively conditioned on the previous generation.
-
23 Dec 2019 2 repositories listedThis way, the hallucinated details are integrated with the style of the original image, in an attempt to further boost the quality of the result and possibly allow for arbitrary output resolutions to be supported.
-
1 Jun 2019 2 repositories listedThis paper studies the fundamental problem of extrapolating visual context using deep generative models, i. e., extending image borders with plausible structure and details.
-
25 Aug 2018 2 repositories listedThe challenging task of image outpainting (extrapolation) has received comparatively little attention in relation to its cousin, image inpainting (completion).
-
7 Jun 2024 1 repository listedField-of-view (FOV) recovery of truncated chest CT scans is crucial for accurate body composition analysis, which involves quantifying skeletal muscle and subcutaneous adipose tissue (SAT) on CT slices.
-
3 Jun 2024 1 repository listedIn this paper, we focus on resolving the problem of image outpainting, which aims to extrapolate the surrounding parts given the center contents of an image.
-
28 Jan 2024 1 repository listed Syntology official (archive's flag): 5 ran · 6 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)At inference, we generate images with arbitrary expansion multiples by inputting an anchor image and its corresponding positional embeddings.
-
24 Mar 2023 1 repository listedThis paper raises the new task of Fisheye Semantic Completion (FSC), where dense texture, structure, and semantics of a fisheye image are inferred even beyond the sensor field-of-view (FoV).
-
22 Nov 2022 1 repository listed Syntology official (archive's flag): 17 ran · 17 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 3 honoured, 0 violated, 3 with no contract checked; 11 where Syntology's instrument failed) · 3 unverified (of 20 harvested samples) · 12 pointer-only (licence)We present SinDiffusion, leveraging denoising diffusion models to capture internal distribution of patches from a single natural image.
-
20 Jul 2022 1 repository listedIn this paper, we present NUWA-Infinity, a generative model for infinite visual synthesis, which is defined as the task of generating arbitrarily-sized high-resolution images or long-duration videos.
-
12 Jul 2022 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 2 pointer-only (licence)Image outpainting, which is well studied with Convolution Neural Network (CNN) based framework, has recently drawn more attention in computer vision.
-
12 Jun 2022 1 repository listedFor the distortion synthesis, we propose a spiral distortion-aware perception module, in which the learning path keeps consistent with the distortion prior of the fisheye image.
-
18 Apr 2022 1 repository listedMotivated by this analysis, we present a Cylin-Painting framework that involves meaningful collaborations between inpainting and outpainting and efficiently fuses the different arrangements, with a view to leveraging…
-
28 Mar 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)To improve the properties of a 360-degree image on an output image, we also propose WS-perceptual loss and circular inference.
-
27 Jan 2022 1 repository listedIn this paper, we develop a novel transformer-based generative adversarial neural network called U-Transformer for generalised image outpainting problem.
-
26 Jun 2021 1 repository listedOur self-supervision method, In-N-Out, is summarized as a training approach that leverages the knowledge of the opposite task into the target model.
-
20 Jun 2021 1 repository listedWe aim to tackle the challenging yet practical scenery image outpainting task in this work.
-
28 Mar 2021 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)In this paper we propose a new problem scenario in image processing, wide-range image blending, which aims to smoothly merge two different input photos into a panorama by generating novel image content for the…
-
8 Jul 2020 1 repository listedIn this paper, a novel two-stage siamese adversarial model for image extrapolation, named Siamese Expansion Network (SiENet) is proposed.
-
14 May 2020 1 repository listedAlthough humans perform well at predicting what exists beyond the boundaries of an image, deep models struggle to understand context and extrapolation through retained information.
-
29 Dec 2019 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)The second challenge is how to maintain high quality in generated results, especially for multi-step generations in which generated regions are spatially far away from the initial input.
-
25 Oct 2019 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)In this paper, we study the problem of generating a set ofrealistic and diverse backgrounds when given only a smallforeground region.
-
PanoGen++: Domain-Adapted Text-Guided Panoramic Environment Generation for Vision-and-Language Navigation13 Mar 2025 0 repositories listedVision-and-language navigation (VLN) tasks require agents to navigate three-dimensional environments guided by natural language instructions, offering substantial potential for diverse applications.
-
Unboxed: Geometrically and Temporally Consistent Video Outpainting1 Jan 2025 0 repositories listedExtending the field of view of video content beyond its original version has many applications: immersive viewing experience with VR devices, reformatting 4:3 legacy content to today's viewing conditions with wide…
-
Beyond Local Views: Global State Inference with Diffusion Models for Cooperative Multi-Agent Reinforcement Learning18 Aug 2024 0 repositories listedIn partially observable multi-agent systems, agents typically only have access to local observations.
-
CamFreeDiff: Camera-free Image to Panorama Generation with Diffusion Model9 Jul 2024 0 repositories listedThis paper introduces Camera-free Diffusion (CamFreeDiff) model for 360-degree image outpainting from a single camera-free image and text description.
-
ByteEdit: Boost, Comply and Accelerate Generative Image Editing7 Apr 2024 0 repositories listedRecent advancements in diffusion-based generative image editing have sparked a profound revolution, reshaping the landscape of image outpainting and inpainting tasks.
-
Dream360: Diverse and Immersive Outdoor Virtual Scene Creation via Transformer-Based 360 Image Outpainting19 Jan 2024 0 repositories listed360 images, with a field-of-view (FoV) of 180x360, provide immersive and realistic environments for emerging virtual reality (VR) applications, such as virtual tourism, where users desire to create diverse panoramic…
-
Shadow-Enlightened Image Outpainting1 Jan 2024 0 repositories listedConventional image outpainting methods usually treat unobserved areas as unknown and extend the scene only in terms of semantic consistency thus overlooking the hidden information in shadows cast by unobserved areas…
-
A framework for conditional diffusion modelling with applications in motif scaffolding for protein design14 Dec 2023 0 repositories listed
-
NeRF-Enhanced Outpainting for Faithful Field-of-View Extrapolation23 Sep 2023 0 repositories listed
-
Hierarchical Masked 3D Diffusion Model for Video Outpainting5 Sep 2023 0 repositories listed
-
PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation30 May 2023 0 repositories listed
-
21 Feb 2023 0 repositories listed
-
Structure-guided Image Outpainting21 Dec 2022 0 repositories listed
-
Memory Efficient Patch-based Training for INR-based GANs4 Jul 2022 0 repositories listed
-
Scene Graph Expansion for Semantics-Guided Image Outpainting5 May 2022 0 repositories listed
-
Towards Reliable Image Outpainting: Learning Structure-Aware Multimodal Fusion with Depth Guidance12 Apr 2022 0 repositories listed
-
Contextual Outpainting With Object-Level Contrastive Learning1 Jan 2022 0 repositories listed
-
InOut: Diverse Image Outpainting via GAN Inversion1 Jan 2022 0 repositories listed
-
Boosting Image Outpainting with Semantic Layout Prediction18 Oct 2021 0 repositories listed
-
In&Out : Diverse Image Outpainting via GAN Inversion1 Apr 2021 0 repositories listed
-
Painting Outside as Inside: Edge Guided Image Outpainting via Bidirectional Rearrangement with Progressive Step Learning5 Oct 2020 0 repositories listed
-
Sketch-Guided Scenery Image Outpainting17 Jun 2020 0 repositories listed
-
Nested Scale Editing for Conditional Image Synthesis3 Jun 2020 0 repositories listed
-
Nested Scale-Editing for Conditional Image Synthesis1 Jun 2020 0 repositories listed
Syntology lines on 9 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections