Browse State-of-the-Art › 3D-Aware Image Synthesis
3D-Aware Image Synthesis
27 papers with code · 3 benchmarks · 4 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| FFHQ 256 x 256 (4 rows) | CIPS-3D | CIPS-3D: A 3D-Aware Generator of GANs Based on... | code | Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified | Compare |
| CelebAMask-HQ (3 rows) | Sem2NeRF | Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields | code | Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified | Compare |
| FFHQ 512 x 512 - 4x upscaling (1 row) | IDE-3D | IDE-3D: Interactive Disentangled Editing for High-Resolution... | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 48 · with a code link: 27 · where Syntology ran a sample: 10 (8 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (10 of 48 tagged: 8 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 48 of 48, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
2 Dec 2020 3 repositories listed Syntology official: harvested, nothing ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 2 pointer-only (licence)We have witnessed rapid progress on 3D-aware image synthesis, leveraging recent advances in generative visual models and neural rendering.
-
26 Feb 2022 2 repositories listedWe propose a pipeline to generate Neural Radiance Fields (NeRF) of an object or a scene of a specific class, conditioned on a single input image.
-
21 Mar 2025 1 repository listedTo utilize masks with a desired layout, an extensive training dataset is required, which is challenging to gather.
-
5 Jun 2024 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 6 honoured, 0 violated, 0 with no contract checked; 7 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples) · 16 pointer-only (licence)Specifically, we design a hierarchy of Gaussians where finer-level Gaussians are parameterized by their coarser-level counterparts; the position of finer-level Gaussians would be located near their coarser-level…
-
21 Apr 2024 1 repository listedIn this framework, we utilize an expressive generator to synthesize stylized faces and a triple-branch discriminator module to improve the visual quality and style consistency of the generated faces.
-
21 Jun 2023 1 repository listedDespite the rapid advance of 3D-aware image synthesis, existing studies usually adopt a mixture of techniques and tricks, leaving it unclear how each part contributes to the final performance in terms of generality.
-
4 May 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 9 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 13 pointer-only (licence)Our motivation is that facial semantic labels are view-consistent and correlate with drawing techniques.
-
13 Apr 2023 1 repository listed3D-aware image synthesis encompasses a variety of tasks, such as scene generation and novel view synthesis from images.
-
24 Mar 2023 1 repository listedGenerating photorealistic images with controllable camera pose and scene contents is essential for many applications including AR/VR and simulation.
-
3 Jan 2023 1 repository listedAdditionally, we provide FIDs of generated 3D-aware images of each class of the datasets as it is possible to synthesize class-conditional images with C³G-NeRF.
-
27 Oct 2022 1 repository listedIn this survey, we thoroughly review the ongoing developments of 3D generative models, including methods that employ 2D and 3D supervision.
-
25 Oct 2022 1 repository listedRecent years have seen remarkable progress in deep learning powered visual content creation.
-
21 Jun 2022 1 repository listedIn this work, we show that it is possible to obtain a high-resolution 3D generator with SotA image quality by following a completely different route of simply training the model patch-wise.
-
15 Jun 2022 1 repository listed Syntology official (archive's flag): 17 ran · 17 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 5 honoured, 1 violated, 7 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 18 harvested samples) · 6 pointer-only (licence)State-of-the-art 3D-aware generative models rely on coordinate-based MLPs to parameterize 3D radiance fields.
-
31 May 2022 1 repository listedExisting 3D-aware facial generation methods face a dilemma in quality versus editability: they either generate editable results in low resolution or high-quality ones with no editing flexibility.
-
13 Apr 2022 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)To address this challenge, we propose Multi-View Consistent Generative Adversarial Networks (MVCGAN) for high-quality 3D-aware image synthesis with geometry constraints.
-
21 Mar 2022 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)In light of recent advances in NeRF-based 3D-aware generative models, we introduce a new task, Semantic-to-NeRF translation, that aims to reconstruct a 3D scene modelled by NeRF, conditioned on one single-view semantic…
-
1 Jan 2022 1 repository listedWe propose a pipeline to generate Neural Radiance Fields (NeRF) of an object or a scene of a specific class, conditioned on a single input image.
-
21 Dec 2021 1 repository listedWe introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF.
-
20 Dec 2021 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)The feature field is further accumulated into a 2D feature map as the textural representation, followed by a neural renderer for appearance synthesis.
-
2 Dec 2021 1 repository listedHowever, they usually struggle to generate high-quality images representing non-rigid objects, such as the human body, which is of a great interest for many computer graphics applications.
-
30 Nov 2021 1 repository listed2D GANs can generate high fidelity portraits but with low view consistency.
-
1 Nov 2021 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)In this paper, we propose Generative Occupancy Fields (GOF), a novel model based on generative radiance fields that can learn compact object surfaces without impeding its training convergence.
-
29 Oct 2021 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 15 harvested samples) · 1 pointer-only (licence)Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint as regularization to learn valid 3D radiance fields from 2D images.
-
19 Oct 2021 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 1 pointer-only (licence)The style-based GAN (StyleGAN) architecture achieved state-of-the-art results for generating high-quality images, but it lacks explicit and precise control over camera poses.
-
4 Dec 2020 1 repository listedA radiograph visualizes the internal anatomy of a patient through the use of X-ray, which projects 3D information onto a 2D plane.
-
5 Jul 2020 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 1 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 1 pointer-only (licence)In contrast to voxel-based representations, radiance fields are not confined to a coarse discretization of the 3D space, yet allow for disentangling camera and scene properties while degrading gracefully in the presence…
-
SuperNeRF-GAN: A Universal 3D-Consistent Super-Resolution Framework for Efficient and Enhanced 3D-Aware Image Synthesis12 Jan 2025 0 repositories listedNeural volume rendering techniques, such as NeRF, have revolutionized 3D-aware image synthesis by enabling the generation of images of a single scene or object from various camera poses.
-
SemanticHuman-HD: High-Resolution Semantic Disentangled 3D Human Generation15 Mar 2024 0 repositories listedWith the development of neural radiance fields and generative models, numerous methods have been proposed for learning 3D human generation from 2D images.
-
WildFusion: Learning 3D-Aware Latent Diffusion Models in View Space22 Nov 2023 0 repositories listedModern learning-based approaches to 3D-aware image synthesis achieve high photorealism and 3D-consistent viewpoint changes for the generated images.
-
Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Images13 Apr 2023 0 repositories listed
-
BlobGAN-3D: A Spatially-Disentangled 3D-Aware Generative Model for Indoor Scenes26 Mar 2023 0 repositories listed
-
SDF-3DGAN: A 3D Object Generative Method Based on Implicit Signed Distance Function13 Mar 2023 0 repositories listed
-
Painting 3D Nature in 2D: View Synthesis of Natural Scenes from a Single Semantic Mask14 Feb 2023 0 repositories listed
-
BallGAN: 3D-aware Image Synthesis with a Spherical Background22 Jan 2023 0 repositories listed
-
Learning 3D-aware Image Synthesis with Unknown Pose Distribution18 Jan 2023 0 repositories listed
-
Quantitative Manipulation of Custom Attributes on 3D-Aware Image Synthesis1 Jan 2023 0 repositories listed
-
DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesis22 Dec 2022 0 repositories listed
-
Controllable Radiance Fields for Dynamic Face Synthesis11 Oct 2022 0 repositories listed
-
Improving 3D-aware Image Synthesis with A Geometry-aware Discriminator30 Sep 2022 0 repositories listed
-
Improving GANs with A Dynamic Discriminator20 Sep 2022 0 repositories listed
-
3D-Aware Indoor Scene Synthesis with Depth Priors17 Feb 2022 0 repositories listed
-
VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting13 Jan 2022 0 repositories listed
-
GRAM: Generative Radiance Manifolds for 3D-Aware Image Generation16 Dec 2021 0 repositories listed
-
CG-NeRF: Conditional Generative Neural Radiance Fields7 Dec 2021 0 repositories listed
-
Template NeRF: Towards Modeling Dense Shape Correspondences from Category-Specific Object Images8 Nov 2021 0 repositories listed
-
CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields31 Mar 2021 0 repositories listed
-
Exact Inference for Relational Graphical Models with Interpreted Functions: Lifted Probabilistic Inference Modulo Theories4 Sep 2017 0 repositories listed
Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections