Papers › Large Scale GAN Training for High Fidelity Natural Image Synthesis

Large Scale GAN Training for High Fidelity Natural Image Synthesis

28 Sep 2018ICLR 2019 5arXiv:1809.11096archive 2025-07-28

Andrew Brock, Jeff Donahue, Karen Simonyan

Despite recent progress in generative image modeling, successfully generating high-resolution, diverse samples from complex datasets such as ImageNet remains an elusive goal. To this end, we train Generative Adversarial Networks at the largest scale yet attempted, and study the instabilities specific to such scale. We find that applying orthogonal regularization to the generator renders it amenable to a simple "truncation trick," allowing fine control over the trade-off between sample fidelity and variety by reducing the variance of the Generator's input. Our modifications lead to models which set the new state of the art in class-conditional image synthesis. When trained on ImageNet at 128x128 resolution, our models (BigGANs) achieve an Inception Score (IS) of 166.5 and Frechet Inception Distance (FID) of 7.4, improving over the previous best IS of 52.52 and FID of 18.6.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1809.11096")

Code

Syntology Ran 14 of 41 code samples harvested from 6 repositories linked to this paper; 27 have no recorded run. Of those that ran: 1 ran · honoured contract; 2 ran · violated contract; 7 ran · our draft was wrong; 1 ran · fixture could not drive it; 3 ran with no contract checked.

By repository: community (archive-listed): 38 samples from 6 repositories, 13 ran; 3 identical to code first harvested elsewhere. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

35 repositories listed; official and paper-mentioned ones first.

ANIME305/Anime-GAN mentioned on GitHubtf report
ANIME305/Anime-GAN-tensorflow mentioned on GitHubtf report
AlexVerine/PrecisionRecallGan mentioned on GitHubpytorch report
ZVK/Talking-Heads mentioned on GitHubpytorchGPL-3.0 report
ZVK/talking_heads mentioned on GitHubpytorch report
ajbrock/BigGAN-PyTorch mentioned on GitHubpytorchMIT report
alexverine/precisionrecallbiggan mentioned on GitHubpytorch report
amanjaiswal73892/change_my_pet mentioned on GitHubpytorch report
clu0/unet.cu mentioned on GitHubpytorch report
gcervantes8/Game-Image-Generator mentioned on GitHubpytorch report
kidist-amde/biggan-pytorch mentioned on GitHubpytorchMIT report
lucidrains/big-sleep mentioned on GitHubpytorchMIT report
luqui/big-sleep mentioned on GitHubpytorchMIT report
mingtaoguo/biggan-tensorflow mentioned on GitHubtfMIT report
minyoungg/GAN-Transform-and-Project mentioned on GitHubpytorch report
minyoungg/pix2latent mentioned on GitHubpytorchApache-2.0 report
rajveen/ChangeMyPet mentioned on GitHubpytorch report
rkorzeniowski/bigbigan-pytorch mentioned on GitHubpytorchMIT report
sagy101/SoundGAN mentioned on GitHubpytorch report
taki0112/BigGAN-Tensorflow mentioned on GitHubtfMIT report
yaxingwang/DeepI2I mentioned on GitHubpytorch report
yaxingwang/MineGAN mentioned on GitHubtfMIT report
yuanyuan-yuan/neural-coverage mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

41 samples harvested; 14 ran; 1 honoured the contract we drafted; 27 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

1ran · honoured contract
2ran · violated contract
7ran · our draft was wrong
1ran · fixture could not drive it
3ran
27unverified

Licence: 4 of the 41 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 6 repositories linked to this paper, official or community; each sample names its own and says which. Some samples are identical code Syntology first harvested from another repository; for those, this paper's copy is not located and its licence is not recorded. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

D_arch kidist-amde/biggan-pytorch/BigGAN.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 85eb95cce203dfc7 · report
E_arch yaxingwang/DeepI2I/DeepI2I_BigGAN/BigGAN.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · c49b45bbb80fa489 · report
G_arch kidist-amde/biggan-pytorch/BigGAN.py community (archive-listed) ran · our draft was wrong MIT (permissive) · e8c308c9283407d7 · report
exists lucidrains/big-sleep/big_sleep/big_sleep.py community (archive-listed) ran · violated contract MIT (permissive) · aa5486a3650902d8 · report
find_classes kidist-amde/biggan-pytorch/datasets.py community (archive-listed) ran MIT (permissive) · 52d10a10fb72fb9f · report
gram_schmidt kidist-amde/biggan-pytorch/layers.py community (archive-listed) ran · our draft was wrong MIT (permissive) · c41836f3e51fa8f1 · report
is_image_file kidist-amde/biggan-pytorch/datasets.py community (archive-listed) ran MIT (permissive) · 4e6a8faaf8e44abe · report
l2normalize kidist-amde/biggan-pytorch/TFHub/biggan_v1.py community (archive-listed) ran · violated contract fingerprinted MIT (permissive) · 9b11458d7d1ec61c · report
lanczos lucidrains/big-sleep/big_sleep/resample.py community (archive-listed) ran · our draft was wrong fingerprinted MIT (permissive) · 1c4b58a58ab65b12 · report
make_dataset kidist-amde/biggan-pytorch/datasets.py community (archive-listed) ran MIT (permissive) · 79e61b6269a450e8 · report
ramp lucidrains/big-sleep/big_sleep/resample.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · 8c580a6820115461 · report
sinc lucidrains/big-sleep/big_sleep/resample.py community (archive-listed) ran · our draft was wrong fingerprinted MIT (permissive) · 86a64cd8e1771cc5 · report
url_to_filename lucidrains/big-sleep/big_sleep/biggan.py community (archive-listed) ran · our draft was wrong fingerprinted MIT (permissive) · 5eff22fa0a651276 · report
build_model lucidrains/big-sleep/big_sleep/clip.py community (archive-listed) unverified MIT (permissive) · 2d6984fd14c32184 · report
cached_path lucidrains/big-sleep/big_sleep/biggan.py community (archive-listed) unverified MIT (permissive) · 9dba35ef1c6281eb · report
conditional_batchnorm mingtaoguo/biggan-tensorflow/ops.py community (archive-listed) unverified MIT (permissive) · 8fd36edeb5ac19db · report
conv mingtaoguo/biggan-tensorflow/ops.py community (archive-listed) unverified MIT (permissive) · 0fe7078e87e1115e · report
create_text_path lucidrains/big-sleep/big_sleep/big_sleep.py community (archive-listed) unverified MIT (permissive) · 7ce5c26b4ae6975e · report
denorm kidist-amde/biggan-pytorch/TFHub/biggan_v1.py community (archive-listed) unverified MIT (permissive) · 6e16337c88174e00 · report
differentiable_topk lucidrains/big-sleep/big_sleep/big_sleep.py community (archive-listed) unverified MIT (permissive) · 6c9418cb364fc28e · report
filename_to_url lucidrains/big-sleep/big_sleep/biggan.py community (archive-listed) unverified MIT (permissive) · c5ba2abfbf6a9dfa · report
load lucidrains/big-sleep/big_sleep/clip.py community (archive-listed) unverified MIT (permissive) · b5b26b1bb3d408a5 · report
load luqui/big-sleep/big_sleep/clip.py community (archive-listed) unverified MIT (permissive) · 3d58ef750e04cfc8 · report
load_data taki0112/BigGAN-Tensorflow/utils.py community (archive-listed) unverified MIT (permissive) · 480dc6bdc031d794 · report
loss_dcgan_dis kidist-amde/biggan-pytorch/losses.py community (archive-listed) unverified MIT (permissive) · 982a26492dc6b7fb · report
loss_dcgan_gen kidist-amde/biggan-pytorch/losses.py community (archive-listed) unverified MIT (permissive) · 6c34831223553b6f · report
loss_hinge_dis kidist-amde/biggan-pytorch/losses.py community (archive-listed) unverified MIT (permissive) · 290cd37ab0098d5c · report
non_local mingtaoguo/biggan-tensorflow/ops.py community (archive-listed) unverified MIT (permissive) · f4b3879c22631581 · report
normalize taki0112/BigGAN-Tensorflow/utils.py community (archive-listed) unverified MIT (permissive) · da566c7a926c1dd3 · report
permute_guidance luqui/big-sleep/slippery.py community (archive-listed) unverified MIT (permissive) · 6568dce1945cc36f · report
power_iteration kidist-amde/biggan-pytorch/layers.py community (archive-listed) unverified MIT (permissive) · 28d3a35157f2916d · report
preprocessing taki0112/BigGAN-Tensorflow/utils.py community (archive-listed) unverified MIT (permissive) · 7c108866402e9866 · report
proj kidist-amde/biggan-pytorch/layers.py community (archive-listed) unverified MIT (permissive) · 4015ab1f3ab9b881 · report
read_catdog mingtaoguo/biggan-tensorflow/utils.py community (archive-listed) unverified MIT (permissive) · 3aadcca52d456283 · report
read_cifar mingtaoguo/biggan-tensorflow/utils.py community (archive-listed) unverified MIT (permissive) · 38c8fd67120015bd · report
truncated_noise_sample mingtaoguo/biggan-tensorflow/utils.py community (archive-listed) unverified MIT (permissive) · c19e800fac89b7b2 · report
truncated_z_sample kidist-amde/biggan-pytorch/TFHub/biggan_v1.py community (archive-listed) unverified MIT (permissive) · b72f0c209b7b64be · report
underscorify luqui/big-sleep/big_sleep/big_sleep.py community (archive-listed) unverified MIT (permissive) · 4a5f2b9e54f4fd6c · report
get_embeddings_from_loader identical code first harvested elsewhere ran · fixture could not drive it licence of this copy not recorded · ff18ad392f262bf4 · report
get_embedder identical code first harvested elsewhere unverified licence of this copy not recorded · 8c0803be6096a937 · report
get_keep_indices identical code first harvested elsewhere unverified licence of this copy not recorded · ed9e5e2f2a6ec523 · report

Tasks

Conditional Image GenerationImage GenerationVocal Bursts Intensity Prediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Conditional Image Generation ArtBench-10 (32x32) BigGAN + DiffAug FID 4.055 #3 of 6 Archive leaderboard report
Conditional Image Generation CIFAR-10 BigGAN FID 14.73 #14 of 25 Archive leaderboard report
Conditional Image Generation CIFAR-10 BigGAN Inception score 9.22 #14 of 25 Archive leaderboard report
Conditional Image Generation ImageNet 128x128 BigGAN-deep FID 5.7 #7 of 22 Archive leaderboard report
Conditional Image Generation ImageNet 128x128 BigGAN-deep Inception score 124.5 #7 of 22 Archive leaderboard report
Conditional Image Generation ImageNet 128x128 BigGAN FID 8.7 #14 of 22 Archive leaderboard report
Conditional Image Generation ImageNet 128x128 BigGAN Inception score 98.8 #14 of 22 Archive leaderboard report
Image Generation CIFAR-10 BigGAN IS 9.22 #78 of 78 Archive leaderboard report
Image Generation ImageNet 128x128 BigGAN-deep FID 5.7 #13 of 23 Archive leaderboard report
Image Generation ImageNet 128x128 BigGAN-deep IS 124.5 #13 of 23 Archive leaderboard report
Image Generation ImageNet 128x128 BigGAN FID 8.7 #17 of 23 Archive leaderboard report
Image Generation ImageNet 128x128 BigGAN IS 98.8 #17 of 23 Archive leaderboard report
Image Generation ImageNet 256x256 BigGAN-deep FID 8.1 #92 of 94 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: BigGAN, BigGAN-deep, Off-Diagonal Orthogonal Regularization

1x1 ConvolutionAdamBatch NormalizationBigGANBigGAN-deepBottleneck Residual BlockConditional Batch NormalizationConvolutionDense ConnectionsEarly StoppingFeedforward NetworkGAN Hinge LossLinear LayerNon-Local BlockNon-Local OperationOff-Diagonal Orthogonal RegularizationOrthogonal RegularizationProjection DiscriminatorReLUResidual BlockResidual ConnectionSAGANSoftmaxSpectral NormalizationTTURTruncation Trick

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections