Papers › MaskGAN: Better Text Generation via Filling in the______
MaskGAN: Better Text Generation via Filling in the______
William Fedus, Ian Goodfellow, Andrew M. Dai
Neural text generation models are often autoregressive language models or seq2seq models. These models generate text by sampling words sequentially, with each word conditioned on the previous word, and are state-of-the-art for several machine translation and summarization benchmarks. These benchmarks are often defined by validation perplexity even though this is not a direct measure of the quality of the generated text. Additionally, these models are typically trained via maxi- mum likelihood and teacher forcing. These methods are well-suited to optimizing perplexity but can result in poor sample quality since generating text requires conditioning on sequences of words that may have never been observed at training time. We propose to improve sample quality using Generative Adversarial Networks (GANs), which explicitly train the generator to produce high quality samples and have shown a lot of success in image generation. GANs were originally designed to output differentiable values, so discrete language generation is challenging for them. We claim that validation perplexity alone is not indicative of the quality of text generated by a model. We introduce an actor-critic conditional GAN that fills in missing text conditioned on the surrounding context. We show qualitatively and quantitatively, evidence that this produces more realistic conditional and unconditional text samples compared to a maximum likelihood trained model.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Multivariate Time Series Imputation | Basketball Players Movement | MaskGAN | OOB Rate (10^−3) | 4.592 | #3 of 5 | Archive leaderboard | report |
| Multivariate Time Series Imputation | Basketball Players Movement | MaskGAN | Path Difference | 0.680 | #3 of 5 | Archive leaderboard | report |
| Multivariate Time Series Imputation | Basketball Players Movement | MaskGAN | Path Length | 0.793 | #3 of 5 | Archive leaderboard | report |
| Multivariate Time Series Imputation | Basketball Players Movement | MaskGAN | Player Distance | 0.427 | #3 of 5 | Archive leaderboard | report |
| Multivariate Time Series Imputation | Basketball Players Movement | MaskGAN | Step Change (10^−3) | 9.622 | #3 of 5 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections