{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/stabilizing-adversarial-nets-with-prediction","title":"Stabilizing Adversarial Nets With Prediction Methods","arxiv_id":"1705.07364","date":"2017-05-20","proceeding":"ICLR 2018 1","authors":["Abhay Yadav","Sohil Shah","Zheng Xu","David Jacobs","Tom Goldstein"],"abstract":"Adversarial neural networks solve many important problems in data science,\nbut are notoriously difficult to train. These difficulties come from the fact\nthat optimal weights for adversarial nets correspond to saddle points, and not\nminimizers, of the loss function. The alternating stochastic gradient methods\ntypically used for such problems do not reliably converge to saddle points, and\nwhen convergence does happen it is often highly sensitive to learning rates. We\npropose a simple modification of stochastic gradient descent that stabilizes\nadversarial networks. We show, both in theory and practice, that the proposed\nmethod reliably converges to saddle points, and is stable with a wider range of\ntraining parameters than a non-prediction method. This makes adversarial\nnetworks less likely to \"collapse,\" and enables faster training with larger\nlearning rates.","url_abs":"http://arxiv.org/abs/1705.07364v3","url_pdf":"http://arxiv.org/pdf/1705.07364v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"stabilizing-adversarial-nets-with-prediction","repo_url":"https://github.com/jaiabhayk/stableGAN","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"prediction","task_name":"Prediction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1705.07364","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}