{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/understanding-non-robust-feature","title":"Understanding (Non-)Robust Feature Disentanglement and the Relationship Between Low- and High-Dimensional Adversarial Attacks","arxiv_id":"2004.01903","date":"2020-04-04","proceeding":null,"authors":["Zuowen Wang","Leo Horne"],"abstract":"Recent work has put forth the hypothesis that adversarial vulnerabilities in neural networks are due to them overusing \"non-robust features\" inherent in the training data. We show empirically that for PGD-attacks, there is a training stage where neural networks start heavily relying on non-robust features to boost natural accuracy. We also propose a mechanism reducing vulnerability to PGD-style attacks consisting of mixing in a certain amount of images contain-ing mostly \"robust features\" into each training batch, and then show that robust accuracy is improved, while natural accuracy is not substantially hurt. We show that training on \"robust features\" provides boosts in robust accuracy across various architectures and for different attacks. Finally, we demonstrate empirically that these \"robust features\" do not induce spatial invariance.","url_abs":"https://arxiv.org/abs/2004.01903v1","url_pdf":"https://arxiv.org/pdf/2004.01903v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"understanding-non-robust-feature","repo_url":"https://github.com/ZuowenWang0000/Understanding-Non--Robust-Feature-Disentanglement-and-Flaws-of-the-Current-Supervised-Learning-Para","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"disentanglement","task_name":"Disentanglement"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}