{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/delving-into-transferable-adversarial","title":"Delving into Transferable Adversarial Examples and Black-box Attacks","arxiv_id":"1611.02770","date":"2016-11-08","proceeding":null,"authors":["Yanpei Liu","Xinyun Chen","Chang Liu","Dawn Song"],"abstract":"An intriguing property of deep neural networks is the existence of\nadversarial examples, which can transfer among different architectures. These\ntransferable adversarial examples may severely hinder deep neural network-based\napplications. Previous works mostly study the transferability using small scale\ndatasets. In this work, we are the first to conduct an extensive study of the\ntransferability over large models and a large scale dataset, and we are also\nthe first to study the transferability of targeted adversarial examples with\ntheir target labels. We study both non-targeted and targeted adversarial\nexamples, and show that while transferable non-targeted adversarial examples\nare easy to find, targeted adversarial examples generated using existing\napproaches almost never transfer with their target labels. Therefore, we\npropose novel ensemble-based approaches to generating transferable adversarial\nexamples. Using such approaches, we observe a large proportion of targeted\nadversarial examples that are able to transfer with their target labels for the\nfirst time. We also present some geometric studies to help understanding the\ntransferable adversarial examples. Finally, we show that the adversarial\nexamples generated using ensemble-based approaches can successfully attack\nClarifai.com, which is a black-box image classification system.","url_abs":"http://arxiv.org/abs/1611.02770v3","url_pdf":"http://arxiv.org/pdf/1611.02770v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"delving-into-transferable-adversarial","repo_url":"https://github.com/sunblaze-ucb/transferability-advdnn-pub","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"delving-into-transferable-adversarial","repo_url":"https://github.com/coallaoh/whitenblackbox","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"adversarial-attack","task_name":"Adversarial Attack"},{"task_slug":"adversarial-defense","task_name":"Adversarial Defense"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1611.02770","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1611.02770"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/coallaoh/whitenblackbox","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sunblaze-ucb/transferability-advdnn-pub","reach":{"status":"ok"}}],"summary":{"unverified":10},"by_repo_kind":{"listed":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3a20838f842702d2","entry":"config","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/mnist_metamodel/mnist_metamodel.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/mnist_metamodel/mnist_metamodel.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a20838f842702d2"}},{"code_sha256_prefix":"6b78663ef111f28f","entry":"config","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/mnist_nets/mnist.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/mnist_nets/mnist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6b78663ef111f28f"}},{"code_sha256_prefix":"a884ba7578ed137e","entry":"da","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/lib_pytorch/basetool.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/lib_pytorch/basetool.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a884ba7578ed137e"}},{"code_sha256_prefix":"c60c153eb9677573","entry":"exact_configs","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/mnist_nets/postprocess_mnist_nets.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/mnist_nets/postprocess_mnist_nets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c60c153eb9677573"}},{"code_sha256_prefix":"94f11e5098a44e8a","entry":"initstats_generator","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/mnist_metamodel/mnist_metamodel.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/mnist_metamodel/mnist_metamodel.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"94f11e5098a44e8a"}},{"code_sha256_prefix":"6d45f1a08c939f39","entry":"label_generator","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/mnist_metamodel/mnist_metamodel.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/mnist_metamodel/mnist_metamodel.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d45f1a08c939f39"}},{"code_sha256_prefix":"7f3b39d720a0df96","entry":"load_conf_control_models","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/mnist_nets/train_mnist_nets.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/mnist_nets/train_mnist_nets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7f3b39d720a0df96"}},{"code_sha256_prefix":"75f937c0ce2d64a2","entry":"mnist_data_transform","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/mnist_nets/mnist.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/mnist_nets/mnist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"75f937c0ce2d64a2"}},{"code_sha256_prefix":"360bd4a0407f11d6","entry":"prune_cos","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/mnist_nets/postprocess_mnist_nets.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/mnist_nets/postprocess_mnist_nets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"360bd4a0407f11d6"}},{"code_sha256_prefix":"c4ff659b3d3a5323","entry":"return_drop","repo":"coallaoh/whitenblackbox","repo_kind":"listed","path":"src/mnist_nets/mnist.py","file_url":"https://github.com/coallaoh/whitenblackbox/blob/HEAD/src/mnist_nets/mnist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4ff659b3d3a5323"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}