{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/active-subspace-of-neural-networks-structural","title":"Active Subspace of Neural Networks: Structural Analysis and Universal Attacks","arxiv_id":"1910.13025","date":"2019-10-29","proceeding":null,"authors":["Chunfeng Cui","Kaiqi Zhang","Talgat Daulbaev","Julia Gusak","Ivan Oseledets","Zheng Zhang"],"abstract":"Active subspace is a model reduction method widely used in the uncertainty quantification community. In this paper, we propose analyzing the internal structure and vulnerability and deep neural networks using active subspace. Firstly, we employ the active subspace to measure the number of \"active neurons\" at each intermediate layer and reduce the number of neurons from several thousands to several dozens. This motivates us to change the network structure and to develop a new and more compact network, referred to as {ASNet}, that has significantly fewer model parameters. Secondly, we propose analyzing the vulnerability of a neural network using active subspace and finding an additive universal adversarial attack vector that can misclassify a dataset with a high probability. Our experiments on CIFAR-10 show that ASNet can achieve 23.98$\\times$ parameter and 7.30$\\times$ flops reduction. The universal active subspace attack vector can achieve around 20% higher attack ratio compared with the existing approach in all of our numerical experiments. The PyTorch codes for this paper are available online.","url_abs":"https://arxiv.org/abs/1910.13025v2","url_pdf":"https://arxiv.org/pdf/1910.13025v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"active-subspace-of-neural-networks-structural","repo_url":"https://github.com/chunfengc/ASNet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"adversarial-attack","task_name":"Adversarial Attack"},{"task_slug":"uncertainty-quantification","task_name":"Uncertainty Quantification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1910.13025","atlas_url":"https://app.syntology.ai/?focus=1910.13025","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.13025"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chunfengc/ASNet","reach":null}],"summary":{"ran_draft_wrong":2,"ran_fixture":1},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"26fcd6b071b7b5d0","entry":"AS_attack_input_small_dataset_sz","repo":"chunfengc/ASNet","repo_kind":"official","path":"ASNet/AS_Attack.py","file_url":"https://github.com/chunfengc/ASNet/blob/HEAD/ASNet/AS_Attack.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"26fcd6b071b7b5d0"}},{"code_sha256_prefix":"9fa6f6b2543a04d5","entry":"AS_attack_update_sz","repo":"chunfengc/ASNet","repo_kind":"official","path":"ASNet/AS_Attack.py","file_url":"https://github.com/chunfengc/ASNet/blob/HEAD/ASNet/AS_Attack.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9fa6f6b2543a04d5"}},{"code_sha256_prefix":"d874dd4707f6ba17","entry":"proj_v","repo":"chunfengc/ASNet","repo_kind":"official","path":"ASNet/AS_Attack.py","file_url":"https://github.com/chunfengc/ASNet/blob/HEAD/ASNet/AS_Attack.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d874dd4707f6ba17"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}