{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-20704","title":"Auto-ART: Structured Literature Synthesis and Automated Adversarial Robustness Testing","arxiv_id":"2604.20704","date":"2026-04-22","proceeding":null,"authors":["Abhijit Talluri"],"abstract":"Adversarial robustness evaluation underpins every claim of trustworthy ML deployment, yet the field suffers from fragmented protocols and undetected gradient masking. We make two contributions. (1) Structured synthesis. We analyze nine peer-reviewed corpus sources (2020--2026) through seven complementary protocols, producing the first end-to-end structured analysis of the field's consensus and unresolved challenges. (2) Auto-ART framework. We introduce Auto-ART, an open-source framework that operationalizes identified gaps: 50+ attacks, 28 defense modules, the Robustness Diagnostic Index (RDI), and gradient-masking detection. It supports multi-norm evaluation (l1/l2/linf/semantic/spatial) and compliance mapping to NIST AI RMF, OWASP LLM Top 10, and the EU AI Act. Empirical validation on RobustBench demonstrates that Auto-ART's pre-screening identifies gradient masking in 92% of flagged cases, and RDI rankings correlate highly with full AutoAttack. Multi-norm evaluation exposes a 23.5 pp gap between average and worst-case robustness on state-of-the-art models. No prior work combines such structured meta-scientific analysis with an executable evaluation framework bridging literature gaps into engineering.","url_abs":"https://arxiv.org/abs/2604.20704","url_pdf":"https://arxiv.org/pdf/2604.20704","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2604.20704","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.20704"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/abhitall/auto-art","reach":null}],"summary":{"ran":4,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"6685f852f74de73d","entry":"ExecutionConfig","repo":"abhitall/auto-art","repo_kind":"found_in_text","path":"auto_art/core/orchestrator.py","file_url":"https://github.com/abhitall/auto-art/blob/HEAD/auto_art/core/orchestrator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6685f852f74de73d"}},{"code_sha256_prefix":"bcf0c964380c15b1","entry":"GateConfig","repo":"abhitall/auto-art","repo_kind":"found_in_text","path":"auto_art/core/orchestrator.py","file_url":"https://github.com/abhitall/auto-art/blob/HEAD/auto_art/core/orchestrator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bcf0c964380c15b1"}},{"code_sha256_prefix":"4eb8b87f9b941a55","entry":"OrchestratorConfig","repo":"abhitall/auto-art","repo_kind":"found_in_text","path":"auto_art/core/orchestrator.py","file_url":"https://github.com/abhitall/auto-art/blob/HEAD/auto_art/core/orchestrator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4eb8b87f9b941a55"}},{"code_sha256_prefix":"1dcdbf413c527b75","entry":"OrchestratorReport","repo":"abhitall/auto-art","repo_kind":"found_in_text","path":"auto_art/core/orchestrator.py","file_url":"https://github.com/abhitall/auto-art/blob/HEAD/auto_art/core/orchestrator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1dcdbf413c527b75"}},{"code_sha256_prefix":"cdef58a15377884c","entry":"Orchestrator","repo":"abhitall/auto-art","repo_kind":"found_in_text","path":"auto_art/core/orchestrator.py","file_url":"https://github.com/abhitall/auto-art/blob/HEAD/auto_art/core/orchestrator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cdef58a15377884c"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}