{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/vulnerabilities-in-video-quality-assessment-1","title":"Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attacks","arxiv_id":"2309.13609","date":"2023-09-24","proceeding":"NeurIPS 2023 11","authors":["Ao-Xiang Zhang","Yu Ran","Weixuan Tang","Yuan-Gen Wang"],"abstract":"No-Reference Video Quality Assessment (NR-VQA) plays an essential role in improving the viewing experience of end-users. Driven by deep learning, recent NR-VQA models based on Convolutional Neural Networks (CNNs) and Transformers have achieved outstanding performance. To build a reliable and practical assessment system, it is of great necessity to evaluate their robustness. However, such issue has received little attention in the academic community. In this paper, we make the first attempt to evaluate the robustness of NR-VQA models against adversarial attacks, and propose a patch-based random search method for black-box attack. Specifically, considering both the attack effect on quality score and the visual quality of adversarial video, the attack problem is formulated as misleading the estimated quality score under the constraint of just-noticeable difference (JND). Built upon such formulation, a novel loss function called Score-Reversed Boundary Loss is designed to push the adversarial video's estimated quality score far away from its ground-truth score towards a specific boundary, and the JND constraint is modeled as a strict $L_2$ and $L_\\infty$ norm restriction. By this means, both white-box and black-box attacks can be launched in an effective and imperceptible manner. The source code is available at https://github.com/GZHU-DVL/AttackVQA.","url_abs":"https://arxiv.org/abs/2309.13609v3","url_pdf":"https://arxiv.org/pdf/2309.13609v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"vulnerabilities-in-video-quality-assessment-1","repo_url":"https://github.com/gzhu-dvl/attackvqa","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"video-quality-assessment","task_name":"Video Quality Assessment"},{"task_slug":"visual-question-answering","task_name":"Visual Question Answering (VQA)"}],"methods":[{"method_slug":"random-search","method_name":"Random Search"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2309.13609","atlas_url":"https://app.syntology.ai/?focus=2309.13609","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.13609"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gzhu-dvl/attackvqa","reach":null}],"summary":{"ran_draft_wrong":2,"ran_honours":1,"ran_fixture":1},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"5a58871ebe4d9e65","entry":"get_Lsrb_value","repo":"gzhu-dvl/attackvqa","repo_kind":"official","path":"Black-box.py","file_url":"https://github.com/gzhu-dvl/attackvqa/blob/HEAD/Black-box.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5a58871ebe4d9e65"}},{"code_sha256_prefix":"b4685689e085cefd","entry":"l2_proj","repo":"gzhu-dvl/attackvqa","repo_kind":"official","path":"White-box.py","file_url":"https://github.com/gzhu-dvl/attackvqa/blob/HEAD/White-box.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b4685689e085cefd"}},{"code_sha256_prefix":"2752657796490a9e","entry":"l2_proj_linf","repo":"gzhu-dvl/attackvqa","repo_kind":"official","path":"White-box.py","file_url":"https://github.com/gzhu-dvl/attackvqa/blob/HEAD/White-box.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2752657796490a9e"}},{"code_sha256_prefix":"a438ca3d03d43cf9","entry":"patch_based","repo":"gzhu-dvl/attackvqa","repo_kind":"official","path":"Black-box.py","file_url":"https://github.com/gzhu-dvl/attackvqa/blob/HEAD/Black-box.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a438ca3d03d43cf9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}