{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/kvq-kaleidoscope-video-quality-assessment-for","title":"KVQ: Kwai Video Quality Assessment for Short-form Videos","arxiv_id":"2402.07220","date":"2024-02-11","proceeding":"CVPR 2024 1","authors":["Yiting Lu","Xin Li","Yajing Pei","Kun Yuan","Qizhi Xie","Yunpeng Qu","Ming Sun","Chao Zhou","Zhibo Chen"],"abstract":"Short-form UGC video platforms, like Kwai and TikTok, have been an emerging and irreplaceable mainstream media form, thriving on user-friendly engagement, and kaleidoscope creation, etc. However, the advancing content-generation modes, e.g., special effects, and sophisticated processing workflows, e.g., de-artifacts, have introduced significant challenges to recent UGC video quality assessment: (i) the ambiguous contents hinder the identification of quality-determined regions. (ii) the diverse and complicated hybrid distortions are hard to distinguish. To tackle the above challenges and assist in the development of short-form videos, we establish the first large-scale Kaleidoscope short Video database for Quality assessment, termed KVQ, which comprises 600 user-uploaded short videos and 3600 processed videos through the diverse practical processing workflows, including pre-processing, transcoding, and enhancement. Among them, the absolute quality score of each video and partial ranking score among indistinguishable samples are provided by a team of professional researchers specializing in image processing. Based on this database, we propose the first short-form video quality evaluator, i.e., KSVQE, which enables the quality evaluator to identify the quality-determined semantics with the content understanding of large vision language models (i.e., CLIP) and distinguish the distortions with the distortion understanding module. Experimental results have shown the effectiveness of KSVQE on our KVQ database and popular VQA databases.","url_abs":"https://arxiv.org/abs/2402.07220v2","url_pdf":"https://arxiv.org/pdf/2402.07220v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"kvq-kaleidoscope-video-quality-assessment-for","repo_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"form","task_name":"Form"},{"task_slug":"video-quality-assessment","task_name":"Video Quality Assessment"},{"task_slug":"visual-question-answering","task_name":"Visual Question Answering (VQA)"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2402.07220","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.07220"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024","reach":null}],"summary":{"ran":14,"ran_draft_wrong":4,"ran_fixture":3,"ran_honours":1,"unverified":6},"by_repo_kind":{"listed":{"samples":28,"ran":22,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":28,"samples":[{"code_sha256_prefix":"4f17b32dad980e53","entry":"Attention","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4f17b32dad980e53"}},{"code_sha256_prefix":"30bffdd06e87afa5","entry":"CLIP_extractor_addadapter_cls","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"30bffdd06e87afa5"}},{"code_sha256_prefix":"51b3fd50153ad8b6","entry":"CONTRIQUE_model","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"51b3fd50153ad8b6"}},{"code_sha256_prefix":"20223e0eec519729","entry":"Dist_Transformation3","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"20223e0eec519729"}},{"code_sha256_prefix":"64942b88f1136cf8","entry":"Dist_Transformation5","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"64942b88f1136cf8"}},{"code_sha256_prefix":"33c570bc8930a192","entry":"Dist_Transformation7","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"33c570bc8930a192"}},{"code_sha256_prefix":"b684a3f5d798d30a","entry":"Mlp","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b684a3f5d798d30a"}},{"code_sha256_prefix":"f9e0db5dae9068ca","entry":"PatchEmbed3D","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f9e0db5dae9068ca"}},{"code_sha256_prefix":"092afab2341fa8d8","entry":"PatchMerging","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"092afab2341fa8d8"}},{"code_sha256_prefix":"bf910f043f135ebe","entry":"Semantic_Transformation4","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bf910f043f135ebe"}},{"code_sha256_prefix":"eb92a4f883719f46","entry":"Semantic_Transformation6","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"eb92a4f883719f46"}},{"code_sha256_prefix":"e7160717d06600e2","entry":"Semantic_Transformation8","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e7160717d06600e2"}},{"code_sha256_prefix":"5947884d8a6da577","entry":"WindowAttention3D","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5947884d8a6da577"}},{"code_sha256_prefix":"9c5f0f9b1e7635c8","entry":"compute_mask","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9c5f0f9b1e7635c8"}},{"code_sha256_prefix":"ff6d01ab74ef0fd2","entry":"crossattention1","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ff6d01ab74ef0fd2"}},{"code_sha256_prefix":"29bcc276db28ab85","entry":"distortion_contrastive_supervised","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"29bcc276db28ab85"}},{"code_sha256_prefix":"e4f140f85865ac5e","entry":"fragment_infos","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e4f140f85865ac5e"}},{"code_sha256_prefix":"f9ad01f8ca274dca","entry":"get_adaptive_window_size","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f9ad01f8ca274dca"}},{"code_sha256_prefix":"c19485093ee920a2","entry":"get_network","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c19485093ee920a2"}},{"code_sha256_prefix":"555de784c61b26da","entry":"global_position_index","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"555de784c61b26da"}},{"code_sha256_prefix":"ff07c6c05a30f4a8","entry":"resize_pos_embed2d","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ff07c6c05a30f4a8"}},{"code_sha256_prefix":"0b61daa7a9e9cba6","entry":"window_partition","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0b61daa7a9e9cba6"}},{"code_sha256_prefix":"2041a50857f664d7","entry":"BasicLayer","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2041a50857f664d7"}},{"code_sha256_prefix":"22a83c36ab143ed6","entry":"KSVQE","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"22a83c36ab143ed6"}},{"code_sha256_prefix":"ea1bb9ec61d67c3a","entry":"Semantic_Transformation2","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ea1bb9ec61d67c3a"}},{"code_sha256_prefix":"6dc7fae55e8b43e3","entry":"SwinTransformerBlock3D","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6dc7fae55e8b43e3"}},{"code_sha256_prefix":"c85d5e20f082b1f0","entry":"build_CLIPmodel_basedadapter_cls","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c85d5e20f082b1f0"}},{"code_sha256_prefix":"04ec11cc7e389655","entry":"load_clip_to_cpu","repo":"lixinustc/kvq-challenge-cvpr-ntire2024","repo_kind":"listed","path":"models/backbones/KSVQE_model.py","file_url":"https://github.com/lixinustc/kvq-challenge-cvpr-ntire2024/blob/HEAD/models/backbones/KSVQE_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"04ec11cc7e389655"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}