{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/descriptive-image-quality-assessment-in-the","title":"Descriptive Image Quality Assessment in the Wild","arxiv_id":"2405.18842","date":"2024-05-29","proceeding":null,"authors":["Zhiyuan You","Jinjin Gu","Zheyuan Li","Xin Cai","Kaiwen Zhu","Chao Dong","Tianfan Xue"],"abstract":"With the rapid advancement of Vision Language Models (VLMs), VLM-based Image Quality Assessment (IQA) seeks to describe image quality linguistically to align with human expression and capture the multifaceted nature of IQA tasks. However, current methods are still far from practical usage. First, prior works focus narrowly on specific sub-tasks or settings, which do not align with diverse real-world applications. Second, their performance is sub-optimal due to limitations in dataset coverage, scale, and quality. To overcome these challenges, we introduce Depicted image Quality Assessment in the Wild (DepictQA-Wild). Our method includes a multi-functional IQA task paradigm that encompasses both assessment and comparison tasks, brief and detailed responses, full-reference and non-reference scenarios. We introduce a ground-truth-informed dataset construction approach to enhance data quality, and scale up the dataset to 495K under the brief-detail joint framework. Consequently, we construct a comprehensive, large-scale, and high-quality dataset, named DQ-495K. We also retain image resolution during training to better handle resolution-related quality issues, and estimate a confidence score that is helpful to filter out low-quality responses. Experimental results demonstrate that DepictQA-Wild significantly outperforms traditional score-based methods, prior VLM-based IQA models, and proprietary GPT-4V in distortion identification, instant rating, and reasoning tasks. Our advantages are further confirmed by real-world applications including assessing the web-downloaded images and ranking model-processed images. Datasets and codes will be released in https://depictqa.github.io/depictqa-wild/.","url_abs":"https://arxiv.org/abs/2405.18842v2","url_pdf":"https://arxiv.org/pdf/2405.18842v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"descriptive-image-quality-assessment-in-the","repo_url":"https://github.com/XPixelGroup/DepictQA","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"descriptive","task_name":"Descriptive"},{"task_slug":"image-quality-assessment","task_name":"Image Quality Assessment"}],"methods":[{"method_slug":"align","method_name":"ALIGN"},{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2405.18842","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.18842"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/XPixelGroup/DepictQA","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":6,"ran_violates":1,"unverified":1},"by_repo_kind":{"listed":{"samples":8,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"483cfbcad2f5e464","entry":"calculate_plcc","repo":"XPixelGroup/DepictQA","repo_kind":"listed","path":"src/eval/cal_srcc_plcc_voting.py","file_url":"https://github.com/XPixelGroup/DepictQA/blob/HEAD/src/eval/cal_srcc_plcc_voting.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"483cfbcad2f5e464"}},{"code_sha256_prefix":"d6ad4fa766599fa3","entry":"calculate_srcc","repo":"XPixelGroup/DepictQA","repo_kind":"listed","path":"src/eval/cal_srcc_plcc_voting.py","file_url":"https://github.com/XPixelGroup/DepictQA/blob/HEAD/src/eval/cal_srcc_plcc_voting.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d6ad4fa766599fa3"}},{"code_sha256_prefix":"21a0840548bc398d","entry":"fit_curve","repo":"XPixelGroup/DepictQA","repo_kind":"listed","path":"src/eval/cal_srcc_plcc_voting.py","file_url":"https://github.com/XPixelGroup/DepictQA/blob/HEAD/src/eval/cal_srcc_plcc_voting.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"21a0840548bc398d"}},{"code_sha256_prefix":"3f0a6b1f203bd4a6","entry":"gen_context","repo":"XPixelGroup/DepictQA","repo_kind":"listed","path":"src/eval/cal_gpt4_score_detail_v1.py","file_url":"https://github.com/XPixelGroup/DepictQA/blob/HEAD/src/eval/cal_gpt4_score_detail_v1.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3f0a6b1f203bd4a6"}},{"code_sha256_prefix":"059892cb878c7ffe","entry":"gen_res_from_gpt","repo":"XPixelGroup/DepictQA","repo_kind":"listed","path":"src/eval/cal_gpt4_score_detail_v1.py","file_url":"https://github.com/XPixelGroup/DepictQA/blob/HEAD/src/eval/cal_gpt4_score_detail_v1.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"059892cb878c7ffe"}},{"code_sha256_prefix":"763f6fe20bd52fbb","entry":"parse_score","repo":"XPixelGroup/DepictQA","repo_kind":"listed","path":"src/eval/cal_gpt4_score_detail_v1.py","file_url":"https://github.com/XPixelGroup/DepictQA/blob/HEAD/src/eval/cal_gpt4_score_detail_v1.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"763f6fe20bd52fbb"}},{"code_sha256_prefix":"d22ddef4b1ae67fd","entry":"parse_score","repo":"XPixelGroup/DepictQA","repo_kind":"listed","path":"src/eval/cal_gpt4_score_detail_v2.py","file_url":"https://github.com/XPixelGroup/DepictQA/blob/HEAD/src/eval/cal_gpt4_score_detail_v2.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d22ddef4b1ae67fd"}},{"code_sha256_prefix":"7f670d7f1fc55960","entry":"gen_res_from_gpt","repo":"XPixelGroup/DepictQA","repo_kind":"listed","path":"src/eval/cal_gpt4_score_detail_v2.py","file_url":"https://github.com/XPixelGroup/DepictQA/blob/HEAD/src/eval/cal_gpt4_score_detail_v2.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7f670d7f1fc55960"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}