Papers › Perceptual Quality Assessment of Smartphone Photography

Perceptual Quality Assessment of Smartphone Photography

1 Jun 2020CVPR 2020 6archive 2025-07-28

Yuming Fang, Hanwei Zhu, Yan Zeng, Kede Ma, Zhou Wang

As smartphones become people's primary cameras to take photos, the quality of their cameras and the associated computational photography modules has become a de facto standard in evaluating and ranking smartphones in the consumer market. We conduct so far the most comprehensive study of perceptual quality assessment of smartphone photography. We introduce the Smartphone Photography Attribute and Quality (SPAQ) database, consisting of 11,125 pictures taken by 66 smartphones, where each image is attached with so far the richest annotations. Specifically, we collect a series of human opinions for each image, including image quality, image attributes (brightness, colorfulness, contrast, noisiness, and sharpness), and scene category labels (animal, cityscape, human, indoor scene, landscape, night scene, plant, still life, and others) in a well-controlled laboratory environment. The exchangeable image file format (EXIF) data for all images are also recorded to aid deeper analysis. We also make the first attempts using the database to train blind image quality assessment (BIQA) models constructed by baseline and multi-task deep neural networks. The results provide useful insights on how EXIF data, image attributes and high-level semantics interact with image quality, how next-generation BIQA models can be designed, and how better computational photography systems can be optimized on mobile devices. The database along with the proposed BIQA models are available at https://github.com/h4nwei/SPAQ.

PaperPDFCode

Code

h4nwei/SPAQ officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

AttributeImage Quality AssessmentNo-Reference Image Quality Assessment

Datasets

Introduced by this paper, per the archive.

SPAQ

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Quality Assessment MSU NR VQA Database SPAQ MT-S KLCC 0.7186 #4 of 10 Archive leaderboard report
Image Quality Assessment MSU NR VQA Database SPAQ MT-S PLCC 0.8814 #4 of 10 Archive leaderboard report
Image Quality Assessment MSU NR VQA Database SPAQ MT-S SRCC 0.8822 #4 of 10 Archive leaderboard report
Image Quality Assessment MSU NR VQA Database SPAQ BL KLCC 0.7106 #5 of 10 Archive leaderboard report
Image Quality Assessment MSU NR VQA Database SPAQ BL PLCC 0.8855 #5 of 10 Archive leaderboard report
Image Quality Assessment MSU NR VQA Database SPAQ BL SRCC 0.8799 #5 of 10 Archive leaderboard report
Image Quality Assessment MSU NR VQA Database SPAQ MT-A KLCC 0.7148 #6 of 10 Archive leaderboard report
Image Quality Assessment MSU NR VQA Database SPAQ MT-A PLCC 0.8824 #6 of 10 Archive leaderboard report
Image Quality Assessment MSU NR VQA Database SPAQ MT-A SRCC 0.8794 #6 of 10 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ MT-S KLCC 0.7186 #9 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ MT-S PLCC 0.8814 #9 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ MT-S SRCC 0.8822 #9 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ MT-S Type NR #9 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ BL KLCC 0.7106 #10 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ BL PLCC 0.8855 #10 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ BL SRCC 0.8799 #10 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ BL Type NR #10 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ MT-A KLCC 0.7148 #11 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ MT-A PLCC 0.8824 #11 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ MT-A SRCC 0.8794 #11 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database SPAQ MT-A Type NR #11 of 21 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections