Papers › Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training

Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training

9 Nov 2020arXiv:2011.04263archive 2025-07-28

Dingquan Li, Tingting Jiang, Ming Jiang

Video quality assessment (VQA) is an important problem in computer vision. The videos in computer vision applications are usually captured in the wild. We focus on automatically assessing the quality of in-the-wild videos, which is a challenging problem due to the absence of reference videos, the complexity of distortions, and the diversity of video contents. Moreover, the video contents and distortions among existing datasets are quite different, which leads to poor performance of data-driven methods in the cross-dataset evaluation setting. To improve the performance of quality assessment models, we borrow intuitions from human perception, specifically, content dependency and temporal-memory effects of human visual system. To face the cross-dataset evaluation challenge, we explore a mixed datasets training strategy for training a single VQA model with multiple datasets. The proposed unified framework explicitly includes three stages: relative quality assessor, nonlinear mapping, and dataset-specific perceptual scale alignment, to jointly predict relative quality, perceptual quality, and subjective quality. Experiments are conducted on four publicly available datasets for VQA in the wild, i.e., LIVE-VQC, LIVE-Qualcomm, KoNViD-1k, and CVD2014. The experimental results verify the effectiveness of the mixed datasets training strategy and prove the superior performance of the unified model in comparison with the state-of-the-art models. For reproducible research, we make the PyTorch implementation of our method available at https://github.com/lidq92/MDTVSFA.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

lidq92/MDTVSFA officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Video Quality Assessment

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Quality Assessment MSU NR VQA Database MDTVSFA KLCC 0.7883 #1 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database MDTVSFA PLCC 0.9431 #1 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database MDTVSFA SRCC 0.9289 #1 of 21 Archive leaderboard report
Video Quality Assessment MSU NR VQA Database MDTVSFA Type NR #1 of 21 Archive leaderboard report
Video Quality Assessment MSU SR-QA Dataset MDTVSFA KLCC 0.48406 #19 of 60 Archive leaderboard report
Video Quality Assessment MSU SR-QA Dataset MDTVSFA PLCC 0.61821 #19 of 60 Archive leaderboard report
Video Quality Assessment MSU SR-QA Dataset MDTVSFA SROCC 0.60193 #19 of 60 Archive leaderboard report
Video Quality Assessment MSU SR-QA Dataset MDTVSFA Type NR #19 of 60 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: MDTVSFA

MDTVSFA

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections