Papers › Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training
Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training
Dingquan Li, Tingting Jiang, Ming Jiang
Video quality assessment (VQA) is an important problem in computer vision. The videos in computer vision applications are usually captured in the wild. We focus on automatically assessing the quality of in-the-wild videos, which is a challenging problem due to the absence of reference videos, the complexity of distortions, and the diversity of video contents. Moreover, the video contents and distortions among existing datasets are quite different, which leads to poor performance of data-driven methods in the cross-dataset evaluation setting. To improve the performance of quality assessment models, we borrow intuitions from human perception, specifically, content dependency and temporal-memory effects of human visual system. To face the cross-dataset evaluation challenge, we explore a mixed datasets training strategy for training a single VQA model with multiple datasets. The proposed unified framework explicitly includes three stages: relative quality assessor, nonlinear mapping, and dataset-specific perceptual scale alignment, to jointly predict relative quality, perceptual quality, and subjective quality. Experiments are conducted on four publicly available datasets for VQA in the wild, i.e., LIVE-VQC, LIVE-Qualcomm, KoNViD-1k, and CVD2014. The experimental results verify the effectiveness of the mixed datasets training strategy and prove the superior performance of the unified model in comparison with the state-of-the-art models. For reproducible research, we make the PyTorch implementation of our method available at https://github.com/lidq92/MDTVSFA.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Video Quality Assessment | MSU NR VQA Database | MDTVSFA | KLCC | 0.7883 | #1 of 21 | Archive leaderboard | report |
| Video Quality Assessment | MSU NR VQA Database | MDTVSFA | PLCC | 0.9431 | #1 of 21 | Archive leaderboard | report |
| Video Quality Assessment | MSU NR VQA Database | MDTVSFA | SRCC | 0.9289 | #1 of 21 | Archive leaderboard | report |
| Video Quality Assessment | MSU NR VQA Database | MDTVSFA | Type | NR | #1 of 21 | Archive leaderboard | report |
| Video Quality Assessment | MSU SR-QA Dataset | MDTVSFA | KLCC | 0.48406 | #19 of 60 | Archive leaderboard | report |
| Video Quality Assessment | MSU SR-QA Dataset | MDTVSFA | PLCC | 0.61821 | #19 of 60 | Archive leaderboard | report |
| Video Quality Assessment | MSU SR-QA Dataset | MDTVSFA | SROCC | 0.60193 | #19 of 60 | Archive leaderboard | report |
| Video Quality Assessment | MSU SR-QA Dataset | MDTVSFA | Type | NR | #19 of 60 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Introduced by this paper: MDTVSFA
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections