Papers › You Only Train Once: A Unified Framework for Both Full-Reference and No-Reference...

You Only Train Once: A Unified Framework for Both Full-Reference and No-Reference Image Quality Assessment

14 Oct 2023arXiv:2310.09560archive 2025-07-28

Yi Ke Yun, Weisi Lin

Although recent efforts in image quality assessment (IQA) have achieved promising performance, there still exists a considerable gap compared to the human visual system (HVS). One significant disparity lies in humans' seamless transition between full reference (FR) and no reference (NR) tasks, whereas existing models are constrained to either FR or NR tasks. This disparity implies the necessity of designing two distinct systems, thereby greatly diminishing the model's versatility. Therefore, our focus lies in unifying FR and NR IQA under a single framework. Specifically, we first employ an encoder to extract multi-level features from input images. Then a Hierarchical Attention (HA) module is proposed as a universal adapter for both FR and NR inputs to model the spatial distortion at each encoder stage. Furthermore, considering that different distortions contaminate encoder stages and damage image semantic meaning differently, a Semantic Distortion Aware (SDA) module is proposed to examine feature correlations between shallow and deep layers of the encoder. By adopting HA and SDA, the proposed network can effectively perform both FR and NR IQA. When our proposed model is independently trained on NR or FR IQA tasks, it outperforms existing models and achieves state-of-the-art performance. Moreover, when trained jointly on NR and FR IQA tasks, it further enhances the performance of NR IQA while achieving on-par performance in the state-of-the-art FR IQA. You only train once to perform both IQA tasks. Code will be released at: https://github.com/BarCodeReader/YOTO.

PaperPDFCode

Code

barcodereader/yoto officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Full-Reference Image Quality AssessmentImage Quality AssessmentNo-Reference Image Quality Assessment

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Quality Assessment KonIQ-10k UNIQA PLCC 0.938 #3 of 4 Archive leaderboard report
Image Quality Assessment KonIQ-10k UNIQA SRCC 0.926 #3 of 4 Archive leaderboard report
NR-IQA LIVE UNIQA PLCC 98.6 #1 of 1 Archive leaderboard report
NR-IQA LIVE UNIQA SRCC 98.6 #1 of 1 Archive leaderboard report
No-Reference Image Quality Assessment CSIQ UNIQA PLCC 0.970 #1 of 8 Archive leaderboard report
No-Reference Image Quality Assessment CSIQ UNIQA SRCC 0.964 #1 of 8 Archive leaderboard report
No-Reference Image Quality Assessment KADID-10k UNIQA PLCC 0.946 #2 of 9 Archive leaderboard report
No-Reference Image Quality Assessment KADID-10k UNIQA SRCC 0.944 #2 of 9 Archive leaderboard report
No-Reference Image Quality Assessment LIVE UNIQA PLCC 0.986 #1 of 1 Archive leaderboard report
No-Reference Image Quality Assessment LIVE UNIQA SRCC 0.986 #1 of 1 Archive leaderboard report
No-Reference Image Quality Assessment TID2013 UNIQA PLCC 0.956 #1 of 8 Archive leaderboard report
No-Reference Image Quality Assessment TID2013 UNIQA SRCC 0.953 #1 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AWAREAbsolute Position EncodingsAdamAdapterAttentionBPEDense ConnectionsDropoutFocusLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections