Papers › Feature-domain Adaptive Contrastive Distillation for Efficient Single Image Super-Resolution
Feature-domain Adaptive Contrastive Distillation for Efficient Single Image Super-Resolution
HyeonCheol Moon, Jinwoo Jeong, Sungjei Kim
Recently, CNN-based SISR has numerous parameters and high computational cost to achieve better performance, limiting its applicability to resource-constrained devices such as mobile. As one of the methods to make the network efficient, Knowledge Distillation (KD), which transfers teacher's useful knowledge to student, is currently being studied. More recently, KD for SISR utilizes Feature Distillation (FD) to minimize the Euclidean distance loss of feature maps between teacher and student networks, but it does not sufficiently consider how to effectively and meaningfully deliver knowledge from teacher to improve the student performance at given network capacity constraints. In this paper, we propose a feature-domain adaptive contrastive distillation (FACD) method for efficiently training lightweight student SISR networks. We show the limitations of the existing FD methods using Euclidean distance loss, and propose a feature-domain contrastive loss that makes a student network learn richer information from the teacher's representation in the feature domain. In addition, we propose an adaptive distillation that selectively applies distillation depending on the conditions of the training patches. The experimental results show that the student EDSR and RCAN networks with the proposed FACD scheme improves not only the PSNR performance of the entire benchmark datasets and scales, but also the subjective image quality compared to the conventional FD approaches.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Image Super-Resolution | Set5 - 2x upscaling | FACD | PSNR | 38.242 | #18 of 41 | Archive leaderboard | report |
| Image Super-Resolution | Set5 - 3x upscaling | FACD | PSNR | 34.729 | #16 of 32 | Archive leaderboard | report |
| Image Super-Resolution | Urban100 - 2x upscaling | FACD | PSNR | 32.878 | #19 of 29 | Archive leaderboard | report |
| Image Super-Resolution | Urban100 - 3x upscaling | FACD | PSNR | 28.818 | #16 of 22 | Archive leaderboard | report |
| Image Super-Resolution | Urban100 - 4x upscaling | FACD | PSNR | 26.606 | #34 of 65 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections