{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-framework-for-real-time-object-detection","title":"Resolution Enhancement Processing on Low Quality Images Using Swin Transformer Based on Interval Dense Connection Strategy","arxiv_id":"2303.09190","date":"2023-03-16","proceeding":null,"authors":["Rui-Yang Ju","Chih-Chia Chen","Jen-Shiun Chiang","Yu-Shian Lin","Wei-Han Chen","Chun-Tse Chien"],"abstract":"The Transformer-based method has demonstrated remarkable performance for image super-resolution in comparison to the method based on the convolutional neural networks (CNNs). However, using the self-attention mechanism like SwinIR (Image Restoration Using Swin Transformer) to extract feature information from images needs a significant amount of computational resources, which limits its application on low computing power platforms. To improve the model feature reuse, this research work proposes the Interval Dense Connection Strategy, which connects different blocks according to the newly designed algorithm. We apply this strategy to SwinIR and present a new model, which named SwinOIR (Object Image Restoration Using Swin Transformer). For image super-resolution, an ablation study is conducted to demonstrate the positive effect of the Interval Dense Connection Strategy on the model performance. Furthermore, we evaluate our model on various popular benchmark datasets, and compare it with other state-of-the-art (SOTA) lightweight models. For example, SwinOIR obtains a PSNR of 26.62 dB for x4 upscaling image super-resolution on Urban100 dataset, which is 0.15 dB higher than the SOTA model SwinIR. For real-life application, this work applies the lastest version of You Only Look Once (YOLOv8) model and the proposed model to perform object detection and real-life image super-resolution on low-quality images. This implementation code is publicly available at https://github.com/Rubbbbbbbbby/SwinOIR.","url_abs":"https://arxiv.org/abs/2303.09190v2","url_pdf":"https://arxiv.org/pdf/2303.09190v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-framework-for-real-time-object-detection","repo_url":"https://github.com/rubbbbbbbbby/swinoir","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"a-framework-for-real-time-object-detection","repo_url":"https://github.com/Mind23-2/MindCode-101/tree/main/IPT","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"image-cropping","task_name":"Image Cropping"},{"task_slug":"image-restoration","task_name":"Image Restoration"},{"task_slug":"image-super-resolution","task_name":"Image Super-Resolution"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"real-time-object-detection","task_name":"Real-Time Object Detection"},{"task_slug":"super-resolution","task_name":"Super-Resolution"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"stochastic-depth","method_name":"Stochastic Depth"},{"method_slug":"swin-transformer","method_name":"Swin Transformer"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-super-resolution-on-bsd100-2x-upscaling","task":"Image Super-Resolution","dataset":"BSD100 - 2x upscaling","model":"SwinOIR","rank_in_archive_order":18,"of":30,"metrics":{"PSNR":"32.34","SSIM":"0.9022"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-bsd100-3x-upscaling","task":"Image Super-Resolution","dataset":"BSD100 - 3x upscaling","model":"SwinOIR","rank_in_archive_order":13,"of":21,"metrics":{"PSNR":"29.27","SSIM":"0.8111"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-bsd100-4x-upscaling","task":"Image Super-Resolution","dataset":"BSD100 - 4x upscaling","model":"SwinOIR","rank_in_archive_order":23,"of":71,"metrics":{"PSNR":"27.76","SSIM":"0.7441"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-set14-2x-upscaling","task":"Image Super-Resolution","dataset":"Set14 - 2x upscaling","model":"SwinOIR","rank_in_archive_order":18,"of":35,"metrics":{"PSNR":"33.97","SSIM":"0.922"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-set14-3x-upscaling","task":"Image Super-Resolution","dataset":"Set14 - 3x upscaling","model":"SwinOIR","rank_in_archive_order":14,"of":24,"metrics":{"PSNR":"30.65","SSIM":"0.8493"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-set14-4x-upscaling","task":"Image Super-Resolution","dataset":"Set14 - 4x upscaling","model":"SwinOIR","rank_in_archive_order":38,"of":104,"metrics":{"PSNR":"28.92","SSIM":"0.7892"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-set5-2x-upscaling","task":"Image Super-Resolution","dataset":"Set5 - 2x upscaling","model":"SwinOIR","rank_in_archive_order":20,"of":41,"metrics":{"PSNR":"38.21","SSIM":"0.9614"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-set5-3x-upscaling","task":"Image Super-Resolution","dataset":"Set5 - 3x upscaling","model":"SwinOIR","rank_in_archive_order":19,"of":32,"metrics":{"PSNR":"34.69","SSIM":"0.9296"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-urban100-2x","task":"Image Super-Resolution","dataset":"Urban100 - 2x upscaling","model":"SwinOIR","rank_in_archive_order":20,"of":29,"metrics":{"PSNR":"32.83","SSIM":"0.9353"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-urban100-3x","task":"Image Super-Resolution","dataset":"Urban100 - 3x upscaling","model":"SwinOIR","rank_in_archive_order":15,"of":22,"metrics":{"PSNR":"28.87","SSIM":"0.8674"},"uses_additional_data":false},{"leaderboard":"/sota/image-super-resolution-on-urban100-4x","task":"Image Super-Resolution","dataset":"Urban100 - 4x upscaling","model":"SwinOIR","rank_in_archive_order":28,"of":65,"metrics":{"PSNR":"26.74","SSIM":"0.806"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}