{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/seesr-towards-semantics-aware-real-world","title":"SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution","arxiv_id":"2311.16518","date":"2023-11-27","proceeding":"CVPR 2024 1","authors":["Rongyuan Wu","Tao Yang","Lingchen Sun","Zhengqiang Zhang","Shuai Li","Lei Zhang"],"abstract":"Owe to the powerful generative priors, the pre-trained text-to-image (T2I) diffusion models have become increasingly popular in solving the real-world image super-resolution problem. However, as a consequence of the heavy quality degradation of input low-resolution (LR) images, the destruction of local structures can lead to ambiguous image semantics. As a result, the content of reproduced high-resolution image may have semantic errors, deteriorating the super-resolution performance. To address this issue, we present a semantics-aware approach to better preserve the semantic fidelity of generative real-world image super-resolution. First, we train a degradation-aware prompt extractor, which can generate accurate soft and hard semantic prompts even under strong degradation. The hard semantic prompts refer to the image tags, aiming to enhance the local perception ability of the T2I model, while the soft semantic prompts compensate for the hard ones to provide additional representation information. These semantic prompts encourage the T2I model to generate detailed and semantically accurate results. Furthermore, during the inference process, we integrate the LR images into the initial sampling noise to mitigate the diffusion model's tendency to generate excessive random details. The experiments show that our method can reproduce more realistic image details and hold better the semantics. The source code of our method can be found at https://github.com/cswry/SeeSR.","url_abs":"https://arxiv.org/abs/2311.16518v2","url_pdf":"https://arxiv.org/pdf/2311.16518v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"seesr-towards-semantics-aware-real-world","repo_url":"https://github.com/cswry/seesr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"seesr-towards-semantics-aware-real-world","repo_url":"https://github.com/xpixelgroup/diffbir","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"image-super-resolution","task_name":"Image Super-Resolution"},{"task_slug":"super-resolution","task_name":"Super-Resolution"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2311.16518","atlas_url":"https://app.syntology.ai/?focus=2311.16518","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.16518"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xpixelgroup/diffbir","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cswry/seesr","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_fixture":2,"ran_draft_wrong":3,"ran":5,"unverified":5},"by_repo_kind":{"official":{"samples":6,"ran":1,"repositories":1},"listed":{"samples":9,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"144d10b49baeb8a6","entry":"window_partition","repo":"xpixelgroup/diffbir","repo_kind":"listed","path":"diffbir/model/swinir.py","file_url":"https://github.com/xpixelgroup/diffbir/blob/HEAD/diffbir/model/swinir.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":2,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"144d10b49baeb8a6"}},{"code_sha256_prefix":"c3a6b977022957cb","entry":"Normalize","repo":"xpixelgroup/diffbir","repo_kind":"listed","path":"diffbir/model/attention.py","file_url":"https://github.com/xpixelgroup/diffbir/blob/HEAD/diffbir/model/attention.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c3a6b977022957cb"}},{"code_sha256_prefix":"566b9df70aa38276","entry":"disabled_train","repo":"xpixelgroup/diffbir","repo_kind":"listed","path":"diffbir/model/cldm.py","file_url":"https://github.com/xpixelgroup/diffbir/blob/HEAD/diffbir/model/cldm.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"566b9df70aa38276"}},{"code_sha256_prefix":"f8cffb7cf0621a45","entry":"enforce_zero_terminal_snr","repo":"xpixelgroup/diffbir","repo_kind":"listed","path":"diffbir/model/gaussian_diffusion.py","file_url":"https://github.com/xpixelgroup/diffbir/blob/HEAD/diffbir/model/gaussian_diffusion.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f8cffb7cf0621a45"}},{"code_sha256_prefix":"2fac110f5991fe84","entry":"extract_into_tensor","repo":"xpixelgroup/diffbir","repo_kind":"listed","path":"diffbir/model/gaussian_diffusion.py","file_url":"https://github.com/xpixelgroup/diffbir/blob/HEAD/diffbir/model/gaussian_diffusion.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2fac110f5991fe84"}},{"code_sha256_prefix":"bd5a05ce886da4ce","entry":"image_grid","repo":"cswry/seesr","repo_kind":"official","path":"train_seesr.py","file_url":"https://github.com/cswry/seesr/blob/HEAD/train_seesr.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bd5a05ce886da4ce"}},{"code_sha256_prefix":"5b2d67393952cf18","entry":"make_beta_schedule","repo":"xpixelgroup/diffbir","repo_kind":"listed","path":"diffbir/model/gaussian_diffusion.py","file_url":"https://github.com/xpixelgroup/diffbir/blob/HEAD/diffbir/model/gaussian_diffusion.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5b2d67393952cf18"}},{"code_sha256_prefix":"c04a23de0531da4a","entry":"make_layer","repo":"xpixelgroup/diffbir","repo_kind":"listed","path":"diffbir/model/bsrnet.py","file_url":"https://github.com/xpixelgroup/diffbir/blob/HEAD/diffbir/model/bsrnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c04a23de0531da4a"}},{"code_sha256_prefix":"17eb0a31c91b671c","entry":"normal_kl","repo":"xpixelgroup/diffbir","repo_kind":"listed","path":"diffbir/model/distributions.py","file_url":"https://github.com/xpixelgroup/diffbir/blob/HEAD/diffbir/model/distributions.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"17eb0a31c91b671c"}},{"code_sha256_prefix":"61bf152e6a42a184","entry":"window_reverse","repo":"xpixelgroup/diffbir","repo_kind":"listed","path":"diffbir/model/swinir.py","file_url":"https://github.com/xpixelgroup/diffbir/blob/HEAD/diffbir/model/swinir.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"61bf152e6a42a184"}},{"code_sha256_prefix":"8d3cd21cd5c3181a","entry":"AttentionBlock","repo":"cswry/seesr","repo_kind":"official","path":"basicsr/archs/dfdnet_util.py","file_url":"https://github.com/cswry/seesr/blob/HEAD/basicsr/archs/dfdnet_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8d3cd21cd5c3181a"}},{"code_sha256_prefix":"b7c6741eed724350","entry":"adaptive_instance_normalization","repo":"cswry/seesr","repo_kind":"official","path":"basicsr/archs/dfdnet_util.py","file_url":"https://github.com/cswry/seesr/blob/HEAD/basicsr/archs/dfdnet_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b7c6741eed724350"}},{"code_sha256_prefix":"a7e8af4ef5efc131","entry":"calc_mean_std","repo":"cswry/seesr","repo_kind":"official","path":"basicsr/archs/dfdnet_util.py","file_url":"https://github.com/cswry/seesr/blob/HEAD/basicsr/archs/dfdnet_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a7e8af4ef5efc131"}},{"code_sha256_prefix":"2f00b39db5a81466","entry":"import_model_class_from_model_name_or_path","repo":"cswry/seesr","repo_kind":"official","path":"train_seesr.py","file_url":"https://github.com/cswry/seesr/blob/HEAD/train_seesr.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2f00b39db5a81466"}},{"code_sha256_prefix":"da94debb8019ad46","entry":"zero_module","repo":"cswry/seesr","repo_kind":"official","path":"models/controlnet.py","file_url":"https://github.com/cswry/seesr/blob/HEAD/models/controlnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"da94debb8019ad46"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}