{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/improving-scene-text-image-super-resolution","title":"Improving Scene Text Image Super-resolution via Dual Prior Modulation Network","arxiv_id":"2302.10414","date":"2023-02-21","proceeding":null,"authors":["Shipeng Zhu","Zuoyan Zhao","Pengfei Fang","Hui Xue"],"abstract":"Scene text image super-resolution (STISR) aims to simultaneously increase the resolution and legibility of the text images, and the resulting images will significantly affect the performance of downstream tasks. Although numerous progress has been made, existing approaches raise two crucial issues: (1) They neglect the global structure of the text, which bounds the semantic determinism of the scene text. (2) The priors, e.g., text prior or stroke prior, employed in existing works, are extracted from pre-trained text recognizers. That said, such priors suffer from the domain gap including low resolution and blurriness caused by poor imaging conditions, leading to incorrect guidance. Our work addresses these gaps and proposes a plug-and-play module dubbed Dual Prior Modulation Network (DPMN), which leverages dual image-level priors to bring performance gain over existing approaches. Specifically, two types of prior-guided refinement modules, each using the text mask or graphic recognition result of the low-quality SR image from the preceding layer, are designed to improve the structural clarity and semantic accuracy of the text, respectively. The following attention mechanism hence modulates two quality-enhanced images to attain a superior SR result. Extensive experiments validate that our method improves the image quality and boosts the performance of downstream tasks over five typical approaches on the benchmark. Substantial visualizations and ablation studies demonstrate the advantages of the proposed DPMN. Code is available at: https://github.com/jdfxzzy/DPMN.","url_abs":"https://arxiv.org/abs/2302.10414v2","url_pdf":"https://arxiv.org/pdf/2302.10414v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"improving-scene-text-image-super-resolution","repo_url":"https://github.com/jdfxzzy/dpmn","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"improving-scene-text-image-super-resolution","repo_url":"https://github.com/jdfxzzy/pean","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-super-resolution","task_name":"Image Super-Resolution"},{"task_slug":"super-resolution","task_name":"Super-Resolution"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2302.10414","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2302.10414"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/jdfxzzy/DPMN","reach":null}],"summary":{"ran":5,"ran_fixture":1,"unverified":3},"by_repo_kind":{"official":{"samples":9,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2eda70dc4bda97b3","entry":"Mlp","repo":"jdfxzzy/DPMN","repo_kind":"official","path":"model/pgrm.py","file_url":"https://github.com/jdfxzzy/DPMN/blob/HEAD/model/pgrm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2eda70dc4bda97b3"}},{"code_sha256_prefix":"3c25c632b997cbfc","entry":"PatchEmbed","repo":"jdfxzzy/DPMN","repo_kind":"official","path":"model/pgrm.py","file_url":"https://github.com/jdfxzzy/DPMN/blob/HEAD/model/pgrm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c25c632b997cbfc"}},{"code_sha256_prefix":"8e37847cbc71fa7c","entry":"PatchUnEmbed","repo":"jdfxzzy/DPMN","repo_kind":"official","path":"model/pgrm.py","file_url":"https://github.com/jdfxzzy/DPMN/blob/HEAD/model/pgrm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8e37847cbc71fa7c"}},{"code_sha256_prefix":"da9e9659e364e1c6","entry":"SKConv","repo":"jdfxzzy/DPMN","repo_kind":"official","path":"model/pgrm.py","file_url":"https://github.com/jdfxzzy/DPMN/blob/HEAD/model/pgrm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da9e9659e364e1c6"}},{"code_sha256_prefix":"652d7deae22ba88d","entry":"WindowAttention","repo":"jdfxzzy/DPMN","repo_kind":"official","path":"model/pgrm.py","file_url":"https://github.com/jdfxzzy/DPMN/blob/HEAD/model/pgrm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"652d7deae22ba88d"}},{"code_sha256_prefix":"110b31464b7dac57","entry":"window_partition","repo":"jdfxzzy/DPMN","repo_kind":"official","path":"model/pgrm.py","file_url":"https://github.com/jdfxzzy/DPMN/blob/HEAD/model/pgrm.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"110b31464b7dac57"}},{"code_sha256_prefix":"fa89cab9061b79c3","entry":"BasicLayer","repo":"jdfxzzy/DPMN","repo_kind":"official","path":"model/pgrm.py","file_url":"https://github.com/jdfxzzy/DPMN/blob/HEAD/model/pgrm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fa89cab9061b79c3"}},{"code_sha256_prefix":"93f23445ecf137b8","entry":"PGRM","repo":"jdfxzzy/DPMN","repo_kind":"official","path":"model/pgrm.py","file_url":"https://github.com/jdfxzzy/DPMN/blob/HEAD/model/pgrm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"93f23445ecf137b8"}},{"code_sha256_prefix":"7eee4aeb9a526a72","entry":"SwinTransformerBlock","repo":"jdfxzzy/DPMN","repo_kind":"official","path":"model/pgrm.py","file_url":"https://github.com/jdfxzzy/DPMN/blob/HEAD/model/pgrm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7eee4aeb9a526a72"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}