{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2509-05146","title":"PRIM: Towards Practical In-Image Multilingual Machine Translation","arxiv_id":"2509.05146","date":"2025-09-05","proceeding":"EMNLP","authors":["Yanzhi Tian","Zeming Liu","Zhengyang Liu","Chong Feng","Xin Li","Heyan Huang","Yuhang Guo"],"abstract":"In-Image Machine Translation (IIMT) aims to translate images containing texts from one language to another. Current research of end-to-end IIMT mainly conducts on synthetic data, with simple background, single font, fixed text position, and bilingual translation, which can not fully reflect real world, causing a significant gap between the research and practical conditions. To facilitate research of IIMT in real-world scenarios, we explore Practical In-Image Multilingual Machine Translation (IIMMT). In order to convince the lack of publicly available data, we annotate the PRIM dataset, which contains real-world captured one-line text images with complex background, various fonts, diverse text positions, and supports multilingual translation directions. We propose an end-to-end model VisTrans to handle the challenge of practical conditions in PRIM, which processes visual text and background information in the image separately, ensuring the capability of multilingual translation while improving the visual quality. Experimental results indicate the VisTrans achieves a better translation quality and visual effect compared to other models. The code and dataset are available at: https://github.com/BITHLP/PRIM.","url_abs":"https://arxiv.org/abs/2509.05146","url_pdf":"https://arxiv.org/pdf/2509.05146","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2509.05146","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2509.05146"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Unbabel/COMET","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/JaidedAI/EasyOCR","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/mjpost/sacrebleu","reach":{"status":"ok","spdx":"Apache-2.0"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/BITHLP/PRIM","reach":null}],"summary":{"ran":5},"by_repo_kind":{"found_in_text":{"samples":5,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1e1ca377fc4da0b8","entry":"Embedding","repo":"BITHLP/PRIM","repo_kind":"found_in_text","path":"vision/src/VisionModel.py","file_url":"https://github.com/BITHLP/PRIM/blob/HEAD/vision/src/VisionModel.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e1ca377fc4da0b8"}},{"code_sha256_prefix":"ba7c68ce38eef075","entry":"MultiTaskViT","repo":"BITHLP/PRIM","repo_kind":"found_in_text","path":"vision/src/VisionModel.py","file_url":"https://github.com/BITHLP/PRIM/blob/HEAD/vision/src/VisionModel.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ba7c68ce38eef075"}},{"code_sha256_prefix":"4a5a51d13defa82f","entry":"OutputLayer","repo":"BITHLP/PRIM","repo_kind":"found_in_text","path":"vision/src/VisionModel.py","file_url":"https://github.com/BITHLP/PRIM/blob/HEAD/vision/src/VisionModel.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4a5a51d13defa82f"}},{"code_sha256_prefix":"45f24e5f1f0d5eb3","entry":"TiMMViTEncoder","repo":"BITHLP/PRIM","repo_kind":"found_in_text","path":"vision/src/VisionModel.py","file_url":"https://github.com/BITHLP/PRIM/blob/HEAD/vision/src/VisionModel.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"45f24e5f1f0d5eb3"}},{"code_sha256_prefix":"2f63d81bd1cb35f6","entry":"TransformerDecoder","repo":"BITHLP/PRIM","repo_kind":"found_in_text","path":"vision/src/VisionModel.py","file_url":"https://github.com/BITHLP/PRIM/blob/HEAD/vision/src/VisionModel.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2f63d81bd1cb35f6"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_api"},"syntology_extracted_results":null}