{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/seedream-2-0-a-native-chinese-english","title":"Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Model","arxiv_id":"2503.07703","date":"2025-03-10","proceeding":null,"authors":["Lixue Gong","Xiaoxia Hou","Fanshi Li","Liang Li","Xiaochen Lian","Fei Liu","Liyang Liu","Wei Liu","Wei Lu","Yichun Shi","Shiqi Sun","Yu Tian","Zhi Tian","Peng Wang","Xun Wang","Ye Wang","Guofeng Wu","Jie Wu","Xin Xia","Xuefeng Xiao","Linjie Yang","Zhonghua Zhai","Xinyu Zhang","Qi Zhang","Yuwei Zhang","Shijia Zhao","Jianchao Yang","Weilin Huang"],"abstract":"Rapid advancement of diffusion models has catalyzed remarkable progress in the field of image generation. However, prevalent models such as Flux, SD3.5 and Midjourney, still grapple with issues like model bias, limited text rendering capabilities, and insufficient understanding of Chinese cultural nuances. To address these limitations, we present Seedream 2.0, a native Chinese-English bilingual image generation foundation model that excels across diverse dimensions, which adeptly manages text prompt in both Chinese and English, supporting bilingual image generation and text rendering. We develop a powerful data system that facilitates knowledge integration, and a caption system that balances the accuracy and richness for image description. Particularly, Seedream is integrated with a self-developed bilingual large language model as a text encoder, allowing it to learn native knowledge directly from massive data. This enable it to generate high-fidelity images with accurate cultural nuances and aesthetic expressions described in either Chinese or English. Beside, Glyph-Aligned ByT5 is applied for flexible character-level text rendering, while a Scaled ROPE generalizes well to untrained resolutions. Multi-phase post-training optimizations, including SFT and RLHF iterations, further improve the overall capability. Through extensive experimentation, we demonstrate that Seedream 2.0 achieves state-of-the-art performance across multiple aspects, including prompt-following, aesthetics, text rendering, and structural correctness. Furthermore, Seedream 2.0 has been optimized through multiple RLHF iterations to closely align its output with human preferences, as revealed by its outstanding ELO score. In addition, it can be readily adapted to an instruction-based image editing model, such as SeedEdit, with strong editing capability that balances instruction-following and image consistency.","url_abs":"https://arxiv.org/abs/2503.07703v1","url_pdf":"https://arxiv.org/pdf/2503.07703v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"seedream-2-0-a-native-chinese-english","repo_url":"https://github.com/DYEvaLab/EvalMuse","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":null,"task_name":"Image Description"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"instruction-following","task_name":"Instruction Following"},{"task_slug":"large-language-model","task_name":"Large Language Model"}],"methods":[{"method_slug":"align","method_name":"ALIGN"},{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"sft","method_name":"SFT"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2503.07703","atlas_url":"https://app.syntology.ai/?focus=2503.07703","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.07703"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/DYEvaLab/EvalMuse","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":9,"ran_draft_wrong":2,"unverified":2},"by_repo_kind":{"listed":{"samples":13,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c398976e864ca923","entry":"compute_metrics","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"NTIRE2025/Track1_Alignment/evaluate.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/NTIRE2025/Track1_Alignment/evaluate.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c398976e864ca923"}},{"code_sha256_prefix":"3ce6f2c660bdd4d5","entry":"find_connected_components","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"NTIRE2025/Track2_Structure/evaluate.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/NTIRE2025/Track2_Structure/evaluate.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3ce6f2c660bdd4d5"}},{"code_sha256_prefix":"157d2a06ef6e5db1","entry":"get_plcc_srcc","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"NTIRE2025/Track2_Structure/evaluate.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/NTIRE2025/Track2_Structure/evaluate.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"157d2a06ef6e5db1"}},{"code_sha256_prefix":"c6ec173f19f5c34d","entry":"interpolate_pos_embed","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"lavis/models/vit.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/lavis/models/vit.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c6ec173f19f5c34d"}},{"code_sha256_prefix":"39c7582f0f751221","entry":"is_sublist","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"process/element2mask.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/process/element2mask.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"39c7582f0f751221"}},{"code_sha256_prefix":"7a749446072d47a6","entry":"load_csv_as_dict_list","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7a749446072d47a6"}},{"code_sha256_prefix":"43ad22367a932664","entry":"load_data","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"43ad22367a932664"}},{"code_sha256_prefix":"7c83ce9ecb81c347","entry":"load_json_as_dict_list","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7c83ce9ecb81c347"}},{"code_sha256_prefix":"eecc2b52c51e67dc","entry":"logistic_func","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"NTIRE2025/Track1_Alignment/evaluate.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/NTIRE2025/Track1_Alignment/evaluate.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"eecc2b52c51e67dc"}},{"code_sha256_prefix":"791c72070c0b1cfb","entry":"node_to_dict","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"lavis/common/config.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/lavis/common/config.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"791c72070c0b1cfb"}},{"code_sha256_prefix":"cb33571427334815","entry":"tile","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"lavis/models/base_model.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/lavis/models/base_model.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cb33571427334815"}},{"code_sha256_prefix":"0ec9fc2025c16f65","entry":"all_gather_with_grad","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"lavis/models/base_model.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/lavis/models/base_model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0ec9fc2025c16f65"}},{"code_sha256_prefix":"a33274f4811ba44b","entry":"calculate_score","repo":"DYEvaLab/EvalMuse","repo_kind":"listed","path":"NTIRE2025/Track1_Alignment/evaluate.py","file_url":"https://github.com/DYEvaLab/EvalMuse/blob/HEAD/NTIRE2025/Track1_Alignment/evaluate.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a33274f4811ba44b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}