{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/flowtok-flowing-seamlessly-across-text-and","title":"FlowTok: Flowing Seamlessly Across Text and Image Tokens","arxiv_id":"2503.10772","date":"2025-03-13","proceeding":null,"authors":["Ju He","Qihang Yu","Qihao Liu","Liang-Chieh Chen"],"abstract":"Bridging different modalities lies at the heart of cross-modality generation. While conventional approaches treat the text modality as a conditioning signal that gradually guides the denoising process from Gaussian noise to the target image modality, we explore a much simpler paradigm-directly evolving between text and image modalities through flow matching. This requires projecting both modalities into a shared latent space, which poses a significant challenge due to their inherently different representations: text is highly semantic and encoded as 1D tokens, whereas images are spatially redundant and represented as 2D latent embeddings. To address this, we introduce FlowTok, a minimal framework that seamlessly flows across text and images by encoding images into a compact 1D token representation. Compared to prior methods, this design reduces the latent space size by 3.3x at an image resolution of 256, eliminating the need for complex conditioning mechanisms or noise scheduling. Moreover, FlowTok naturally extends to image-to-text generation under the same formulation. With its streamlined architecture centered around compact 1D tokens, FlowTok is highly memory-efficient, requires significantly fewer training resources, and achieves much faster sampling speeds-all while delivering performance comparable to state-of-the-art models. Code will be available at https://github.com/bytedance/1d-tokenizer.","url_abs":"https://arxiv.org/abs/2503.10772v1","url_pdf":"https://arxiv.org/pdf/2503.10772v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"flowtok-flowing-seamlessly-across-text-and","repo_url":"https://github.com/bytedance/1d-tokenizer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"image-to-text","task_name":"Image to text"},{"task_slug":"scheduling","task_name":"Scheduling"},{"task_slug":"text-generation","task_name":"Text Generation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2503.10772","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.10772"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bytedance/1d-tokenizer","reach":null}],"summary":{"ran":6,"unverified":3},"by_repo_kind":{"official":{"samples":9,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9c740c7fb2d9eb1a","entry":"Conv2dSame","repo":"bytedance/1d-tokenizer","repo_kind":"official","path":"modeling/titok.py","file_url":"https://github.com/bytedance/1d-tokenizer/blob/HEAD/modeling/titok.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9c740c7fb2d9eb1a"}},{"code_sha256_prefix":"656f15a0445c5293","entry":"DiagonalGaussianDistribution","repo":"bytedance/1d-tokenizer","repo_kind":"official","path":"modeling/titok.py","file_url":"https://github.com/bytedance/1d-tokenizer/blob/HEAD/modeling/titok.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"656f15a0445c5293"}},{"code_sha256_prefix":"f9805e2cf90696a2","entry":"ResidualAttentionBlock","repo":"bytedance/1d-tokenizer","repo_kind":"official","path":"modeling/titok.py","file_url":"https://github.com/bytedance/1d-tokenizer/blob/HEAD/modeling/titok.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f9805e2cf90696a2"}},{"code_sha256_prefix":"34247def2368ea75","entry":"ResnetBlock","repo":"bytedance/1d-tokenizer","repo_kind":"official","path":"modeling/titok.py","file_url":"https://github.com/bytedance/1d-tokenizer/blob/HEAD/modeling/titok.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"34247def2368ea75"}},{"code_sha256_prefix":"b3a00367dff48d07","entry":"TiTokDecoder","repo":"bytedance/1d-tokenizer","repo_kind":"official","path":"modeling/titok.py","file_url":"https://github.com/bytedance/1d-tokenizer/blob/HEAD/modeling/titok.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b3a00367dff48d07"}},{"code_sha256_prefix":"c604f5049ddf0f34","entry":"VectorQuantizer","repo":"bytedance/1d-tokenizer","repo_kind":"official","path":"modeling/titok.py","file_url":"https://github.com/bytedance/1d-tokenizer/blob/HEAD/modeling/titok.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c604f5049ddf0f34"}},{"code_sha256_prefix":"2f5ef3dff7b3cad2","entry":"TiTok","repo":"bytedance/1d-tokenizer","repo_kind":"official","path":"modeling/titok.py","file_url":"https://github.com/bytedance/1d-tokenizer/blob/HEAD/modeling/titok.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2f5ef3dff7b3cad2"}},{"code_sha256_prefix":"f96834950f20c5e0","entry":"TiTokEncoder","repo":"bytedance/1d-tokenizer","repo_kind":"official","path":"modeling/titok.py","file_url":"https://github.com/bytedance/1d-tokenizer/blob/HEAD/modeling/titok.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f96834950f20c5e0"}},{"code_sha256_prefix":"66a99516de4e95bd","entry":"UpsamplingBlock","repo":"bytedance/1d-tokenizer","repo_kind":"official","path":"modeling/titok.py","file_url":"https://github.com/bytedance/1d-tokenizer/blob/HEAD/modeling/titok.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"66a99516de4e95bd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}