{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/lingvo-a-modular-and-scalable-framework-for","title":"Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling","arxiv_id":"1902.08295","date":"2019-02-21","proceeding":null,"authors":["Jonathan Shen","Patrick Nguyen","Yonghui Wu","Zhifeng Chen","Mia X. Chen","Ye Jia","Anjuli Kannan","Tara Sainath","Yuan Cao","Chung-Cheng Chiu","Yanzhang He","Jan Chorowski","Smit Hinsu","Stella Laurenzo","James Qin","Orhan Firat","Wolfgang Macherey","Suyog Gupta","Ankur Bapna","Shuyuan Zhang","Ruoming Pang","Ron J. Weiss","Rohit Prabhavalkar","Qiao Liang","Benoit Jacob","Bowen Liang","HyoukJoong Lee","Ciprian Chelba","Sébastien Jean","Bo Li","Melvin Johnson","Rohan Anil","Rajat Tibrewal","Xiaobing Liu","Akiko Eriguchi","Navdeep Jaitly","Naveen Ari","Colin Cherry","Parisa Haghani","Otavio Good","Youlong Cheng","Raziel Alvarez","Isaac Caswell","Wei-Ning Hsu","Zongheng Yang","Kuan-Chieh Wang","Ekaterina Gonina","Katrin Tomanek","Ben Vanik","Zelin Wu","Llion Jones","Mike Schuster","Yanping Huang","Dehao Chen","Kazuki Irie","George Foster","John Richardson","Klaus Macherey","Antoine Bruguier","Heiga Zen","Colin Raffel","Shankar Kumar","Kanishka Rao","David Rybach","Matthew Murray","Vijayaditya Peddinti","Maxim Krikun","Michiel A. U. Bacchiani","Thomas B. Jablin","Rob Suderman","Ian Williams","Benjamin Lee","Deepti Bhatia","Justin Carlson","Semih Yavuz","Yu Zhang","Ian McGraw","Max Galkin","Qi Ge","Golan Pundak","Chad Whipkey","Todd Wang","Uri Alon","Dmitry Lepikhin","Ye Tian","Sara Sabour","William Chan","Shubham Toshniwal","Baohua Liao","Michael Nirschl","Pat Rondon"],"abstract":"Lingvo is a Tensorflow framework offering a complete solution for\ncollaborative deep learning research, with a particular focus towards\nsequence-to-sequence models. Lingvo models are composed of modular building\nblocks that are flexible and easily extensible, and experiment configurations\nare centralized and highly customizable. Distributed training and quantized\ninference are supported directly within the framework, and it contains existing\nimplementations of a large number of utilities, helper functions, and the\nnewest research ideas. Lingvo has been used in collaboration by dozens of\nresearchers in more than 20 papers over the last two years. This document\noutlines the underlying design of Lingvo and serves as an introduction to the\nvarious pieces of the framework, while also offering examples of advanced\nfeatures that showcase the capabilities of the framework.","url_abs":"http://arxiv.org/abs/1902.08295v1","url_pdf":"http://arxiv.org/pdf/1902.08295v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"lingvo-a-modular-and-scalable-framework-for","repo_url":"https://github.com/tensorflow/lingvo","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"lingvo-a-modular-and-scalable-framework-for","repo_url":"https://github.com/galv/lingvo-copy","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"sequence-to-sequence-speech-recognition","task_name":"Sequence-To-Sequence Speech Recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=1902.08295","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1902.08295"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tensorflow/lingvo","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/galv/lingvo-copy","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":4},"by_repo_kind":{"listed":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"14ceabc12ad0d7fc","entry":"ImportAllParams","repo":"galv/lingvo-copy","repo_kind":"listed","path":"lingvo/model_imports.py","file_url":"https://github.com/galv/lingvo-copy/blob/HEAD/lingvo/model_imports.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"14ceabc12ad0d7fc"}},{"code_sha256_prefix":"b02dcb7f52e60c9c","entry":"ImportParams","repo":"galv/lingvo-copy","repo_kind":"listed","path":"lingvo/model_imports.py","file_url":"https://github.com/galv/lingvo-copy/blob/HEAD/lingvo/model_imports.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b02dcb7f52e60c9c"}},{"code_sha256_prefix":"52179ea095ddaa8d","entry":"stateless_cache_dataset","repo":"galv/lingvo-copy","repo_kind":"listed","path":"lingvo/compat.py","file_url":"https://github.com/galv/lingvo-copy/blob/HEAD/lingvo/compat.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"52179ea095ddaa8d"}},{"code_sha256_prefix":"c5f452e6210da1d9","entry":"stateless_shuffle_dataset","repo":"galv/lingvo-copy","repo_kind":"listed","path":"lingvo/compat.py","file_url":"https://github.com/galv/lingvo-copy/blob/HEAD/lingvo/compat.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":false,"mcp_get_code":{"code_sha256":"c5f452e6210da1d9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}