{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/estimating-speech-from-lip-dynamics","title":"Estimating speech from lip dynamics","arxiv_id":"1708.01198","date":"2017-08-03","proceeding":null,"authors":["Jithin Donny George","Ronan Keane","Conor Zellmer"],"abstract":"The goal of this project is to develop a limited lip reading algorithm for a\nsubset of the English language. We consider a scenario in which no audio\ninformation is available. The raw video is processed and the position of the\nlips in each frame is extracted. We then prepare the lip data for processing\nand classify the lips into visemes and phonemes. Hidden Markov Models are used\nto predict the words the speaker is saying based on the sequences of classified\nphonemes and visemes. The GRID audiovisual sentence corpus [10][11] database is\nused for our study.","url_abs":"http://arxiv.org/abs/1708.01198v1","url_pdf":"http://arxiv.org/pdf/1708.01198v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"estimating-speech-from-lip-dynamics","repo_url":"https://github.com/Dirivian/dynamic_lips","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"lip-reading","task_name":"Lip Reading"},{"task_slug":null,"task_name":"Position"},{"task_slug":"sentence","task_name":"Sentence"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}