{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sync-draw-automatic-video-generation-using","title":"Sync-DRAW: Automatic Video Generation using Deep Recurrent Attentive Architectures","arxiv_id":"1611.10314","date":"2016-11-30","proceeding":null,"authors":["Gaurav Mittal","Tanya Marwah","Vineeth N. Balasubramanian"],"abstract":"This paper introduces a novel approach for generating videos called\nSynchronized Deep Recurrent Attentive Writer (Sync-DRAW). Sync-DRAW can also\nperform text-to-video generation which, to the best of our knowledge, makes it\nthe first approach of its kind. It combines a Variational Autoencoder~(VAE)\nwith a Recurrent Attention Mechanism in a novel manner to create a temporally\ndependent sequence of frames that are gradually formed over time. The recurrent\nattention mechanism in Sync-DRAW attends to each individual frame of the video\nin sychronization, while the VAE learns a latent distribution for the entire\nvideo at the global level. Our experiments with Bouncing MNIST, KTH and UCF-101\nsuggest that Sync-DRAW is efficient in learning the spatial and temporal\ninformation of the videos and generates frames with high structural integrity,\nand can generate videos from simple captions on these datasets. (Accepted as\noral paper in ACM-Multimedia 2017)","url_abs":"http://arxiv.org/abs/1611.10314v4","url_pdf":"http://arxiv.org/pdf/1611.10314v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sync-draw-automatic-video-generation-using","repo_url":"https://github.com/Singularity42/Sync-DRAW","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null}],"tasks":[{"task_slug":"text-to-video-generation","task_name":"Text-to-Video Generation"},{"task_slug":"video-generation","task_name":"Video Generation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1611.10314","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}