{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/language2pose-natural-language-grounded-pose","title":"Language2Pose: Natural Language Grounded Pose Forecasting","arxiv_id":"1907.01108","date":"2019-07-02","proceeding":null,"authors":["Chaitanya Ahuja","Louis-Philippe Morency"],"abstract":"Generating animations from natural language sentences finds its applications in a a number of domains such as movie script visualization, virtual human animation and, robot motion planning. These sentences can describe different kinds of actions, speeds and direction of these actions, and possibly a target destination. The core modeling challenge in this language-to-pose application is how to map linguistic concepts to motion animations. In this paper, we address this multimodal problem by introducing a neural architecture called Joint Language to Pose (or JL2P), which learns a joint embedding of language and pose. This joint embedding space is learned end-to-end using a curriculum learning approach which emphasizes shorter and easier sequences first before moving to longer and harder ones. We evaluate our proposed model on a publicly available corpus of 3D pose data and human-annotated sentences. Both objective metrics and human judgment evaluation confirm that our proposed approach is able to generate more accurate animations and are deemed visually more representative by humans than other data driven approaches.","url_abs":"https://arxiv.org/abs/1907.01108v2","url_pdf":"https://arxiv.org/pdf/1907.01108v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"language2pose-natural-language-grounded-pose","repo_url":"https://github.com/chahuja/language2pose","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"language2pose-natural-language-grounded-pose","repo_url":"https://github.com/DataScienceNigeria/Joint-Language-to-Pose-JL2P-with-3D-pose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"human-animation","task_name":"Human Animation"},{"task_slug":"motion-planning","task_name":"Motion Planning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=1907.01108","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.01108"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/DataScienceNigeria/Joint-Language-to-Pose-JL2P-with-3D-pose","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chahuja/language2pose","reach":null}],"summary":{"ran_honours":1,"unverified":3},"by_repo_kind":{"official":{"samples":4,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"52d29a9bb0ddd3e3","entry":"get_mask_indices","repo":"chahuja/language2pose","repo_kind":"official","path":"src/sample_wordConditioned.py","file_url":"https://github.com/chahuja/language2pose/blob/HEAD/src/sample_wordConditioned.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"52d29a9bb0ddd3e3"}},{"code_sha256_prefix":"b2001a443e6846e2","entry":"local2global","repo":"chahuja/language2pose","repo_kind":"official","path":"src/sample_wordConditioned.py","file_url":"https://github.com/chahuja/language2pose/blob/HEAD/src/sample_wordConditioned.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b2001a443e6846e2"}},{"code_sha256_prefix":"d121ba09edc52d34","entry":"toEuler","repo":"chahuja/language2pose","repo_kind":"official","path":"src/sample_wordConditioned.py","file_url":"https://github.com/chahuja/language2pose/blob/HEAD/src/sample_wordConditioned.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d121ba09edc52d34"}},{"code_sha256_prefix":"bdffbd4b7a7df991","entry":"train","repo":"chahuja/language2pose","repo_kind":"official","path":"src/train_wordConditioned.py","file_url":"https://github.com/chahuja/language2pose/blob/HEAD/src/train_wordConditioned.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bdffbd4b7a7df991"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}