{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/an-empirical-exploration-of-curriculum","title":"An Empirical Exploration of Curriculum Learning for Neural Machine Translation","arxiv_id":"1811.00739","date":"2018-11-02","proceeding":null,"authors":["Xuan Zhang","Gaurav Kumar","Huda Khayrallah","Kenton Murray","Jeremy Gwinnup","Marianna J. Martindale","Paul McNamee","Kevin Duh","Marine Carpuat"],"abstract":"Machine translation systems based on deep neural networks are expensive to\ntrain. Curriculum learning aims to address this issue by choosing the order in\nwhich samples are presented during training to help train better models faster.\nWe adopt a probabilistic view of curriculum learning, which lets us flexibly\nevaluate the impact of curricula design, and perform an extensive exploration\non a German-English translation task. Results show that it is possible to\nimprove convergence time at no loss in translation quality. However, results\nare highly sensitive to the choice of sample difficulty criteria, curriculum\nschedule and other hyperparameters.","url_abs":"http://arxiv.org/abs/1811.00739v1","url_pdf":"http://arxiv.org/pdf/1811.00739v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"an-empirical-exploration-of-curriculum","repo_url":"https://github.com/awslabs/sockeye","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"mxnet","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"machine-translation","task_name":"Machine Translation"},{"task_slug":"translation","task_name":"Translation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1811.00739","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}