{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/may-the-force-be-with-your-copy-mechanism-1","title":"May the Force Be with Your Copy Mechanism: Enhanced Supervised-Copy Method for Natural Language Generation","arxiv_id":"2112.10360","date":"2021-12-20","proceeding":"arXiv 2021 12","authors":["Sanghyuk Choi","Jeong-in Hwang","Hyungjong Noh","Yeonsoo Lee"],"abstract":"Recent neural sequence-to-sequence models with a copy mechanism have achieved remarkable progress in various text generation tasks. These models addressed out-of-vocabulary problems and facilitated the generation of rare words. However, the identification of the word which needs to be copied is difficult, as observed by prior copy models, which suffer from incorrect generation and lacking abstractness. In this paper, we propose a novel supervised approach of a copy network that helps the model decide which words need to be copied and which need to be generated. Specifically, we re-define the objective function, which leverages source sequences and target vocabularies as guidance for copying. The experimental results on data-to-text generation and abstractive summarization tasks verify that our approach enhances the copying quality and improves the degree of abstractness.","url_abs":"https://arxiv.org/abs/2112.10360v1","url_pdf":"https://arxiv.org/pdf/2112.10360v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"abstractive-text-summarization","task_name":"Abstractive Text Summarization"},{"task_slug":"data-to-text-generation","task_name":"Data-to-Text Generation"},{"task_slug":"text-generation","task_name":"Text Generation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/data-to-text-generation-on-mlb-dataset-2","task":"Data-to-Text Generation","dataset":"MLB Dataset","model":"Force-Copy","rank_in_archive_order":4,"of":4,"metrics":{"BLEU":"10.5"},"uses_additional_data":false},{"leaderboard":"/sota/data-to-text-generation-on-mlb-dataset-3","task":"Data-to-Text Generation","dataset":"MLB Dataset (Content Ordering)","model":"Force-Copy","rank_in_archive_order":3,"of":4,"metrics":{"DLD":"21.16"},"uses_additional_data":false},{"leaderboard":"/sota/data-to-text-generation-on-mlb-dataset-1","task":"Data-to-Text Generation","dataset":"MLB Dataset (Content Selection)","model":"Force-Copy","rank_in_archive_order":1,"of":3,"metrics":{"Precision":"49.39","Recall":"50.89"},"uses_additional_data":false},{"leaderboard":"/sota/data-to-text-generation-on-mlb-dataset","task":"Data-to-Text Generation","dataset":"MLB Dataset (Relation Generation)","model":"Force-Copy","rank_in_archive_order":3,"of":4,"metrics":{"Precision":"84.50","count":"21.05"},"uses_additional_data":false},{"leaderboard":"/sota/data-to-text-generation-on-rotowire","task":"Data-to-Text Generation","dataset":"RotoWire","model":"Force-Copy","rank_in_archive_order":3,"of":6,"metrics":{"BLEU":"17.26"},"uses_additional_data":false},{"leaderboard":"/sota/data-to-text-generation-on-rotowire-content","task":"Data-to-Text Generation","dataset":"RotoWire (Content Ordering)","model":"Force-Copy","rank_in_archive_order":4,"of":5,"metrics":{"BLEU":"15.8","DLD":"17.26%"},"uses_additional_data":false},{"leaderboard":"/sota/data-to-text-generation-on-rotowire-relation","task":"Data-to-Text Generation","dataset":"RotoWire (Relation Generation)","model":"Force-Copy","rank_in_archive_order":3,"of":6,"metrics":{"Precision":"95.40%","count":"27.37"},"uses_additional_data":false},{"leaderboard":"/sota/data-to-text-generation-on-rotowire-content-1","task":"Data-to-Text Generation","dataset":"Rotowire (Content Selection)","model":"Force-Copy","rank_in_archive_order":2,"of":5,"metrics":{"Precision":"34.34%","Recall":"48.85%"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}