{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/split-and-rephrase-better-evaluation-and-a","title":"Split and Rephrase: Better Evaluation and a Stronger Baseline","arxiv_id":"1805.01035","date":"2018-05-02","proceeding":null,"authors":["Roee Aharoni","Yoav Goldberg"],"abstract":"Splitting and rephrasing a complex sentence into several shorter sentences\nthat convey the same meaning is a challenging problem in NLP. We show that\nwhile vanilla seq2seq models can reach high scores on the proposed benchmark\n(Narayan et al., 2017), they suffer from memorization of the training set which\ncontains more than 89% of the unique simple sentences from the validation and\ntest sets. To aid this, we present a new train-development-test data split and\nneural models augmented with a copy-mechanism, outperforming the best reported\nbaseline by 8.68 BLEU and fostering further progress on the task.","url_abs":"http://arxiv.org/abs/1805.01035v1","url_pdf":"http://arxiv.org/pdf/1805.01035v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"split-and-rephrase-better-evaluation-and-a","repo_url":"https://github.com/biu-nlp/sprp-acl2018","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"split-and-rephrase-better-evaluation-and-a","repo_url":"https://github.com/roeeaharoni/sprp-acl2018","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"memorization","task_name":"Memorization"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"split-and-rephrase","task_name":"Split and Rephrase"}],"methods":[{"method_slug":"lstm","method_name":"LSTM"},{"method_slug":"seq2seq","method_name":"Seq2Seq"},{"method_slug":"sigmoid-activation","method_name":"Sigmoid Activation"},{"method_slug":"tanh-activation","method_name":"Tanh Activation"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=1805.01035","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}