{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/text-segmentation-as-a-supervised-learning","title":"Text Segmentation as a Supervised Learning Task","arxiv_id":"1803.09337","date":"2018-03-25","proceeding":"NAACL 2018 6","authors":["Omri Koshorek","Adir Cohen","Noam Mor","Michael Rotman","Jonathan Berant"],"abstract":"Text segmentation, the task of dividing a document into contiguous segments\nbased on its semantic structure, is a longstanding challenge in language\nunderstanding. Previous work on text segmentation focused on unsupervised\nmethods such as clustering or graph search, due to the paucity in labeled data.\nIn this work, we formulate text segmentation as a supervised learning problem,\nand present a large new dataset for text segmentation that is automatically\nextracted and labeled from Wikipedia. Moreover, we develop a segmentation model\nbased on this dataset and show that it generalizes well to unseen natural text.","url_abs":"http://arxiv.org/abs/1803.09337v1","url_pdf":"http://arxiv.org/pdf/1803.09337v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"text-segmentation-as-a-supervised-learning","repo_url":"https://github.com/koomri/text-segmentation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"text-segmentation-as-a-supervised-learning","repo_url":"https://github.com/ocinemod87/text_segmentation","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}}],"tasks":[{"task_slug":"clustering","task_name":"Clustering"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"text-segmentation","task_name":"Text Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1803.09337","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}