{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/wisebe-window-based-sentence-boundary","title":"WiSeBE: Window-based Sentence Boundary Evaluation","arxiv_id":"1808.08850","date":"2018-08-27","proceeding":null,"authors":["Carlos-Emiliano González-Gallardo","Juan-Manuel Torres-Moreno"],"abstract":"Sentence Boundary Detection (SBD) has been a major research topic since\nAutomatic Speech Recognition transcripts have been used for further Natural\nLanguage Processing tasks like Part of Speech Tagging, Question Answering or\nAutomatic Summarization. But what about evaluation? Do standard evaluation\nmetrics like precision, recall, F-score or classification error; and more\nimportant, evaluating an automatic system against a unique reference is enough\nto conclude how well a SBD system is performing given the final application of\nthe transcript? In this paper we propose Window-based Sentence Boundary\nEvaluation (WiSeBE), a semi-supervised metric for evaluating Sentence Boundary\nDetection systems based on multi-reference (dis)agreement. We evaluate and\ncompare the performance of different SBD systems over a set of Youtube\ntranscripts using WiSeBE and standard metrics. This double evaluation gives an\nunderstanding of how WiSeBE is a more reliable metric for the SBD task.","url_abs":"http://arxiv.org/abs/1808.08850v1","url_pdf":"http://arxiv.org/pdf/1808.08850v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"wisebe-window-based-sentence-boundary","repo_url":"https://github.com/cic4k/wisebe","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"automatic-speech-recognition-2","task_name":"Automatic Speech Recognition"},{"task_slug":"automatic-speech-recognition","task_name":"Automatic Speech Recognition (ASR)"},{"task_slug":"boundary-detection","task_name":"Boundary Detection"},{"task_slug":"part-of-speech-tagging","task_name":"Part-Of-Speech Tagging"},{"task_slug":"question-answering","task_name":"Question Answering"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"speech-recognition","task_name":"Speech Recognition"},{"task_slug":"speech-recognition-1","task_name":"speech-recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}