{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-automatic-boundary-detection-for","title":"Towards Automatic Boundary Detection for Human-AI Collaborative Hybrid Essay in Education","arxiv_id":"2307.12267","date":"2023-07-23","proceeding":null,"authors":["Zijie Zeng","Lele Sha","Yuheng Li","Kaixun Yang","Dragan Gašević","Guanliang Chen"],"abstract":"The recent large language models (LLMs), e.g., ChatGPT, have been able to generate human-like and fluent responses when provided with specific instructions. While admitting the convenience brought by technological advancement, educators also have concerns that students might leverage LLMs to complete their writing assignments and pass them off as their original work. Although many AI content detection studies have been conducted as a result of such concerns, most of these prior studies modeled AI content detection as a classification problem, assuming that a text is either entirely human-written or entirely AI-generated. In this study, we investigated AI content detection in a rarely explored yet realistic setting where the text to be detected is collaboratively written by human and generative LLMs (i.e., hybrid text). We first formalized the detection task as identifying the transition points between human-written content and AI-generated content from a given hybrid text (boundary detection). Then we proposed a two-step approach where we (1) separated AI-generated content from human-written content during the encoder training process; and (2) calculated the distances between every two adjacent prototypes and assumed that the boundaries exist between the two adjacent prototypes that have the furthest distance from each other. Through extensive experiments, we observed the following main findings: (1) the proposed approach consistently outperformed the baseline methods across different experiment settings; (2) the encoder training process can significantly boost the performance of the proposed approach; (3) when detecting boundaries for single-boundary hybrid essays, the proposed approach could be enhanced by adopting a relatively large prototype size, leading to a 22% improvement in the In-Domain evaluation and an 18% improvement in the Out-of-Domain evaluation.","url_abs":"https://arxiv.org/abs/2307.12267v6","url_pdf":"https://arxiv.org/pdf/2307.12267v6.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"towards-automatic-boundary-detection-for","repo_url":"https://github.com/douglashiwo/boundarydetection","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"towards-automatic-boundary-detection-for","repo_url":"https://github.com/douglashiwo/BoundaryDetectionFromHybridText","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"boundary-detection","task_name":"Boundary Detection"},{"task_slug":"text-detection","task_name":"Text Detection"}],"methods":[],"datasets_introduced":[{"slug":"tribert","name":"TriBERT","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/boundary-detection-on-tribert-in-domain","task":"Boundary Detection","dataset":"TriBERT (in-domain)","model":"TriBERT (p=2)","rank_in_archive_order":2,"of":2,"metrics":{"F1@3":"0.575"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.12267","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.12267"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/douglashiwo/BoundaryDetectionFromHybridText","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/douglashiwo/boundarydetection","reach":null}],"summary":{"ran_fixture":1,"unverified":1},"by_repo_kind":{"official":{"samples":2,"ran":1,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"c7e2675ab206dd18","entry":"get_euclidean_distance","repo":"douglashiwo/boundarydetection","repo_kind":"official","path":"Codes_and_DataForBoundaryDetectionProject/TriBERT-In_Domain_Evaluation/code.py","file_url":"https://github.com/douglashiwo/boundarydetection/blob/HEAD/Codes_and_DataForBoundaryDetectionProject/TriBERT-In_Domain_Evaluation/code.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c7e2675ab206dd18"}},{"code_sha256_prefix":"df25f4bb741d268c","entry":"get_sentence","repo":"douglashiwo/BoundaryDetectionFromHybridText","repo_kind":"official","path":"Codes_and_DataForBoundaryDetectionProject/TriBERT-In_Domain_Evaluation/code.py","file_url":"https://github.com/douglashiwo/BoundaryDetectionFromHybridText/blob/HEAD/Codes_and_DataForBoundaryDetectionProject/TriBERT-In_Domain_Evaluation/code.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"df25f4bb741d268c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}