{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/what-causes-the-failure-of-explicit-to","title":"What Causes the Failure of Explicit to Implicit Discourse Relation Recognition?","arxiv_id":"2404.00999","date":"2024-04-01","proceeding":null,"authors":["Wei Liu","Stephen Wan","Michael Strube"],"abstract":"We consider an unanswered question in the discourse processing community: why do relation classifiers trained on explicit examples (with connectives removed) perform poorly in real implicit scenarios? Prior work claimed this is due to linguistic dissimilarity between explicit and implicit examples but provided no empirical evidence. In this study, we show that one cause for such failure is a label shift after connectives are eliminated. Specifically, we find that the discourse relations expressed by some explicit instances will change when connectives disappear. Unlike previous work manually analyzing a few examples, we present empirical evidence at the corpus level to prove the existence of such shift. Then, we analyze why label shift occurs by considering factors such as the syntactic role played by connectives, ambiguity of connectives, and more. Finally, we investigate two strategies to mitigate the label shift: filtering out noisy data and joint learning with connectives. Experiments on PDTB 2.0, PDTB 3.0, and the GUM dataset demonstrate that classifiers trained with our strategies outperform strong baselines.","url_abs":"https://arxiv.org/abs/2404.00999v1","url_pdf":"https://arxiv.org/pdf/2404.00999v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"what-causes-the-failure-of-explicit-to","repo_url":"https://github.com/liuwei1206/exp2imp","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":null,"task_name":"Relation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2404.00999","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.00999"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/liuwei1206/Exp2Imp","reach":{"status":"ok"}}],"summary":{"ran":5,"unverified":2},"by_repo_kind":{"official":{"samples":7,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"e165370719144ab3","entry":"cal_acc_f1_score_with_ids","repo":"liuwei1206/Exp2Imp","repo_kind":"official","path":"utils.py","file_url":"https://github.com/liuwei1206/Exp2Imp/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e165370719144ab3"}},{"code_sha256_prefix":"15e549d812c2455d","entry":"get_dataloader","repo":"liuwei1206/Exp2Imp","repo_kind":"official","path":"analyze.py","file_url":"https://github.com/liuwei1206/Exp2Imp/blob/HEAD/analyze.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"15e549d812c2455d"}},{"code_sha256_prefix":"ac6f1bdb205bbdd6","entry":"get_dataloader","repo":"liuwei1206/Exp2Imp","repo_kind":"official","path":"joint.py","file_url":"https://github.com/liuwei1206/Exp2Imp/blob/HEAD/joint.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ac6f1bdb205bbdd6"}},{"code_sha256_prefix":"f42b590889dd1e89","entry":"labels_from_file","repo":"liuwei1206/Exp2Imp","repo_kind":"official","path":"utils.py","file_url":"https://github.com/liuwei1206/Exp2Imp/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f42b590889dd1e89"}},{"code_sha256_prefix":"771b9922a089830b","entry":"read_npz","repo":"liuwei1206/Exp2Imp","repo_kind":"official","path":"filter_util.py","file_url":"https://github.com/liuwei1206/Exp2Imp/blob/HEAD/filter_util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"771b9922a089830b"}},{"code_sha256_prefix":"a4d7e28a893e28ca","entry":"cal_acc_f1_score_per_label","repo":"liuwei1206/Exp2Imp","repo_kind":"official","path":"utils.py","file_url":"https://github.com/liuwei1206/Exp2Imp/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a4d7e28a893e28ca"}},{"code_sha256_prefix":"e7755e953453ff29","entry":"read_txt","repo":"liuwei1206/Exp2Imp","repo_kind":"official","path":"filter_util.py","file_url":"https://github.com/liuwei1206/Exp2Imp/blob/HEAD/filter_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e7755e953453ff29"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}