{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/entity-structure-within-and-throughout","title":"Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction","arxiv_id":"2102.10249","date":"2021-02-20","proceeding":null,"authors":["Benfeng Xu","Quan Wang","Yajuan Lyu","Yong Zhu","Zhendong Mao"],"abstract":"Entities, as the essential elements in relation extraction tasks, exhibit certain structure. In this work, we formulate such structure as distinctive dependencies between mention pairs. We then propose SSAN, which incorporates these structural dependencies within the standard self-attention mechanism and throughout the overall encoding stage. Specifically, we design two alternative transformation modules inside each self-attention building block to produce attentive biases so as to adaptively regularize its attention flow. Our experiments demonstrate the usefulness of the proposed entity structure and the effectiveness of SSAN. It significantly outperforms competitive baselines, achieving new state-of-the-art results on three popular document-level relation extraction datasets. We further provide ablation and visualization to show how the entity structure guides the model for better relation extraction. Our code is publicly available.","url_abs":"https://arxiv.org/abs/2102.10249v1","url_pdf":"https://arxiv.org/pdf/2102.10249v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"entity-structure-within-and-throughout","repo_url":"https://github.com/BenfengXu/SSAN","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"entity-structure-within-and-throughout","repo_url":"https://github.com/PaddlePaddle/Research","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"paddle","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"entity-structure-within-and-throughout","repo_url":"https://github.com/fduyjx/rsman","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"document-level-relation-extraction","task_name":"Document-level Relation Extraction"},{"task_slug":null,"task_name":"Relation"},{"task_slug":"relation-extraction","task_name":"Relation Extraction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/relation-extraction-on-cdr","task":"Relation Extraction","dataset":"CDR","model":"SSANBiaffine","rank_in_archive_order":7,"of":10,"metrics":{"F1":"68.7"},"uses_additional_data":false},{"leaderboard":"/sota/relation-extraction-on-docred","task":"Relation Extraction","dataset":"DocRED","model":"SSAN-RoBERTa-large+Adaptation","rank_in_archive_order":3,"of":62,"metrics":{"F1":"65.92","Ign F1":"63.78"},"uses_additional_data":false},{"leaderboard":"/sota/relation-extraction-on-docred","task":"Relation Extraction","dataset":"DocRED","model":"SSAN-RoBERTa-large","rank_in_archive_order":22,"of":62,"metrics":{"F1":"61.42","Ign F1":"59.47"},"uses_additional_data":false},{"leaderboard":"/sota/relation-extraction-on-docred","task":"Relation Extraction","dataset":"DocRED","model":"SSAN-RoBERTa-base","rank_in_archive_order":33,"of":62,"metrics":{"F1":"59.94","Ign F1":"57.71"},"uses_additional_data":false},{"leaderboard":"/sota/relation-extraction-on-docred","task":"Relation Extraction","dataset":"DocRED","model":"SSAN-BERT-base","rank_in_archive_order":44,"of":62,"metrics":{"F1":"58.16","Ign F1":"55.84"},"uses_additional_data":false},{"leaderboard":"/sota/relation-extraction-on-gda","task":"Relation Extraction","dataset":"GDA","model":"SSANBiaffine","rank_in_archive_order":8,"of":9,"metrics":{"F1":"83.9"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2102.10249","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}