Papers › A Unified Positive-Unlabeled Learning Framework for Document-Level Relation Extraction...
A Unified Positive-Unlabeled Learning Framework for Document-Level Relation Extraction with Different Levels of Labeling
Ye Wang, Xinxin Liu, Wenxin Hu, Tao Zhang
Document-level relation extraction (RE) aims to identify relations between entities across multiple sentences. Most previous methods focused on document-level RE under full supervision. However, in real-world scenario, it is expensive and difficult to completely label all relations in a document because the number of entity pairs in document-level RE grows quadratically with the number of entities. To solve the common incomplete labeling problem, we propose a unified positive-unlabeled learning framework - shift and squared ranking loss positive-unlabeled (SSR-PU) learning. We use positive-unlabeled (PU) learning on document-level RE for the first time. Considering that labeled data of a dataset may lead to prior shift of unlabeled data, we introduce a PU learning under prior shift of training data. Also, using none-class score as an adaptive threshold, we propose squared ranking loss and prove its Bayesian consistency with multi-label ranking metrics. Extensive experiments demonstrate that our method achieves an improvement of about 14 F1 points relative to the previous baseline with incomplete labeling. In addition, it outperforms previous state-of-the-art results under both fully supervised and extremely unlabeled settings as well.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Document-level RE with incomplete labeling | ChemDisGene | SSR-PU | F1 | 48.56 | #2 of 3 | Archive leaderboard | report |
| Document-level RE with incomplete labeling | ChemDisGene | ATLOP | F1 | 42.73 | #3 of 3 | Archive leaderboard | report |
| Document-level RE with incomplete labeling | Re-DocRED | SSR-PU | F1 | 59.50 | #1 of 2 | Archive leaderboard | report |
| Document-level RE with incomplete labeling | Re-DocRED | SSR-PU | Ign F1 | 58.68 | #1 of 2 | Archive leaderboard | report |
| Document-level RE with incomplete labeling | Re-DocRED | ATLOP | F1 | 45.19 | #2 of 2 | Archive leaderboard | report |
| Document-level RE with incomplete labeling | Re-DocRED | ATLOP | Ign F1 | 45.09 | #2 of 2 | Archive leaderboard | report |
| Relation Extraction | ReDocRED | SSR-PU | F1 | 78.86 | #4 of 8 | Archive leaderboard | report |
| Relation Extraction | ReDocRED | SSR-PU | Ign F1 | 77.67 | #4 of 8 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections