Papers › A Hierarchical Framework for Relation Extraction with Reinforcement Learning

A Hierarchical Framework for Relation Extraction with Reinforcement Learning

9 Nov 2018arXiv:1811.03925archive 2025-07-28

Ryuichi Takanobu, Tianyang Zhang, Jiexi Liu, Minlie Huang

Most existing methods determine relation types only after all the entities have been recognized, thus the interaction between relation types and entity mentions is not fully modeled. This paper presents a novel paradigm to deal with relation extraction by regarding the related entities as the arguments of a relation. We apply a hierarchical reinforcement learning (HRL) framework in this paradigm to enhance the interaction between entity mentions and relation types. The whole extraction process is decomposed into a hierarchy of two-level RL policies for relation detection and entity extraction respectively, so that it is more feasible and natural to deal with overlapping relations. Our model was evaluated on public datasets collected via distant supervision, and results show that it gains better performance than existing methods and is more powerful for extracting overlapping relations.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

truthless11/HRL-RE officialmentioned in papermentioned on GitHubpytorch report
AndrewSukhobok95/DL_GraphEntity_project mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Entity Extraction using GANHierarchical Reinforcement LearningReinforcement LearningReinforcement Learning (RL)Relation Extractionreinforcement-learning

1 archive task tag without a task page not shown.

Datasets

Introduced by this paper, per the archive.

NYT11-HRL

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Relation Extraction NYT10-HRL HRL F1 64.4 #9 of 10 Archive leaderboard report
Relation Extraction NYT11-HRL HRL F1 53.8 #6 of 12 Archive leaderboard report
Relation Extraction NYT24 HRLRE F1 77.6 #2 of 2 Archive leaderboard report
Relation Extraction NYT29 HRLRE F1 64.3 #3 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections