Browse State-of-the-Art › Semantic Role Labeling

Semantic Role Labeling

138 papers with code · 7 benchmarks · 14 datasets archive 2025-07-28

Natural Language Processing

Semantic role labeling aims to model the predicate-argument structure of a sentence and is often described as answering "Who did what to whom". BIO notation is typically used for semantic role labeling.

Example:

Housing starts are expected to quicken a bit from August’s pace
B-ARG1 I-ARG1 O O O V B-ARG2 I-ARG2 B-ARG3 I-ARG3 I-ARG3

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

7 leaderboard tables shown for this task, 7 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

DatasetBest model (first row in archive order)PaperCodeSyntologyCompare
OntoNotes (17 rows) HeSyFu Better Combine Them Together! Integrating Syntactic Constituency... code — Compare
CoNLL 2005 (15 rows) MRC-SRL An MRC Framework for Semantic Role Labeling code — Compare
CoNLL05 Brown (2 rows) DeepStruct multi-task w/ finetune DeepStruct: Pretraining of Language Models for Structure Prediction code Syntology ran 7 of 13 samples · 6 unverified Compare
CoNLL05 WSJ (2 rows) DeepStruct multi-task DeepStruct: Pretraining of Language Models for Structure Prediction code Syntology ran 7 of 13 samples · 6 unverified Compare
CoNLL12 (2 rows) DeepStruct multi-task DeepStruct: Pretraining of Language Models for Structure Prediction code Syntology ran 7 of 13 samples · 6 unverified Compare
CoNLL-2009 (1 row) Ours (High-Order model) End-to-end Semantic Role Labeling with Neural Transition-based Model code — Compare
CoNLL 2012 (1 row) HeSyFu Better Combine Them Together! Integrating Syntactic Constituency... code — Compare

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

14 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

3 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 138 papers with code (620 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

Syntology lines on 10 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections