Browse State-of-the-Art › Semantic Role Labeling
Semantic Role Labeling
138 papers with code · 7 benchmarks · 14 datasets archive 2025-07-28
Semantic role labeling aims to model the predicate-argument structure of a sentence and is often described as answering "Who did what to whom". BIO notation is typically used for semantic role labeling.
Example:
| Housing | starts | are | expected | to | quicken | a | bit | from | August’s | pace |
|---|---|---|---|---|---|---|---|---|---|---|
| B-ARG1 | I-ARG1 | O | O | O | V | B-ARG2 | I-ARG2 | B-ARG3 | I-ARG3 | I-ARG3 |
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
7 leaderboard tables shown for this task, 7 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
14 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
3 subtasks in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 620 · with a code link: 138 · where Syntology ran a sample: 19 (16 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (19 of 620 tagged: 16 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)
Page 1 of 7: papers 1 to 100 of 620, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
15 Feb 2018 46 repositories listed Syntology 30 ran (of which 12 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 0 violated, 22 with no contract checked; 6 where Syntology's instrument failed) · 28 unverified (of 58 harvested samples) · 25 pointer-only (licence)We introduce a new type of deep contextualized word representation that models both (1) complex characteristics of word use (e. g., syntax and semantics), and (2) how these uses vary across linguistic contexts (i. e.…
-
20 Jun 2018 6 repositories listed Syntology official (archive's flag): 9 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 13 harvested samples) · 4 pointer-only (licence)Though designed for decaNLP, MQAN also achieves state of the art results on the WikiSQL semantic parsing task in the single-task setting.
-
22 Aug 2016 4 repositories listed Syntology official (archive's flag): 3 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 3 pointer-only (licence)We describe a transition-based parser for AMR that parses sentences left-to-right, in linear time.
-
10 Nov 2019 3 repositories listedNatural language processing covers a wide variety of tasks predicting syntax, semantics, and information content, and usually each type of output is generated with specially designed architectures.
-
10 Apr 2019 3 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)We present simple BERT-based models for relation extraction and semantic role labeling.
-
22 Mar 2019 3 repositories listedWe present a reusable methodology for creation and evaluation of such tests in a multilingual setting.
-
14 May 2018 3 repositories listedWe present a new large-scale corpus of Question-Answer driven Semantic Role Labeling (QA-SRL) annotations, and the first high-quality QA-SRL parser.
-
29 Jul 2017 3 repositories listedLanguage is increasingly being used to define rich visual recognition problems with supporting image collections sourced from the web.
-
18 Sep 2023 2 repositories listedThe growing body of political texts opens up new opportunities for rich insights into political dynamics and ideologies but also increases the workload for manual analysis.
-
1 Dec 2022 2 repositories listedHere, we introduce a novel task - EXCLAIM, generating explanations for visual semantic role labeling in memes.
-
19 Apr 2022 2 repositories listedAs Abstract Meaning Representation (AMR) implicitly involves compound semantic annotations, we hypothesize auxiliary tasks which are semantically or formally related can better enhance AMR parsing.
-
14 Jan 2021 2 repositories listedWe propose a new framework, Translation between Augmented Natural Languages (TANL), to solve many structured prediction language tasks including joint entity and relation extraction, nested named entity recognition…
-
19 Dec 2019 2 repositories listed Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)The transformer-based pre-trained language model BERT has helped to improve state-of-the-art performance on many natural language processing (NLP) tasks.
-
29 Jan 2019 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 1 pointer-only (licence)However, due to the lack of rich pictographic evidence in glyphs and the weak generalization ability of standard computer vision models on character data, an effective way to utilize the glyph information remains to be…
-
4 Oct 2018 2 repositories listedWe present a simple and accurate span-based model for semantic role labeling (SRL).
-
20 Mar 2018 2 repositories listedThis paper describes AllenNLP, a platform for research on deep learning methods in natural language understanding.
-
14 Mar 2017 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)GCNs over syntactic dependency trees are used as sentence encoders, producing latent feature representations of words in a sentence.
-
10 Jan 2017 2 repositories listedHowever, when automatically predicted part-of-speech tags are provided as input, it substantially outperforms all previous local models and approaches the best reported results on the English CoNLL-2009 dataset.
-
1 Jun 2016 2 repositories listed
-
17 May 2015 2 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)In this paper we introduce the problem of Visual Semantic Role Labeling: given an image we want to detect people doing actions and localize the objects of interaction.
-
2 Mar 2011 2 repositories listedWe propose a unified neural network architecture and learning algorithm that can be applied to various natural language processing tasks including: part-of-speech tagging, chunking, named entity recognition, and…
-
9 Feb 2025 1 repository listedSemantic role labeling (SRL) is a central natural language processing (NLP) task aiming to understand the semantic roles within texts, facilitating a wide range of downstream applications.
-
10 Oct 2024 1 repository listedWe introduce a neural architecture finetuned for the task of scenario context generation: The relevant location and time of an event or entity mentioned in text.
-
30 Jul 2024 1 repository listedWe also propose a verb-wise role prediction model with near-perfect accuracy to create an end-to-end framework for producing situational summaries for out-of-domain images.
-
7 Jun 2024 1 repository listedDespite the remarkable generative capabilities of language models in producing naturalistic language, their effectiveness on explicit manipulation and generation of linguistic structures remain understudied.
-
7 Nov 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 3 pointer-only (licence)Unfortunately, this requires formatting them into specialized augmented format unknown to the base pretrained language model (PLMs) necessitating finetuning to the target format.
-
31 Oct 2023 1 repository listedThis paper presents a deep learning based approach to extract product comparison information out of user reviews on various e-commerce websites.
-
28 Sep 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)More interestingly, the hierarchical structures induced by ReCAT exhibit strong consistency with human-annotated syntactic trees, indicating good interpretability brought by the CIO layers.
-
27 Jul 2023 1 repository listedWe propose a novel end-to-end Semantic Role Labeling model that effectively captures most of the structured semantic information within the Transformer hidden state.
-
17 Jul 2023 1 repository listedNarrative is a foundation of human cognition and decision making.
-
29 May 2023 1 repository listed
-
24 May 2023 1 repository listed
-
23 May 2023 1 repository listed
-
22 May 2023 1 repository listed
-
23 Feb 2023 1 repository listed
-
14 Feb 2023 1 repository listed
-
5 Dec 2022 1 repository listed
-
2 Dec 2022 1 repository listed
-
25 Oct 2022 1 repository listed
-
12 Oct 2022 1 repository listed
-
1 Jul 2022 1 repository listed
-
14 Jun 2022 1 repository listed
-
1 Jun 2022 1 repository listed
-
1 Jun 2022 1 repository listed
-
25 May 2022 1 repository listed
-
21 May 2022 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 1 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 3 pointer-only (licence)
-
20 May 2022 1 repository listed
-
13 May 2022 1 repository listed
-
8 May 2022 1 repository listed
-
1 May 2022 1 repository listed
-
1 May 2022 1 repository listed
-
1 May 2022 1 repository listed
-
11 Apr 2022 1 repository listed
-
6 Dec 2021 1 repository listed
-
1 Nov 2021 1 repository listed
-
1 Nov 2021 1 repository listed
-
13 Oct 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
28 Sep 2021 1 repository listed
-
25 Sep 2021 1 repository listed
-
23 Sep 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)
-
23 Sep 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
16 Sep 2021 1 repository listed
-
14 Sep 2021 1 repository listed
-
8 Sep 2021 1 repository listed
-
1 Aug 2021 1 repository listed
-
1 Aug 2021 1 repository listed
-
14 Jun 2021 1 repository listed
-
1 Jun 2021 1 repository listed
-
1 Jun 2021 1 repository listed
-
18 May 2021 1 repository listed
-
2 Apr 2021 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
-
22 Mar 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
4 Jan 2021 1 repository listed
-
2 Jan 2021 1 repository listed
-
1 Dec 2020 1 repository listed
-
1 Dec 2020 1 repository listed
-
29 Nov 2020 1 repository listed
-
1 Nov 2020 1 repository listed
-
1 Nov 2020 1 repository listed
-
21 Oct 2020 1 repository listed
-
12 Oct 2020 1 repository listed
-
9 Oct 2020 1 repository listed
-
7 Oct 2020 1 repository listed
-
6 Oct 2020 1 repository listed
-
5 Oct 2020 1 repository listed
-
1 Oct 2020 1 repository listed
-
24 Sep 2020 1 repository listed
-
20 Aug 2020 1 repository listed
-
17 May 2020 1 repository listed
-
2 May 2020 1 repository listed
-
1 May 2020 1 repository listed
-
1 May 2020 1 repository listed
-
14 Apr 2020 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)
-
1 Dec 2019 1 repository listed
-
12 Nov 2019 1 repository listed
-
8 Nov 2019 1 repository listed
-
7 Nov 2019 1 repository listed
-
7 Oct 2019 1 repository listed
-
21 Sep 2019 1 repository listed
-
7 Sep 2019 1 repository listed
Syntology lines on 17 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections