Papers › A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsing

A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsing

15 Oct 2022arXiv:2210.08355archive 2025-07-28

Naoki Kobayashi, Tsutomu Hirao, Hidetaka Kamigaito, Manabu Okumura, Masaaki Nagata

To promote and further develop RST-style discourse parsing models, we need a strong baseline that can be regarded as a reference for reporting reliable experimental results. This paper explores a strong baseline by integrating existing simple parsing strategies, top-down and bottom-up, with various transformer-based pre-trained language models. The experimental results obtained from two benchmark datasets demonstrate that the parsing performance strongly relies on the pretrained language models rather than the parsing strategies. In particular, the bottom-up parser achieves large performance gains compared to the current best parser when employing DeBERTa. We further reveal that language models with a span-masking scheme especially boost the parsing performance through our analysis within intra- and multi-sentential parsing, and nuclearity prediction.

PaperPDFCode

Code

nttcslab-nlp/rstparser_emnlp22 officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Discourse Parsing

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (DeBERTa) Standard Parseval (Full) 44.4 #1 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (DeBERTa) Standard Parseval (Nuclearity) 60.0 #1 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (DeBERTa) Standard Parseval (Relation) 51.4 #1 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (DeBERTa) Standard Parseval (Span) 77.8 #1 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (DeBERTa) Standard Parseval (Full) 43.4 #2 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (DeBERTa) Standard Parseval (Nuclearity) 57.9 #2 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (DeBERTa) Standard Parseval (Relation) 50.0 #2 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (DeBERTa) Standard Parseval (Span) 77.3 #2 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (XLNet) Standard Parseval (Full) 40.7 #3 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (XLNet) Standard Parseval (Nuclearity) 56.4 #3 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (XLNet) Standard Parseval (Relation) 47.4 #3 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (XLNet) Standard Parseval (Span) 73.6 #3 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (RoBERTa) Standard Parseval (Full) 41.5 #4 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (RoBERTa) Standard Parseval (Nuclearity) 56.1 #4 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (RoBERTa) Standard Parseval (Relation) 48.7 #4 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (RoBERTa) Standard Parseval (Span) 75.7 #4 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (RoBERTa) Standard Parseval (Full) 41.4 #5 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (RoBERTa) Standard Parseval (Nuclearity) 55.5 #5 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (RoBERTa) Standard Parseval (Relation) 47.9 #5 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (RoBERTa) Standard Parseval (Span) 73.2 #5 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (XLNet) Standard Parseval (Full) 40.2 #6 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (XLNet) Standard Parseval (Nuclearity) 55.2 #6 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (XLNet) Standard Parseval (Relation) 47.0 #6 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (XLNet) Standard Parseval (Span) 74.3 #6 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (SpanBERT) Standard Parseval (Full) 36.7 #7 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (SpanBERT) Standard Parseval (Nuclearity) 54.5 #7 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (SpanBERT) Standard Parseval (Relation) 42.7 #7 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (SpanBERT) Standard Parseval (Span) 73.7 #7 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (SpanBERT) Standard Parseval (Full) 40.5 #8 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (SpanBERT) Standard Parseval (Nuclearity) 53.8 #8 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (SpanBERT) Standard Parseval (Relation) 46.0 #8 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (SpanBERT) Standard Parseval (Span) 72.9 #8 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (BERT) Standard Parseval (Full) 32.9 #10 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (BERT) Standard Parseval (Nuclearity) 46.3 #10 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (BERT) Standard Parseval (Relation) 39.5 #10 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Bottom-up (BERT) Standard Parseval (Span) 66.6 #10 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (BERT) Standard Parseval (Full) 30.9 #11 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (BERT) Standard Parseval (Nuclearity) 44.6 #11 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (BERT) Standard Parseval (Relation) 37.6 #11 of 12 Archive leaderboard report
Discourse Parsing Instructional-DT (Instr-DT) Top-down (BERT) Standard Parseval (Span) 65.3 #11 of 12 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (DeBERTa) Standard Parseval (Full) 55.4 ± 0.4 #7 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (DeBERTa) Standard Parseval (Nuclearity) 68.0 ± 0.5 #7 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (DeBERTa) Standard Parseval (Relation) 57.3 ± 0.2 #7 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (DeBERTa) Standard Parseval (Span) 77.8 ± 0.3 #7 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (XLNet) Standard Parseval (Full) 54.8 #8 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (XLNet) Standard Parseval (Nuclearity) 67.4 #8 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (XLNet) Standard Parseval (Relation) 57.0 #8 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (XLNet) Standard Parseval (Span) 77.8 #8 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (DeBERTa) Standard Parseval (Full) 54.4 #9 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (DeBERTa) Standard Parseval (Nuclearity) 67.9 #9 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (DeBERTa) Standard Parseval (Relation) 56.6 #9 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (DeBERTa) Standard Parseval (Span) 78.5 #9 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (XLNet) Standard Parseval (Full) 54.2 #10 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (XLNet) Standard Parseval (Nuclearity) 65.9 #10 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (XLNet) Standard Parseval (Relation) 56.3 #10 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (RoBERTa) Standard Parseval (Full) 53.8 #11 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (RoBERTa) Standard Parseval (Nuclearity) 66.6 #11 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (RoBERTa) Standard Parseval (Relation) 55.8 #11 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (RoBERTa) Standard Parseval (Span) 77.3 #11 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (RoBERTa) Standard Parseval (Full) 53.7 #12 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (RoBERTa) Standard Parseval (Nuclearity) 66.5 #12 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (RoBERTa) Standard Parseval (Relation) 55.4 #12 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (RoBERTa) Standard Parseval (Span) 76.1 #12 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (SpanBERT) Standard Parseval (Full) 52.7 #14 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (SpanBERT) Standard Parseval (Nuclearity) 65.3 #14 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (SpanBERT) Standard Parseval (Relation) 54.9 #14 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (SpanBERT) Standard Parseval (Full) 52.2 #15 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (SpanBERT) Standard Parseval (Nuclearity) 65.4 #15 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (SpanBERT) Standard Parseval (Relation) 54.5 #15 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (SpanBERT) Standard Parseval (Span) 76.5 #15 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (BERT) Standard Parseval (Full) 46.6 #22 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (BERT) Standard Parseval (Nuclearity) 59.1 #22 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (BERT) Standard Parseval (Relation) 48.3 #22 of 40 Archive leaderboard report
Discourse Parsing RST-DT Top-down (BERT) Standard Parseval (Span) 69.8 #22 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (BERT) Standard Parseval (Full) 46.0 #23 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (BERT) Standard Parseval (Nuclearity) 57.8 #23 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (BERT) Standard Parseval (Relation) 47.8 #23 of 40 Archive leaderboard report
Discourse Parsing RST-DT Bottom-up (BERT) Standard Parseval (Span) 68.3 #23 of 40 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

DeBERTa

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections