Papers › Jointly Learning to Label Sentences and Tokens
Jointly Learning to Label Sentences and Tokens
Marek Rei, Anders Søgaard
Learning to construct text representations in end-to-end systems can be difficult, as natural languages are highly compositional and task-specific annotated datasets are often limited in size. Methods for directly supervising language composition can allow us to guide the models based on existing knowledge, regularizing them towards more robust and interpretable representations. In this paper, we investigate how objectives at different granularities can be used to learn better language representations and we propose an architecture for jointly learning to label sentences and tokens. The predictions at each level are combined together using an attention mechanism, with token-level labels also acting as explicit supervision for composing sentence-level representations. Our experiments show that by learning to perform these tasks jointly on multiple levels, the model achieves substantial improvements for both sentence classification and sequence labeling.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Grammatical Error Detection | CoNLL-2014 A1 | BiLSTM-JOINT (trained on FCE) | F0.5 | 22.14 | #4 of 8 | Archive leaderboard | report |
| Grammatical Error Detection | CoNLL-2014 A2 | BiLSTM-JOINT (trained on FCE) | F0.5 | 29.65 | #5 of 8 | Archive leaderboard | report |
| Grammatical Error Detection | FCE | BiLSTM-JOINT | F0.5 | 52.07 | #2 of 8 | Archive leaderboard | report |
| Grammatical Error Detection | JFLEG | BiLSTM-JOINT (trained on FCE) | F0.5 | 52.52 | #1 of 1 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections