Papers › With More Contexts Comes Better Performance: Contextualized Sense Embeddings for...
With More Contexts Comes Better Performance: Contextualized Sense Embeddings for All-Round Word Sense Disambiguation
Bianca Scarlini, Tommaso Pasini, Roberto Navigli
Contextualized word embeddings have been employed effectively across several tasks in Natural Language Processing, as they have proved to carry useful semantic information. However, it is still hard to link them to structured sources of knowledge. In this paper we present ARES (context-AwaRe Embeddings of Senses), a semi-supervised approach to producing sense embeddings for the lexical meanings within a lexical knowledge base that lie in a space that is comparable to that of contextualized word vectors. ARES representations enable a simple 1 Nearest-Neighbour algorithm to outperform state-of-the-art models, not only in the English Word Sense Disambiguation task, but also in the multilingual one, whilst training on sense-annotated data in English only. We further assess the quality of our embeddings in the Word-in-Context task, where, when used as an external source of knowledge, they consistently improve the performance of a neural model, leading it to compete with other more complex architectures. ARES embeddings for all WordNet concepts and the automatically-extracted contexts used for creating the sense representations are freely available at http://sensembert.org/ares.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Word Sense Disambiguation | Supervised: | ARES | SemEval 2007 | 71.0 | #13 of 27 | Archive leaderboard | report |
| Word Sense Disambiguation | Supervised: | ARES | SemEval 2013 | 77.3 | #13 of 27 | Archive leaderboard | report |
| Word Sense Disambiguation | Supervised: | ARES | SemEval 2015 | 83.2 | #13 of 27 | Archive leaderboard | report |
| Word Sense Disambiguation | Supervised: | ARES | Senseval 2 | 78.0 | #13 of 27 | Archive leaderboard | report |
| Word Sense Disambiguation | Supervised: | ARES | Senseval 3 | 77.1 | #13 of 27 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections