Papers › Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense...

Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information

1 Jul 2020ACL 2020 6archive 2025-07-28

Michele Bevilacqua, Roberto Navigli

Neural architectures are the current state of the art in Word Sense Disambiguation (WSD). However, they make limited use of the vast amount of relational information encoded in Lexical Knowledge Bases (LKB). We present Enhanced WSD Integrating Synset Embeddings and Relations (EWISER), a neural supervised architecture that is able to tap into this wealth of knowledge by embedding information from the LKB graph within the neural architecture, and to exploit pretrained synset embeddings, enabling the network to predict synsets that are not in the training set. As a result, we set a new state of the art on almost all the evaluation settings considered, also breaking through, for the first time, the 80{%} ceiling on the concatenation of all the standard all-words English WSD evaluation benchmarks. On multilingual all-words WSD, we report state-of-the-art results by training on nothing but English.

PaperPDFCode

Code

SapienzaNLP/ewiser officialpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

AllWord Sense Disambiguation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Word Sense Disambiguation Supervised: EWISER+WNGC SemEval 2007 75.2 #8 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: EWISER+WNGC SemEval 2013 80.7 #8 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: EWISER+WNGC SemEval 2015 81.8 #8 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: EWISER+WNGC Senseval 2 80.8 #8 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: EWISER+WNGC Senseval 3 79.0 #8 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: EWISER SemEval 2007 71.0 #12 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: EWISER SemEval 2013 78.9 #12 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: EWISER SemEval 2015 79.3 #12 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: EWISER Senseval 2 78.9 #12 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: EWISER Senseval 3 78.4 #12 of 27 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections