Papers › Sense Vocabulary Compression through the Semantic Knowledge of WordNet for Neural Word...

Sense Vocabulary Compression through the Semantic Knowledge of WordNet for Neural Word Sense Disambiguation

14 May 2019GWC 2019 7arXiv:1905.05677archive 2025-07-28

Loïc Vial, Benjamin Lecouteux, Didier Schwab

In this article, we tackle the issue of the limited quantity of manually sense annotated corpora for the task of word sense disambiguation, by exploiting the semantic relationships between senses such as synonymy, hypernymy and hyponymy, in order to compress the sense vocabulary of Princeton WordNet, and thus reduce the number of different sense tags that must be observed to disambiguate all words of the lexical database. We propose two different methods that greatly reduces the size of neural WSD models, with the benefit of improving their coverage without additional training data, and without impacting their precision. In addition to our method, we present a WSD system which relies on pre-trained BERT word vectors in order to achieve results that significantly outperform the state of the art on all WSD evaluation tasks.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

getalp/disambiguate officialmentioned in papermentioned on GitHubpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Word Sense Disambiguation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Word Sense Disambiguation SemEval 2007 Task 17 SemCor+WNGC, hypernyms F1 73.4 #1 of 9 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 7 SemCor+WNGC, hypernyms F1 90.4 #1 of 10 Archive leaderboard report
Word Sense Disambiguation SemEval 2013 Task 12 SemCor+WNGC, hypernyms F1 78.7 #1 of 12 Archive leaderboard report
Word Sense Disambiguation SemEval 2015 Task 13 SemCor+WNGC, hypernyms F1 82.6 #1 of 6 Archive leaderboard report
Word Sense Disambiguation SensEval 2 SemCor+WNGC, hypernyms F1 79.7 #1 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 3 Task 1 SemCor+WNGC, hypernyms F1 77.8 #1 of 11 Archive leaderboard report
Word Sense Disambiguation Supervised: SemCor+WNGC, hypernyms SemEval 2007 73.4 #9 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: SemCor+WNGC, hypernyms SemEval 2013 78.7 #9 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: SemCor+WNGC, hypernyms SemEval 2015 82.6 #9 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: SemCor+WNGC, hypernyms Senseval 2 79.7 #9 of 27 Archive leaderboard report
Word Sense Disambiguation Supervised: SemCor+WNGC, hypernyms Senseval 3 77.8 #9 of 27 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AdamAttentionAttention DropoutBERTDense ConnectionsDropoutLayer NormalizationLinear LayerLinear Warmup With Linear DecayMulti-Head AttentionResidual ConnectionSoftmaxWeight DecayWordPiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections