Papers › Semi-supervised Word Sense Disambiguation with Neural Models

Semi-supervised Word Sense Disambiguation with Neural Models

22 Mar 2016COLING 2016 12arXiv:1603.07012archive 2025-07-28

Dayu Yuan, Julian Richardson, Ryan Doherty, Colin Evans, Eric Altendorf

Determining the intended sense of words in text - word sense disambiguation (WSD) - is a long standing problem in natural language processing. Recently, researchers have shown promising results using word vectors extracted from a neural network language model as features in WSD algorithms. However, a simple average or concatenation of word vectors for each word in a text loses the sequential and syntactic information of the text. In this paper, we study WSD with a sequence learning neural net, LSTM, to better capture the sequential and syntactic patterns of the text. To alleviate the lack of training data in all-words WSD, we employ the same LSTM in a semi-supervised label propagation classifier. We demonstrate state-of-the-art results, especially on verbs.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Language ModelingLanguage ModellingWord Sense Disambiguation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Word Sense Disambiguation SemEval 2007 Task 17 LSTM (T:SemCor) F1 64.2 #3 of 9 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 17 LSTMLP (T:SemCor, U:OMSTI) F1 63.7 #4 of 9 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 17 LSTMLP (T:SemCor, U:1K) F1 63.5 #5 of 9 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 17 LSTMLP (T:OMSTI, U:1K) F1 63.3 #6 of 9 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 17 LSTM (T:OMSTI) F1 60.7 #9 of 9 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 7 LSTMLP (T:SemCor, U:OMSTI) F1 84.3 #4 of 10 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 7 LSTMLP (T:SemCor, U:1K) F1 83.6 #5 of 10 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 7 LSTMLP (T:OMSTI, U:1K) F1 83.3 #6 of 10 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 7 LSTM (T:SemCor) F1 82.8 #7 of 10 Archive leaderboard report
Word Sense Disambiguation SemEval 2007 Task 7 LSTM (T:OMSTI) F1 81.1 #10 of 10 Archive leaderboard report
Word Sense Disambiguation SemEval 2013 Task 12 LSTMLP (T:SemCor, U:1K) F1 69.5 #3 of 12 Archive leaderboard report
Word Sense Disambiguation SemEval 2013 Task 12 LSTMLP (T:OMSTI, U:1K) F1 68.1 #4 of 12 Archive leaderboard report
Word Sense Disambiguation SemEval 2013 Task 12 LSTMLP (T:SemCor, U:OMSTI) F1 67.9 #5 of 12 Archive leaderboard report
Word Sense Disambiguation SemEval 2013 Task 12 LSTM (T:OMSTI) F1 67.3 #6 of 12 Archive leaderboard report
Word Sense Disambiguation SemEval 2013 Task 12 LSTM (T:SemCor) F1 67.0 #10 of 12 Archive leaderboard report
Word Sense Disambiguation SensEval 2 LSTMLP (T:OMSTI, U:1K) F1 74.4 #3 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 2 LSTMLP (T:SemCor, U:OMSTI) F1 73.9 #4 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 2 LSTMLP (T:SemCor, U:1K) F1 73.8 #5 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 2 LSTM (T:SemCor) F1 73.6 #6 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 2 LSTM (T:OMSTI) F1 72.4 #8 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 3 Task 1 LSTMLP (T:SemCor, U:1K) F1 71.8 #2 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 3 Task 1 LSTMLP (T:SemCor, U:OMSTI) F1 71.1 #3 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 3 Task 1 LSTMLP (T:OMSTI, U:1K) F1 71.0 #4 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 3 Task 1 LSTM (T:SemCor) F1 69.2 #10 of 11 Archive leaderboard report
Word Sense Disambiguation SensEval 3 Task 1 LSTM (T:OMSTI) F1 64.3 #11 of 11 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

LSTMSigmoid ActivationTanh Activation

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections