Papers › Hypernyms under Siege: Linguistically-motivated Artillery for Hypernymy Detection
Hypernyms under Siege: Linguistically-motivated Artillery for Hypernymy Detection
Vered Shwartz, Enrico Santus, Dominik Schlechtweg
The fundamental role of hypernymy in NLP has motivated the development of many methods for the automatic identification of this relation, most of which rely on word distribution. We investigate an extensive number of such unsupervised measures, using several distributional semantic models that differ by context type and feature weighting. We analyze the performance of the different methods based on their linguistic motivation. Comparison to the state-of-the-art supervised methods shows that while supervised methods generally outperform the unsupervised ones, the former are sensitive to the distribution of training instances, hurting their reliability. Being based on general linguistic hypotheses and independent from training data, unsupervised measures are more robust, and therefore are still useful artillery for hypernymy detection.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Hypernym Discovery | General | balAPInc | MAP | 1.36 | #8 of 8 | Archive leaderboard | report |
| Hypernym Discovery | General | balAPInc | MRR | 3.18 | #8 of 8 | Archive leaderboard | report |
| Hypernym Discovery | General | balAPInc | P@5 | 1.30 | #8 of 8 | Archive leaderboard | report |
| Hypernym Discovery | Medical domain | balAPInc | MAP | 0.91 | #8 of 8 | Archive leaderboard | report |
| Hypernym Discovery | Medical domain | balAPInc | MRR | 2.10 | #8 of 8 | Archive leaderboard | report |
| Hypernym Discovery | Medical domain | balAPInc | P@5 | 1.08 | #8 of 8 | Archive leaderboard | report |
| Hypernym Discovery | Music domain | balAPInc | MAP | 1.95 | #7 of 7 | Archive leaderboard | report |
| Hypernym Discovery | Music domain | balAPInc | MRR | 5.01 | #7 of 7 | Archive leaderboard | report |
| Hypernym Discovery | Music domain | balAPInc | P@5 | 2.15 | #7 of 7 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections