Papers › The SIGMORPHON 2022 Shared Task on Morpheme Segmentation

The SIGMORPHON 2022 Shared Task on Morpheme Segmentation

15 Jun 2022NAACL (SIGMORPHON) 2022 7arXiv:2206.07615archive 2025-07-28

Khuyagbaatar Batsuren, Gábor Bella, Aryaman Arora, Viktor Martinović, Kyle Gorman, Zdeněk Žabokrtský, Amarsanaa Ganbold, Šárka Dohnalová, Magda Ševčíková, Kateřina Pelegrinová, Fausto Giunchiglia, Ryan Cotterell, Ekaterina Vylomova

The SIGMORPHON 2022 shared task on morpheme segmentation challenged systems to decompose a word into a sequence of morphemes and covered most types of morphology: compounds, derivations, and inflections. Subtask 1, word-level morpheme segmentation, covered 5 million words in 9 languages (Czech, English, Spanish, Hungarian, French, Italian, Russian, Latin, Mongolian) and received 13 system submissions from 7 teams and the best system averaged 97.29% F1 score across all languages, ranging English (93.84%) to Latin (99.38%). Subtask 2, sentence-level morpheme segmentation, covered 18,735 sentences in 3 languages (Czech, English, Mongolian), received 10 system submissions from 3 teams, and the best systems outperformed all three state-of-the-art subword tokenization methods (BPE, ULM, Morfessor2) by 30.71% absolute. To facilitate error analysis and support any type of future studies, we released all system predictions, the evaluation script, and all gold standard datasets.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

sigmorphon/2022segmentationst officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

AllMorpheme SegmentaitonSegmentationSentence

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Morpheme Segmentaiton UniMorph 4.0 Morfessor2 f1 macro avg (subtask 2) 50.65 #8 of 19 Archive leaderboard report
Morpheme Segmentaiton UniMorph 4.0 Morfessor2 lev dist (subtask 2) 12.08 #8 of 19 Archive leaderboard report
Morpheme Segmentaiton UniMorph 4.0 Morfessor2 macro avg (subtask 1) 25.57 #8 of 19 Archive leaderboard report
Morpheme Segmentaiton UniMorph 4.0 ULM f1 macro avg (subtask 2) 45.99 #9 of 19 Archive leaderboard report
Morpheme Segmentaiton UniMorph 4.0 ULM lev dist (subtask 2) 14.28 #9 of 19 Archive leaderboard report
Morpheme Segmentaiton UniMorph 4.0 ULM macro avg (subtask 1) 20.61 #9 of 19 Archive leaderboard report
Morpheme Segmentaiton UniMorph 4.0 WordPiece f1 macro avg (subtask 2) 40.59 #10 of 19 Archive leaderboard report
Morpheme Segmentaiton UniMorph 4.0 WordPiece lev dist (subtask 2) 17.54 #10 of 19 Archive leaderboard report
Morpheme Segmentaiton UniMorph 4.0 WordPiece macro avg (subtask 1) 15.89 #10 of 19 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections