Papers › Sentence Embeddings for Russian NLU

Sentence Embeddings for Russian NLU

29 Oct 2019arXiv:1910.13291archive 2025-07-28

Dmitry Popov, Alexander Pugachev, Polina Svyatokum, Elizaveta Svitanko, Ekaterina Artemova

We investigate the performance of sentence embeddings models on several tasks for the Russian language. In our comparison, we include such tasks as multiple choice question answering, next sentence prediction, and paraphrase identification. We employ FastText embeddings as a baseline and compare it to ELMo and BERT embeddings. We conduct two series of experiments, using both unsupervised (i.e., based on similarity measure only) and supervised approaches for the tasks. Finally, we present datasets for multiple choice question answering and next sentence prediction in Russian.

PaperPDFCode

Code

avidale/encodechka mentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Multiple-choiceParaphrase IdentificationPredictionQuestion AnsweringSentenceSentence Embeddings

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

AdamAttentionAttention DropoutBERTBiLSTMDense ConnectionsDropoutELMoLSTMLayer NormalizationLinear LayerLinear Warmup With Linear DecayMulti-Head AttentionResidual ConnectionSigmoid ActivationSoftmaxTanh ActivationWeight DecayWordPiecefastText

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections