Papers › SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis

SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis

20 Dec 2019arXiv:1912.09723archive 2025-07-28

Pavel Efimov, Andrey Chertok, Leonid Boytsov, Pavel Braslavski

SberQuAD -- a large scale analog of Stanford SQuAD in the Russian language - is a valuable resource that has not been properly presented to the scientific community. We fill this gap by providing a description, a thorough analysis, and baseline experimental results.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Question AnsweringReading Comprehension

Datasets

Introduced by this paper, per the archive.

SberQuAD

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Question Answering SberQuAD DeepPavlov RuBERT EM 66.30+-0.24 #1 of 3 Archive leaderboard report
Question Answering SberQuAD DeepPavlov RuBERT F1 84.60+-0.11 #1 of 3 Archive leaderboard report
Question Answering SberQuAD DeepPavlov multilingual BERT EM 64.35+-0.39 #2 of 3 Archive leaderboard report
Question Answering SberQuAD DeepPavlov multilingual BERT F1 83.39+-0.08 #2 of 3 Archive leaderboard report
Question Answering SberQuAD DeepPavlov R-Net EM 60.62 #3 of 3 Archive leaderboard report
Question Answering SberQuAD DeepPavlov R-Net F1 80.04 #3 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections