Papers › Developing Question-Answering Models in Low-Resource Languages: A Case Study on...
Developing Question-Answering Models in Low-Resource Languages: A Case Study on Turkish Medical Texts Using Transformer-Based Approaches
Mert Incidelen, Murat Aydogan
In this study, transformer-based pre-trained language models were fine-tuned using medical texts for question-answering (QA) tasks in Turkish, a low-resource language. Variations of the BERTurk pre-trained language model created using large Turkish corpus were used for QA tasks. The study presents a medical Turkish QA dataset created using Turkish Wikipedia and medical theses located in the Thesis Center of the Council of Higher Education in Turkey. This dataset, containing a total of 8200 question-answer pairs, is used to fine-tune the BERTurk model. The performance of the models was evaluated by Exact Match (EM) and F1 score. The BERTurk (cased, 32k) model achieved an EM of 51.097 and an F1 score of 74.148, while the BERTurk (cased, 128 k) model achieved an EM of 55.121 and an F1 score of 77.187. The results show that pre-trained language models can be successfully used for question-answer tasks in low-resource languages such as Turkish. This study lays an important foundation for Turkish medical text processing and automatic QA tasks and sheds light on future research in this field.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Datasets
Introduced by this paper, per the archive.
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Question Answering | MedTurkQuAD: Medical Turkish Question-Answering Dataset | BERTurk (cased, 32k) | Exact Match | 51.097 | #1 of 2 | Archive leaderboard | report |
| Question Answering | MedTurkQuAD: Medical Turkish Question-Answering Dataset | BERTurk (cased, 32k) | F1 Score | 74.148 | #1 of 2 | Archive leaderboard | report |
| Question Answering | MedTurkQuAD: Medical Turkish Question-Answering Dataset | BERTurk (cased, 128k) | Exact Match | 55.121 | #2 of 2 | Archive leaderboard | report |
| Question Answering | MedTurkQuAD: Medical Turkish Question-Answering Dataset | BERTurk (cased, 128k) | F1 Score | 77.187 | #2 of 2 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections