Papers › Developing Question-Answering Models in Low-Resource Languages: A Case Study on...

Developing Question-Answering Models in Low-Resource Languages: A Case Study on Turkish Medical Texts Using Transformer-Based Approaches

16 Oct 2024International Artificial Intelligence and Data Processing Symposium 2024 10archive 2025-07-28

Mert Incidelen, Murat Aydogan

In this study, transformer-based pre-trained language models were fine-tuned using medical texts for question-answering (QA) tasks in Turkish, a low-resource language. Variations of the BERTurk pre-trained language model created using large Turkish corpus were used for QA tasks. The study presents a medical Turkish QA dataset created using Turkish Wikipedia and medical theses located in the Thesis Center of the Council of Higher Education in Turkey. This dataset, containing a total of 8200 question-answer pairs, is used to fine-tune the BERTurk model. The performance of the models was evaluated by Exact Match (EM) and F1 score. The BERTurk (cased, 32k) model achieved an EM of 51.097 and an F1 score of 74.148, while the BERTurk (cased, 128 k) model achieved an EM of 55.121 and an F1 score of 77.187. The results show that pre-trained language models can be successfully used for question-answer tasks in low-resource languages such as Turkish. This study lays an important foundation for Turkish medical text processing and automatic QA tasks and sheds light on future research in this field.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Language ModelingLanguage ModellingQuestion Answering

Datasets

Introduced by this paper, per the archive.

MedTurkQuAD: Medical Turkish Question-Answering Dataset

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Question Answering MedTurkQuAD: Medical Turkish Question-Answering Dataset BERTurk (cased, 32k) Exact Match 51.097 #1 of 2 Archive leaderboard report
Question Answering MedTurkQuAD: Medical Turkish Question-Answering Dataset BERTurk (cased, 32k) F1 Score 74.148 #1 of 2 Archive leaderboard report
Question Answering MedTurkQuAD: Medical Turkish Question-Answering Dataset BERTurk (cased, 128k) Exact Match 55.121 #2 of 2 Archive leaderboard report
Question Answering MedTurkQuAD: Medical Turkish Question-Answering Dataset BERTurk (cased, 128k) F1 Score 77.187 #2 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections