Papers › A Modern Turkish Poet: Fine-Tuned GPT-2

A Modern Turkish Poet: Fine-Tuned GPT-2

15 Sep 20238th International Conference on Computer Science and Engineering (UBMK) 2023 9archive 2025-07-28

Uygar Kurt, Aykut Çayır

Generative tasks are getting more realistic thanks to the improvements in deep learning. Text generation is getting increasingly important as LLMs (large language models) get more advanced. Even though ChatGPT gave rise to many computer-generated literary works, it has several limitations, such as not being open-sourced and can't be fine-tuned. Because other LLMs are understudied in Turkish, they usually can't be used efficiently to generate literary work. In this paper, we fine-tuned GPT-2 [1] models on sixty Turkish poem categories and trained five models that convey different emotions and write on different topics. The results are gathered in a 70-page Turkish poem book named “Gerçekligin İçinde” that contains 50 poems in total, 10 poems for each chapter. The book got published by Amazon [2], Goodreads [3] and Google Books [4].

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Text Generation

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

AdamAttentionAttention DropoutBPECosine AnnealingDense ConnectionsDiscriminative Fine-TuningDropoutGPT-2Layer NormalizationLinear LayerLinear Warmup With Cosine AnnealingMulti-Head AttentionResidual ConnectionSoftmaxWeight Decay

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections