Papers › VNLP: Turkish NLP Package

VNLP: Turkish NLP Package

2 Mar 2024arXiv:2403.01309archive 2025-07-28

Meliksah Turker, Mehmet Erdi Ari, Aydin Han

In this work, we present VNLP: the first dedicated, complete, open-source, well-documented, lightweight, production-ready, state-of-the-art Natural Language Processing (NLP) package for the Turkish language. It contains a wide variety of tools, ranging from the simplest tasks, such as sentence splitting and text normalization, to the more advanced ones, such as text and token classification models. Its token classification models are based on "Context Model", a novel architecture that is both an encoder and an auto-regressive model. NLP tasks solved by VNLP models include but are not limited to Sentiment Analysis, Named Entity Recognition, Morphological Analysis & Disambiguation and Part-of-Speech Tagging. Moreover, it comes with pre-trained word embeddings and corresponding SentencePiece Unigram tokenizers. VNLP has an open-source GitHub repository, ReadtheDocs documentation, PyPi package for convenient installation, Python and command-line API and a demo page to test all the functionality. Consequently, our main contribution is a complete, compact, easy-to-install and easy-to-use NLP package for Turkish.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

selimfirat/bilkent-turkish-writings-dataset officialmentioned in paperNOASSERTIONSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Evaluating Morphological Compositional Generalization in Large Language Models (arXiv:2410.12656; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Morphological AnalysisNamed Entity RecognitionPart-Of-Speech TaggingSentenceSentiment AnalysisText NormalizationToken ClassificationWord Embeddingsnamed-entity-recognitiontoken-classification

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

BPESentencePiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections