Papers › Extending an Event-type Ontology: Adding Verbs and Classes Using Fine-tuned LLMs Suggestions

Extending an Event-type Ontology: Adding Verbs and Classes Using Fine-tuned LLMs Suggestions

3 Jun 2023arXiv:2306.02130archive 2025-07-28

Jana Straková, Eva Fučíková, Jan Hajič, Zdeňka Urešová

In this project, we have investigated the use of advanced machine learning methods, specifically fine-tuned large language models, for pre-annotating data for a lexical extension task, namely adding descriptive words (verbs) to an existing (but incomplete, as of yet) ontology of event types. Several research questions have been focused on, from the investigation of a possible heuristics to provide at least hints to annotators which verbs to include and which are outside the current version of the ontology, to the possible use of the automatic scores to help the annotators to be more efficient in finding a threshold for identifying verbs that cannot be assigned to any existing class and therefore they are to be used as seeds for a new class. We have also carefully examined the correlation of the automatic scores with the human annotation. While the correlation turned out to be strong, its influence on the annotation proper is modest due to its near linearity, even though the mere fact of such pre-annotation leads to relatively short annotation times.

PaperPDFCode

Code

strakova/synsemclass_ml officialmentioned in papertf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Descriptive

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Ontology

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections