Datasets › OpenAPI completion refined

OpenAPI completion refined

Introduced by Bohdan Petryshyn et al. in Optimizing Large Language Models for OpenAPI Code Completion24 May 2024 archive 2025-07-28

A human-refined dataset of OpenAPI definitions based on the APIs.guru OpenAPI directory.

The dataset was collected from the APIs.guru OpenAPI definitions directory. The directory contains more than 4,000 definitions in yaml format. Analysis of the repository revealed that about 75% of the definitions in the directory are produced by a handful of major companies like Amazon, Google, and Microsoft. To avoid the dataset bias towards a specific producer, the maximum number of definitions from a single producer was limited to 20. Multiple versions of the same API were also excluded from the dataset as they are likely to contain very similar definitions.

Benchmarks archive 2025-07-28

All 1 leaderboard whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
OpenAPI code completion OpenAPI completion refined Code Llama 7B, fine-tuned with document splitting Correctness, avg., % 34 Optimizing Large Language Models for OpenAPI Code Completion BohdanPetryshyn/code-llama-fim-fine-tuning +1 4 Compare

Papers archive 2025-07-28

1 shown of 1 paper with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 1. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
Optimizing Large Language Models for OpenAPI Code Completion 2 4 24 May 2024 not harvested

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

MIT

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • OpenAPI completion refined

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections