Datasets β€Ί ODEX

ODEX

Introduced by Zhiruo Wang et al. in Execution-Based Evaluation for Open-Domain Code Generation20 Dec 2022 archive 2025-07-28

ODEX is an open-domain πŸ“–, multilingual 🌍, execution-based πŸ›  natural language to code generation πŸ’» data benchmark. ODEX has 945 NL-Code pairs spanning 79 diverse libraries, along with 1,707 human-written test cases for execution. The NL-Code pairs are harvested from StackOverflow forums to encourage natural and practical coding queries. Moreover, ODEX supports four natural languages as intents: English, espaΓ±ol (Spanish), ζ—₯本θͺž (Japanese), and Pусский (Russian).

Benchmarks archive 2025-07-28

No leaderboard in the archive resolves to this dataset.

Papers archive 2025-07-28

No paper in the archive has a leaderboard row on this dataset; the archive counts 18 papers for it but never published that list.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

No task tagged in the archive.

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

No modality tagged.

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • ODEX

1 variant name, as the archive lists them.

Report a problem or propose a change Β· a person checks every report against the paper or source before anything changes; decisions are listed on /corrections