Datasets › DS-1000

DS-1000

Introduced by Yuhang Lai et al. in DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation18 Nov 2022 archive 2025-07-28

DS-1000 is a code generation benchmark with a thousand data science questions spanning seven Python libraries that (1) reflects diverse, realistic, and practical use cases, (2) has a reliable metric, (3) defends against memorization by perturbing questions.

Source: DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation

Image Source: https://arxiv.org/abs/2211.11501

Benchmarks archive 2025-07-28

No leaderboard in the archive resolves to this dataset.

Papers archive 2025-07-28

No paper in the archive has a leaderboard row on this dataset; the archive counts 72 papers for it but never published that list.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

Apache-2.0 license

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • DS-1000

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections