Datasets › WinoBias

WinoBias

Introduced by Jieyu Zhao et al. in Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods1 Jan 2018 archive 2025-07-28

WinoBias contains 3,160 sentences, split equally for development and test, created by researchers familiar with the project. Sentences were created to follow two prototypical templates but annotators were encouraged to come up with scenarios where entities could be interacting in plausible ways. Templates were selected to be challenging and designed to cover cases requiring semantics and syntax separately.

Source: WinoBias Image Source: https://uclanlp.github.io/corefBias/overview

Homepage JSON

Benchmarks archive 2025-07-28

No leaderboard in the archive resolves to this dataset.

Papers archive 2025-07-28

No paper in the archive has a leaderboard row on this dataset; the archive counts 134 papers for it but never published that list.

Dataset loaders archive 2025-07-28

huggingface.co/datasets/uclanlp/wino_bias huggingface/datasetstfpytorchjax

huggingface.co/datasets/facebook/panda huggingface/datasetstfpytorchjax

huggingface.co/datasets/wino_bias huggingface/datasetstfpytorchjax

docs.allennlp.org/models/main/models/coref/dataset_readers/winobias/allenai/allennlp-modelspytorch

4 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

Coreference Resolution Fairness Word Embeddings

License archive 2025-07-28

MIT

Modalities archive 2025-07-28

Texts

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

WinoBias

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections