Datasets › GerMS-AT

GerMS-AT (GERMS-AT: A Sexism/Misogyny Dataset of Forum Comments from an Austrian Online Newspaper)

1 Aug 2024 archive 2025-07-28

This dataset contains 7984 user comments from an Austrian online newspaper. The comments have been annotated by 4 or more out of 11 annotators as to how strong sexism/mysogyny is present in the comment. It was used in the GermEval 2024 Shared Task 1: GerMS-Detect to evaluate data-driven approaches to automatically detect sexism in user comments.

The dataset was introduced and described in Brigitte Krenn, Johann Petrak, Marina Kubina, and Christian Burger. 2024. Germs-at: A sexism/misogyny dataset of forum comments from an Austrian online newspaper. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 7728–7739.

The data can be downloaded here: https://huggingface.co/datasets/ofai/GerMS-AT

Benchmarks archive 2025-07-28

All 2 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
GermEval2024 Shared Task 1 Subtask 1 GerMS-AT mE5-large-SVM Macro F1 0.597 Detecting Sexism in German Online Newspaper Comments... dslaborg/germeval2024 1 Compare
GermEval2024 Shared Task 1 Subtask 2 GerMS-AT GBERT-large-SVM Jensen-Shannon distance 0.301 Detecting Sexism in German Online Newspaper Comments... dslaborg/germeval2024 1 Compare

Papers archive 2025-07-28

1 shown of 1 paper with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 1. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • GerMS-AT

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections