Datasets › Counting Probe

Counting Probe (Counting Probe based on Visual7W)

Introduced by Letitia Parcalabescu et al. in Seeing past words: Testing the cross-modal capabilities of pretrained V&L models on counting tasks22 Dec 2020 archive 2025-07-28

Probing cross-modal capabilities of Vision & Language models with a counting task.

  • binary classification
  • following a FOIL setup (as introduced by Shekhar et al. 2017: https://www.aclweb.org/anthology/P17-1024/)

Benchmarks archive 2025-07-28

No leaderboard in the archive resolves to this dataset.

Papers archive 2025-07-28

No paper in the archive has a leaderboard row on this dataset; the archive counts 1 paper for it but never published that list.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

No task tagged in the archive.

License archive 2025-07-28

MIT License

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • Counting Probe

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections