Datasets › IllusionAnimals_test

IllusionAnimals_test

Introduced by Mohammadmostafa Rostamkhani et al. in Illusory VQA: Benchmarking and Enhancing Multimodal Models on Visual Illusions11 Dec 2024 archive 2025-07-28

IllusionAnimals_test

Dataset Characteristics

IllusionAnimals_test is a generated dataset based on a synthetic collection of animal images, including 10 animal classes: cat, dog, pigeon, butterfly, elephant, horse, deer, snake, fish, and rooster. Additionally, it includes a "No Illusion" class, bringing the total number of classes to 11. The dataset contains 1,100 samples, all created synthetically rather than derived from real-world images.

Motivations and Content Summary

The dataset was designed using ControlNet for image generation, with captions provided by four large language models (LLMs). Its purpose is to incorporate the phenomenon of pareidolia—where patterns, often faces, are perceived in random or abstract stimuli—into a variety of animal-related visual contexts. By focusing on animal images, this dataset broadens the scope of illusory reasoning tasks to include more naturalistic and complex visual patterns.

Potential Use Cases
  • Illusory VQA: Questioning models about the illusions present in the images.
  • Multimodal Model Evaluation: Benchmarking multimodal models' ability to interpret and reason about abstract and illusory patterns in naturalistic images.
  • Perceptual Studies: Exploring how AI models perceive pareidolia in animal-related visual data.
  • Synthetic Data Research: Investigating the use of generated datasets to challenge machine learning models with abstract and complex patterns.

Benchmarks archive 2025-07-28

No leaderboard in the archive resolves to this dataset.

Papers archive 2025-07-28

No paper in the archive has a leaderboard row on this dataset; the archive counts 1 paper for it but never published that list.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • IllusionAnimals_test

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections