Datasets › HICO-DET

HICO-DET

Introduced by Yu-Wei Chao et al. in Learning to Detect Human-Object Interactions1 Jan 2018 archive 2025-07-28

HICO-DET is a dataset for detecting human-object interactions (HOI) in images. It contains 47,776 images (38,118 in train set and 9,658 in test set), 600 HOI categories constructed by 80 object categories and 117 verb classes. HICO-DET provides more than 150k annotated human-object pairs. V-COCO provides 10,346 images (2,533 for training, 2,867 for validating and 4,946 for testing) and 16,199 person instances. Each person has annotations for 29 action categories and there are no interaction labels including objects.

Source: Visual Compositional Learning for Human-Object Interaction Detection Image Source: http://www-personal.umich.edu/~ywchao/hico/

Benchmarks archive 2025-07-28

All 4 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Papers archive 2025-07-28

30 shown of 52 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 180. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
Dynamic Scene Understanding from Vision-Language Representations 0 1 20 Jan 2025 not harvested
Unseen No More: Unlocking the Potential of CLIP for Generative Zero-shot HOI Detection 1 1 12 Aug 2024 not harvested
RLIPv2: Fast Scaling of Relational Language-Image Pre-training 3 1 18 Aug 2023 ran 22 of 30 samples (8 unverified)
Exploring Predicate Visual Context in Detecting Human-Object Interactions 1 2 11 Aug 2023 ran 3 of 9 samples (6 unverified)
Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language Advisor 2 1 5 Jul 2023 not harvested
Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Model 1 1 20 May 2023 not harvested
ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detection 1 1 17 Apr 2023 not harvested
Relational Context Learning for Human-Object Interaction Detection 1 1 11 Apr 2023 ran 10 of 12 samples (2 unverified; 12 pointer-only for licence)
HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Models 1 1 28 Mar 2023 not harvested
Category Query Learning for Human-Object Interaction Classification 1 2 24 Mar 2023 ran 1 of 2 samples (1 unverified)
ERNet: Efficient and Reliable Human-Object Interaction Detection 1 1 26 Jan 2023 not harvested
FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detection 1 1 8 Jan 2023 not harvested
RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detection 3 2 5 Sep 2022 ran 0 of 1 samples (1 unverified)
Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection 1 1 28 Jul 2022 ran 1 of 1 samples (0 unverified)
Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection 1 1 13 Jun 2022 not harvested
Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detection 1 2 11 Apr 2022 not harvested
Discovering Human-Object Interaction Concepts via Self-Compositional Learning 2 2 27 Mar 2022 ran 0 of 1 samples (1 unverified; 1 pointer-only for licence)
GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detection 1 1 26 Mar 2022 ran 2 of 3 samples (1 unverified)
Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics 1 1 1 Feb 2022 ran 2 of 7 samples (5 unverified)
QAHOI: Query-Based Anchors for Human-Object Interaction Detection 1 1 16 Dec 2021 ran 10 of 15 samples (5 unverified)
The Overlooked Classifier in Human-Object Interaction Recognition 0 1 13 Dec 2021 not harvested
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformer 1 3 3 Dec 2021 ran 2 of 4 samples (2 unverified)
ACP++: Action Co-occurrence Priors for Human-Object Interaction Detection 1 1 9 Sep 2021 not harvested
Mining the Benefits of Two-stage and One-stage HOI Detection 1 1 11 Aug 2021 ran 3 of 4 samples (1 unverified)
HOTR: End-to-End Human-Object Interaction Detection with Transformers 1 1 28 Apr 2021 ran 1 of 1 samples (0 unverified)
Affordance Transfer Learning for Human-Object Interaction Detection 2 2 7 Apr 2021 not harvested
Detecting Human-Object Interaction via Fabricated Compositional Learning 1 1 15 Mar 2021 ran 0 of 1 samples (1 unverified)
Reformulating HOI Detection as Adaptive Set Prediction 1 1 10 Mar 2021 ran 0 of 1 samples (1 unverified)
QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information 1 3 9 Mar 2021 ran 0 of 1 samples (1 unverified)
End-to-End Human Object Interaction Detection with HOI Transformer 1 2 8 Mar 2021 ran 0 of 1 samples (1 unverified)

The full list of 52 is in the JSON twin.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

Unknown

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • HICO-DET

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections