Datasets › V-COCO

V-COCO (Verbs in COCO)

Introduced by Saurabh Gupta et al. in Visual Semantic Role Labeling1 Jan 2015 archive 2025-07-28

Verbs in COCO (V-COCO) is a dataset that builds off COCO for human-object interaction detection. V-COCO provides 10,346 images (2,533 for training, 2,867 for validating and 4,946 for testing) and 16,199 person instances. Each person has annotations for 29 action categories and there are no interaction labels including objects.

Source: Visual Compositional Learning for Human-Object Interaction Detection Image Source: https://www.researchgate.net/figure/Pose-estimation-and-action-recognition-results-on-the-V-COCO-Dataset-16-which-has_fig9_339477856

Benchmarks archive 2025-07-28

All 1 leaderboard whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Human-Object Interaction Detection V-COCO RLIPv2 AP(S1) 72.1 RLIPv2: Fast Scaling of Relational Language-Image Pre-training jacobyuan7/rlipv2 +2 34 Compare

Papers archive 2025-07-28

28 shown of 28 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 159. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
RLIPv2: Fast Scaling of Relational Language-Image Pre-training 3 1 18 Aug 2023 ran 22 of 30 samples (8 unverified)
Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Model 1 1 20 May 2023 not harvested
Relational Context Learning for Human-Object Interaction Detection 1 1 11 Apr 2023 ran 10 of 12 samples (2 unverified; 12 pointer-only for licence)
HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Models 1 1 28 Mar 2023 not harvested
Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection 1 1 28 Jul 2022 ran 1 of 1 samples (0 unverified)
A Skeleton-aware Graph Convolutional Network for Human-Object Interaction Detection 1 1 11 Jul 2022 not harvested
Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection 1 1 13 Jun 2022 not harvested
Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detection 1 2 11 Apr 2022 not harvested
Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics 1 2 1 Feb 2022 ran 2 of 7 samples (5 unverified)
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformer 1 3 3 Dec 2021 ran 2 of 4 samples (2 unverified)
Mining the Benefits of Two-stage and One-stage HOI Detection 1 1 11 Aug 2021 ran 3 of 4 samples (1 unverified)
HOTR: End-to-End Human-Object Interaction Detection with Transformers 1 1 28 Apr 2021 ran 1 of 1 samples (0 unverified)
Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction Detection 1 1 12 Apr 2021 ran 4 of 9 samples (5 unverified)
QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information 1 2 9 Mar 2021 ran 0 of 1 samples (1 unverified)
Transferable Interactiveness Knowledge for Human-Object Interaction Detection 1 1 25 Jan 2021 not harvested
Spatially Conditioned Graphs for Detecting Human-Object Interactions 2 1 11 Dec 2020 not harvested
HOI Analysis: Integrating and Decomposing Human-Object Interaction 2 1 30 Oct 2020 not harvested
DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction Detection 1 1 2 Oct 2020 ran 3 of 3 samples (0 unverified; 3 pointer-only for licence)
DRG: Dual Relation Graph for Human-Object Interaction Detection 1 1 26 Aug 2020 ran 2 of 3 samples (1 unverified; 2 pointer-only for licence)
Polysemy Deciphering Network for Robust Human-Object Interaction Detection 2 1 7 Aug 2020 not harvested
Pose-based Modular Network for Human-Object Interaction Detection 1 1 5 Aug 2020 not harvested
Detecting Human-Object Interactions with Action Co-occurrence Priors 1 1 1 Aug 2020 not harvested
PaStaNet: Toward Human Activity Knowledge Engine 2 1 2 Apr 2020 not harvested
VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph Convolutions 2 1 11 Mar 2020 ran 0 of 8 samples (8 unverified)
PPDM: Parallel Point Detection and Matching for Real-time Human-Object Interaction Detection 1 1 30 Dec 2019 ran 0 of 2 samples (2 unverified)
Transferable Interactiveness Knowledge for Human-Object Interaction Detection 3 2 20 Nov 2018 ran 0 of 6 samples (6 unverified)
iCAN: Instance-Centric Attention Network for Human-Object Interaction Detection 4 1 30 Aug 2018 ran 0 of 5 samples (5 unverified)
Learning Human-Object Interactions by Graph Parsing Neural Networks 1 1 23 Aug 2018 not harvested

Dataset loaders archive 2025-07-28

1 loader as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

Unknown

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • V-COCO

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections