Papers › Dual-Glance Model for Deciphering Social Relationships

Dual-Glance Model for Deciphering Social Relationships

2 Aug 2017ICCV 2017 10arXiv:1708.00634archive 2025-07-28

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

Since the beginning of early civilizations, social relationships derived from each individual fundamentally form the basis of social structure in our daily life. In the computer vision literature, much progress has been made in scene understanding, such as object detection and scene parsing. Recent research focuses on the relationship between objects based on its functionality and geometrical relations. In this work, we aim to study the problem of social relationship recognition, in still images. We have proposed a dual-glance model for social relationship recognition, where the first glance fixates at the individual pair of interest and the second glance deploys attention mechanism to explore contextual cues. We have also collected a new large scale People in Social Context (PISC) dataset, which comprises of 22,670 images and 76,568 annotated samples from 9 types of social relationship. We provide benchmark results on the PISC dataset, and qualitatively demonstrate the efficacy of the proposed model.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

HCPLab-SYSU/SR mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Object DetectionScene ParsingScene UnderstandingVisual Social Relationship Recognitionmodelobject-detection

Datasets

Introduced by this paper, per the archive.

PISC

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Visual Social Relationship Recognition PIPA Dual-Glance Accuracy 59.6 #4 of 6 Archive leaderboard report
Visual Social Relationship Recognition PIPA Pair CNN Accuracy 58.0 #5 of 6 Archive leaderboard report
Visual Social Relationship Recognition PIPA Pair CNN Accuracy (domain) 65.9 #5 of 6 Archive leaderboard report
Visual Social Relationship Recognition PISC Dual-Glance mAP 63.2 #5 of 5 Archive leaderboard report
Visual Social Relationship Recognition PISC Dual-Glance mAP (Coarse) 79.7 #5 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections