Papers › Detecting Visual Relationships with Deep Relational Networks

Detecting Visual Relationships with Deep Relational Networks

11 Apr 2017CVPR 2017 7arXiv:1704.03114archive 2025-07-28

Bo Dai, Yuqi Zhang, Dahua Lin

Relationships among objects play a crucial role in image understanding. Despite the great success of deep learning techniques in recognizing individual objects, reasoning about the relationships among objects remains a challenging task. Previous methods often treat this as a classification problem, considering each type of relationship (e.g. "ride") or each distinct visual phrase (e.g. "person-ride-horse") as a category. Such approaches are faced with significant difficulties caused by the high diversity of visual appearance for each kind of relationships or the large number of distinct visual phrases. We propose an integrated framework to tackle this problem. At the heart of this framework is the Deep Relational Network, a novel formulation designed specifically for exploiting the statistical dependencies between objects and their relationships. On two large datasets, the proposed method achieves substantial improvement over state-of-the-art.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

doubledaibo/drnet officialmentioned in papermentioned on GitHubcaffe2 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DiversityGeneral Classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Visual Relationship Detection VRD Phrase Detection Dai et. al [[Dai, Zhang, and Lin2017]] R@100 23.45 #3 of 7 Archive leaderboard report
Visual Relationship Detection VRD Phrase Detection Dai et. al [[Dai, Zhang, and Lin2017]] R@50 19.93 #3 of 7 Archive leaderboard report
Visual Relationship Detection VRD Predicate Detection Dai et. al [[Dai, Zhang, and Lin2017]] R@100 81.90 #4 of 7 Archive leaderboard report
Visual Relationship Detection VRD Predicate Detection Dai et. al [[Dai, Zhang, and Lin2017]] R@50 80.78 #4 of 7 Archive leaderboard report
Visual Relationship Detection VRD Relationship Detection Dai et. al [[Dai, Zhang, and Lin2017]] R@100 20.88 #4 of 8 Archive leaderboard report
Visual Relationship Detection VRD Relationship Detection Dai et. al [[Dai, Zhang, and Lin2017]] R@50 17.73 #4 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections