{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-domain-based-approach-to-social-relation","title":"A Domain Based Approach to Social Relation Recognition","arxiv_id":"1704.06456","date":"2017-04-21","proceeding":"CVPR 2017 7","authors":["Qianru Sun","Bernt Schiele","Mario Fritz"],"abstract":"Social relations are the foundation of human daily life. Developing\ntechniques to analyze such relations from visual data bears great potential to\nbuild machines that better understand us and are capable of interacting with us\nat a social level. Previous investigations have remained partial due to the\noverwhelming diversity and complexity of the topic and consequently have only\nfocused on a handful of social relations. In this paper, we argue that the\ndomain-based theory from social psychology is a great starting point to\nsystematically approach this problem. The theory provides coverage of all\naspects of social relations and equally is concrete and predictive about the\nvisual attributes and behaviors defining the relations included in each domain.\nWe provide the first dataset built on this holistic conceptualization of social\nlife that is composed of a hierarchical label space of social domains and\nsocial relations. We also contribute the first models to recognize such domains\nand relations and find superior performance for attribute based features.\nBeyond the encouraging performance of the attribute based approach, we also\nfind interpretable features that are in accordance with the predictions from\nsocial psychology literature. Beyond our findings, we believe that our\ncontributions more tightly interleave visual recognition and social psychology\ntheory that has the potential to complement the theoretical work in the area\nwith empirical and data-driven models of social life.","url_abs":"http://arxiv.org/abs/1704.06456v1","url_pdf":"http://arxiv.org/pdf/1704.06456v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-domain-based-approach-to-social-relation","repo_url":"https://github.com/HCPLab-SYSU/SR","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":null,"task_name":"Relation"},{"task_slug":"visual-social-relationship-recognition","task_name":"Visual Social Relationship Recognition"}],"methods":[],"datasets_introduced":[{"slug":"pipa","name":"PIPA","full_name":"People in Photo Album"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/visual-social-relationship-recognition-on-1","task":"Visual Social Relationship Recognition","dataset":"PIPA","model":"All attributes + SVM","rank_in_archive_order":6,"of":6,"metrics":{"Accuracy":"57.2","Accuracy (domain)":"67.8"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=1704.06456","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}