{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/photochat-a-human-human-dialogue-dataset-with","title":"PhotoChat: A Human-Human Dialogue Dataset with Photo Sharing Behavior for Joint Image-Text Modeling","arxiv_id":"2108.01453","date":"2021-07-06","proceeding":"ACL 2021 5","authors":["Xiaoxue Zang","Lijuan Liu","Maria Wang","Yang song","Hao Zhang","Jindong Chen"],"abstract":"We present a new human-human dialogue dataset - PhotoChat, the first dataset that casts light on the photo sharing behavior in onlin emessaging. PhotoChat contains 12k dialogues, each of which is paired with a user photo that is shared during the conversation. Based on this dataset, we propose two tasks to facilitate research on image-text modeling: a photo-sharing intent prediction task that predicts whether one intends to share a photo in the next conversation turn, and a photo retrieval task that retrieves the most relevant photo according to the dialogue context. In addition, for both tasks, we provide baseline models using the state-of-the-art models and report their benchmark performances. The best image retrieval model achieves 10.4% recall@1 (out of 1000 candidates) and the best photo intent prediction model achieves 58.1% F1 score, indicating that the dataset presents interesting yet challenging real-world problems. We are releasing PhotoChat to facilitate future research work among the community.","url_abs":"https://arxiv.org/abs/2108.01453v1","url_pdf":"https://arxiv.org/pdf/2108.01453v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"image-retrieval","task_name":"Image Retrieval"},{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[{"slug":"photochat","name":"PhotoChat","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-retrieval-on-photochat","task":"Image Retrieval","dataset":"PhotoChat","model":"DE++","rank_in_archive_order":5,"of":5,"metrics":{"R1":"9.0","R@10":"35.7","R@5":"26.4","Sum(R@1,5,10)":"71.1"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2108.01453","atlas_url":"https://app.syntology.ai/?focus=2108.01453","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}