{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/deepdiary-automatic-caption-generation-for","title":"DeepDiary: Automatic Caption Generation for Lifelogging Image Streams","arxiv_id":"1608.03819","date":"2016-08-12","proceeding":null,"authors":["Chenyou Fan","David J. Crandall"],"abstract":"Lifelogging cameras capture everyday life from a first-person perspective,\nbut generate so much data that it is hard for users to browse and organize\ntheir image collections effectively. In this paper, we propose to use automatic\nimage captioning algorithms to generate textual representations of these\ncollections. We develop and explore novel techniques based on deep learning to\ngenerate captions for both individual images and image streams, using temporal\nconsistency constraints to create summaries that are both more compact and less\nnoisy. We evaluate our techniques with quantitative and qualitative results,\nand apply captioning to an image retrieval application for finding potentially\nprivate images. Our results suggest that our automatic captioning algorithms,\nwhile imperfect, may work well enough to help users manage lifelogging photo\ncollections.","url_abs":"http://arxiv.org/abs/1608.03819v1","url_pdf":"http://arxiv.org/pdf/1608.03819v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deepdiary-automatic-caption-generation-for","repo_url":"https://github.com/fanchenyou/deepdiary","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"caption-generation","task_name":"Caption Generation"},{"task_slug":"image-captioning","task_name":"Image Captioning"},{"task_slug":"image-retrieval","task_name":"Image Retrieval"},{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}