{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/toyota-smarthome-real-world-activities-of","title":"Toyota Smarthome: Real-World Activities of Daily Living","arxiv_id":null,"date":"2019-10-01","proceeding":"ICCV 2019 10","authors":["Srijan Das"," Rui Dai"," Michal Koperski"," Luca Minciullo"," Lorenzo Garattoni"," Francois Bremond"," Gianpiero Francesca"],"abstract":"The performance of deep neural networks is strongly influenced by the quantity and quality of annotated data. Most of the large activity recognition datasets consist of data sourced from the web, which does not reflect challenges that exist in activities of daily living. In this paper, we introduce a large real-world video dataset for activities of daily living: Toyota Smarthome. The dataset consists of 16K RGB+D clips of 31 activity classes, performed by seniors in a smarthome. Unlike previous datasets, videos were fully unscripted. As a result, the dataset poses several challenges: high intra-class variation, high class imbalance, simple and composite activities, and activities with similar motion and variable duration. Activities were annotated with both coarse and fine-grained labels. These characteristics differentiate Toyota Smarthome from other datasets for activity recognition. As recent activity recognition approaches fail to address the challenges posed by Toyota Smarthome, we present a novel activity recognition method with attention mechanism. We propose a pose driven spatio-temporal attention mechanism through 3D ConvNets. We show that our novel method outperforms state-of-the-art methods on benchmark datasets, as well as on the Toyota Smarthome dataset. We release the dataset for research use.\r","url_abs":"http://openaccess.thecvf.com/content_ICCV_2019/html/Das_Toyota_Smarthome_Real-World_Activities_of_Daily_Living_ICCV_2019_paper.html","url_pdf":"http://openaccess.thecvf.com/content_ICCV_2019/papers/Das_Toyota_Smarthome_Real-World_Activities_of_Daily_Living_ICCV_2019_paper.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"16k","task_name":"16k"},{"task_slug":"action-classification","task_name":"Action Classification"},{"task_slug":"activity-recognition","task_name":"Activity Recognition"}],"methods":[],"datasets_introduced":[{"slug":"toyota-smarthome-dataset","name":"Toyota Smarthome dataset","full_name":"Toyota Smarthome Trimmed"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-classification-on-toyota-smarthome","task":"Action Classification","dataset":"Toyota Smarthome dataset","model":"Separable STA (RGB + Pose)","rank_in_archive_order":8,"of":13,"metrics":{"CS":"54.2","CV1":"35.2","CV2":"50.3"},"uses_additional_data":true}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}