{"url":"/dataset/sims4action","name":"Sims4Action","full_name":null,"description_markdown":"* **The Sims4Action Dataset**: a videogame-based dataset for Synthetic→Real domain adaptation for human activity recognition.\r\n\r\n* **Goal** : Exploring the concept of constructing training examples for Activities of Daily Living (ADL) recognition by playing life simulation video games.  \r\n* ** ***Sims4Action*  dataset** is created with the commercial game THE SIMS 4**   by executing actions-of-interest within the game in a \"top-down\" manner. It features ten hours of video material of eight diverse characters and multiple environments.  Ten actions are selected to have a direct correspondence to categories covered in the real-life dataset Toyota Smarthome [2] to enable the research of Synthetic→Real transfer in action recognition.\r\n* **Two benchmarks** :* Gaming→Gaming* (training and evaluation on Sims4Action)  and *Gaming→Real* (training on Sims4Action, evaluation on the real Toyota Smarthome data [2]).\r\n* **Main challenge: *Gaming→Real* domain adaptation**  \r\n  While ADL recognition on gaming data is interesting from a theoretical perspective, the key challenge arises from transferring knowledge learned from simulated data to real-world applications. *Sims4Action* specifically provides a benchmark for this scenario since it describes a *Gaming→Real* challenge, which evaluates models on real videos derived from the existing Toyota Smarthome dataset . \r\n\r\n# References \r\n\r\n[1] [Let's Play for Action: Recognizing Activities of Daily Living by Learning from Life Simulation Video Games.](http://arxiv.org/abs/2107.05617\r\n)\r\nAlina Roitberg*, David Schneider*, Aulia Djamal, Constantin Seibold, Simon Reiß, Rainer Stiefelhagen,\r\nIn *International Conference on Intelligent Robots and Systems (IROS)*, 2021\r\n(* denotes equal contribution.)\r\n\r\n[2] [Toyota smarthome: Real-world activities of daily living.](https://arxiv.org/pdf/2010.14982.pdf)\r\nSrijan Das, Rui Dai, Michal Koperski, Luca Minciullo, Lorenzo Garattoni, Francois Bremond, Gianpiero Francesca,\r\nIn *International Conference on Computer Vision (ICCV)*, 2019.","description_withheld":null,"homepage":"https://github.com/aroitberg/sims4action","introduced_date":"2021-07-12","introduced_date_note":null,"introduced_by":{"paper":"/paper/let-s-play-for-action-recognizing-activities","title":"Let's Play for Action: Recognizing Activities of Daily Living by Learning from Life Simulation Video Games","first_author":"Alina Roitberg","url":null},"license":null,"modalities":[{"name":"Videos","url":"/datasets/modality/videos"},{"name":"Actions","url":"/datasets/modality/actions"}],"tasks":[{"name":"Activity Recognition","url":"/task/activity-recognition","datasets_with_task":"/datasets/task/activity-recognition"},{"name":"Domain Adaptation","url":"/task/domain-adaptation","datasets_with_task":"/datasets/task/domain-adaptation"},{"name":"Unsupervised Domain Adaptation","url":"/task/unsupervised-domain-adaptation","datasets_with_task":"/datasets/task/unsupervised-domain-adaptation"},{"name":"Action Classification","url":"/task/action-classification","datasets_with_task":"/datasets/task/action-classification"},{"name":"Domain Generalization","url":"/task/domain-generalization","datasets_with_task":"/datasets/task/domain-generalization"},{"name":"Transfer Learning","url":"/task/transfer-learning","datasets_with_task":"/datasets/task/transfer-learning"},{"name":"Synthetic-to-Real Translation","url":"/task/synthetic-to-real-translation","datasets_with_task":"/datasets/task/synthetic-to-real-translation"}],"languages":[],"variants":["Sims4Action"],"data_loaders":[],"num_papers_in_archive":5,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}