{"url":"/dataset/multimedia-goal-oriented-generative-script","name":"Multimedia Goal-oriented Generative Script Learning Dataset","full_name":null,"description_markdown":"[Multimedia Goal-oriented Generative Script Learning Dataset](https://drive.google.com/file/d/1lSo-Kr4edNas0_uTl1SvDnEGuPYl0Or9/view?usp=sharing) \r\nThis link contains a dataset consisting of multimedia steps for two categories: gardening and crafts. The dataset consists of a total of 79,089 multimedia steps across 5,652 tasks.\r\n\r\nThe dataset is split into three sets: training, development, and testing. The gardening category has 20,258 training tasks, 2,428 development tasks, and 2,684 testing tasks. The crafts category has 32,082 training tasks, 4,064 development tasks, and 3,937 testing tasks. Each task is associated with a set of multimedia steps, which include corresponding step images related to the task. \r\n\r\nThe `*_data` folder contains the full dataset, which will be released after the paper is published. Each `*_data` folder includes three files: `train.json`, `valid.json`, and `test.json`. These files are used for training, validation, and testing respectively.\r\n\r\nEach file is a JSON file that contains multiple lines. Each line represents an instance and follows the schema described below:\r\n\r\n```python\r\n{\r\n    \"title\":        #   goal of activity\r\n    \"method\":       #   subgoal of activity\r\n    \"steps\":        #   list of step text \r\n    \"captions\":     #   list of corresponding captions of step\r\n    \"target\":       #   next step text\r\n    \"img\":          #   last step image id\r\n    \"target_img\":   #   next step image id\r\n    \"retrieve\":     #   20 retrieved historical relevant steps\r\n    \"retrieve_neg\": #   list of retrieved top-20 most similar steps with respect to the last step. They will serve as retrieve-negatives \r\n    }\r\n```\r\n\r\nThe `img` subfolder in the `*_data` folder contains all images and the corresponding wikihow task json file for the gardening and crafts datasets.","description_withheld":null,"homepage":"https://github.com/EagleW/Multimedia-Generative-Script-Learning-for-Task-Planning","introduced_date":"2022-08-25","introduced_date_note":null,"introduced_by":{"paper":"/paper/multimedia-generative-script-learning-for","title":"Multimedia Generative Script Learning for Task Planning","first_author":"Qingyun Wang","url":null},"license":{"name":"MIT","url":null},"modalities":[{"name":"Images","url":"/datasets/modality/images"},{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["Multimedia Goal-oriented Generative Script Learning Dataset"],"data_loaders":[],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}