{"url":"/dataset/notebookcdg","name":"notebookcdg","full_name":null,"description_markdown":"Inspired by Wang et al. 2021, we decided to utilize the top-voted and well-documented Kaggle notebooks to construct the notebookCDGdataset\r\n\r\nWe collected the top 10% highly-voted notebooks from the top 20 popular competitions on Kaggle (e.g. Titanic). We checked the data policy of each of the 20 competitions, none of them has copyright issues. We also contacted the Kaggle administrators to make sure our data collection complies with the platform’s policy.\r\n\r\nIn total, we collected 3,944 notebooks as raw data. After data preprocessing, the final dataset contains 2,476 notebooks out of the 3,944 notebooks from the raw data. It has 28,625 code–documentation pairs. The overall code-to-markdown ratio is 2.2195\r\n\r\n[Download *notebookCDG* dataset](https://www.dropbox.com/s/vpsst1el7f0jqo6/data_notebookcdg.pkl?dl=0)","description_withheld":null,"homepage":"https://github.com/dakuo/haconvgnn","introduced_date":"2021-03-31","introduced_date_note":null,"introduced_by":{"paper":"/paper/haconvgnn-hierarchical-attention-based","title":"HAConvGNN: Hierarchical Attention Based Convolutional Graph Neural Network for Code Documentation Generation in Jupyter Notebooks","first_author":"Xuye Liu","url":null},"license":{"name":"CC-BY","url":null},"modalities":[{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[{"name":"Code Documentation Generation","url":"/task/code-documentation-generation","datasets_with_task":"/datasets/task/code-documentation-generation"},{"name":"Code Comment Generation","url":"/task/code-comment-generation","datasets_with_task":"/datasets/task/code-comment-generation"},{"name":"Code Summarization","url":"/task/code-summarization-1","datasets_with_task":"/datasets/task/code-summarization-1"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["notebookcdg"],"data_loaders":[],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-25T09:33:49+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}