{"url":"/dataset/fewglue-64-labeled","name":"FewGLUE_64_labeled","full_name":"A new version of FewGLUE with 64 training examples","description_markdown":"### Introduction\r\nThe FewGLUE_64_labeled dataset is a new version of FewGLUE dataset. It contains a 64-sample training set, a development set (the original SuperGLUE development set), a test set, and an unlabeled set. It is constructed to facilitate the research of few-shot learning for natural language understanding tasks.\r\n\r\nCompared with the original FewGLUE dataset, it differs in the number of labeled data examples in the training set, where the original FewGLUE has 32 training examples while FewGLUE_64_labeled has 64 labeled examples. Purposes for constructing a new version of FewGLUE dataset include:\r\n\r\n1. To answer the questions that what is the best performance that few-shot learning can achieve and whether it is possible to further close the performance gap between few-shot learning and fully-supervised systems.\r\n\r\n2. To explore to which degree the number of labeled training examples influences the few-shot performance.\r\n\r\nPlease refer to the [FewNLU paper](https://arxiv.org/pdf/2109.12742.pdf) as well as the [FewNLU leaderboard](fewnlu.github.io) for more details.\r\n\r\n### Acknowledgement\r\nPart of the FewGLUE_64_labeled dataset is based on the original 32-sample version of [FewGLUE](https://github.com/timoschick/fewglue). We collect them together in one package for the convenience of usage. We appreciate all the contributors who made their dataset public, which greatly advanced few-shot learning as well as the [FewNLU project](https://github.com/THUDM/FewNLU).","description_withheld":null,"homepage":"https://cloud.tsinghua.edu.cn/f/03b187bf3fff4a5fb1d1/?dl=1","introduced_date":"2021-09-27","introduced_date_note":null,"introduced_by":{"paper":"/paper/fewnlu-benchmarking-state-of-the-art-methods","title":"FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding","first_author":"Yanan Zheng","url":null},"license":null,"modalities":[{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[{"name":"Few-Shot Learning","url":"/task/few-shot-learning","datasets_with_task":"/datasets/task/few-shot-learning"},{"name":"Natural Language Understanding","url":"/task/natural-language-understanding","datasets_with_task":"/datasets/task/natural-language-understanding"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["FewGLUE_64_labeled"],"data_loaders":[],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}