{"url":"/method/sc-gpt","slug":"sc-gpt","name":"SC-GPT","full_name":"SC-GPT","full_name_withheld":false,"description_markdown":"**SC-GPT** is a multi-layer [Transformer](http://paperswithcode.com/method/transformer) neural language model, trained in three steps: (i) Pre-trained on plain text, similar to [GPT-2](http://paperswithcode.com/method/gpt-2); (ii) Continuously pretrained on large amounts of dialog-act labeled utterances corpora to acquire the ability of controllable generation; (iii) Fine-tuned for a target domain using very limited amounts of domain labels. Unlike [GPT-2](http://paperswithcode.com/method/gpt-2), SC-GPT generates semantically controlled responses that are conditioned on the given semantic form, similar to SC-[LSTM](https://paperswithcode.com/method/lstm) but requiring much less domain labels to generalize to new domains. It is pre-trained on a large set of annotated NLG corpus to acquire the controllable generation ability, and fine-tuned with only a few domain-specific labels to adapt to new domains.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Few-shot Natural Language Generation for Task-Oriented Dialog","paper":"/paper/few-shot-natural-language-generation-for-task","first_author":"Baolin Peng","n_authors":7,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/few-shot-natural-language-generation-for-task"},"source":{"url":"https://arxiv.org/abs/2002.12328v1","title":"Few-shot Natural Language Generation for Task-Oriented Dialog","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Natural Language Processing","area_id":"natural-language-processing","collection":"Transformers","url":"/methods/category/transformers","pwc_aliases":[]}],"n_papers_tagged":1,"archive_num_papers":1,"papers_newest_first":[{"paper":"/paper/few-shot-natural-language-generation-for-task","title":"Few-shot Natural Language Generation for Task-Oriented Dialog","date":"2020-02-27","arxiv_id":"2002.12328","n_code_links":2,"syntology":null}],"papers_shown":1,"tasks":[{"task":"/task/data-to-text-generation","name":"Data-to-Text Generation","papers":1},{"task":"/task/few-shot-learning","name":"Few-Shot Learning","papers":1},{"task":"/task/text-generation","name":"Text Generation","papers":1}],"tasks_shown":3,"n_tasks":3,"usage_by_year":[{"year":"2020","papers":1}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/sc-gpt"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}