{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/can-language-models-make-fun-a-case-study-in","title":"Can Language Models Make Fun? A Case Study in Chinese Comical Crosstalk","arxiv_id":"2207.00735","date":"2022-07-02","proceeding":null,"authors":["Benyou Wang","Xiangbo Wu","Xiaokang Liu","Jianquan Li","Prayag Tiwari","Qianqian Xie"],"abstract":"Language is the principal tool for human communication, in which humor is one of the most attractive parts. Producing natural language like humans using computers, a.k.a, Natural Language Generation (NLG), has been widely used for dialogue systems, chatbots, machine translation, as well as computer-aid creation e.g., idea generations, scriptwriting. However, the humor aspect of natural language is relatively under-investigated, especially in the age of pre-trained language models. In this work, we aim to preliminarily test whether NLG can generate humor as humans do. We build a new dataset consisting of numerous digitized Chinese Comical Crosstalk scripts (called C$^3$ in short), which is for a popular Chinese performing art called `Xiangsheng' since 1800s. (For convenience for non-Chinese speakers, we called `crosstalk' for `Xiangsheng' in this paper.) We benchmark various generation approaches including training-from-scratch Seq2seq, fine-tuned middle-scale PLMs, and large-scale PLMs (with and without fine-tuning). Moreover, we also conduct a human assessment, showing that 1) large-scale pretraining largely improves crosstalk generation quality; and 2) even the scripts generated from the best PLM is far from what we expect, with only 65% quality of human-created crosstalk. We conclude, humor generation could be largely improved using large-scaled PLMs, but it is still in its infancy. The data and benchmarking code is publicly available in \\url{https://github.com/anonNo2/crosstalk-generation}.","url_abs":"https://arxiv.org/abs/2207.00735v1","url_pdf":"https://arxiv.org/pdf/2207.00735v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"can-language-models-make-fun-a-case-study-in","repo_url":"https://github.com/anonno2/crosstalk-generation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"machine-translation","task_name":"Machine Translation"},{"task_slug":"text-generation","task_name":"Text Generation"}],"methods":[{"method_slug":"test","method_name":"Test"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2207.00735","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.00735"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/anonNo2/crosstalk-generation","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/anonno2/crosstalk-generation","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":13},"by_repo_kind":{"official":{"samples":13,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"fa46445bbe1d057f","entry":"annotate_heatmap","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/beta_code/muti_heatmap_demo.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/beta_code/muti_heatmap_demo.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fa46445bbe1d057f"}},{"code_sha256_prefix":"e825114d21a034f8","entry":"calculate_bleu_score","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/beta_code/machine_metrics.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/beta_code/machine_metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e825114d21a034f8"}},{"code_sha256_prefix":"3c24b85f295e82cd","entry":"calculate_gleu_score","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/beta_code/machine_metrics.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/beta_code/machine_metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3c24b85f295e82cd"}},{"code_sha256_prefix":"de1c559ab62ebfd7","entry":"calculate_meteor_score","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/beta_code/machine_metrics.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/beta_code/machine_metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"de1c559ab62ebfd7"}},{"code_sha256_prefix":"0d27332b2704f923","entry":"correlation","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/beta_code/indicator_correlation.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/beta_code/indicator_correlation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0d27332b2704f923"}},{"code_sha256_prefix":"a1b8c9fce8bf2bc6","entry":"create_logger","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/cpm/generate_eval_data.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/cpm/generate_eval_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a1b8c9fce8bf2bc6"}},{"code_sha256_prefix":"97f913018bc28b19","entry":"func","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/beta_code/muti_heatmap_demo.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/beta_code/muti_heatmap_demo.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"97f913018bc28b19"}},{"code_sha256_prefix":"668443ea1a908473","entry":"generate_text_by_input","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/cpm/generate_eval_data.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/cpm/generate_eval_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"668443ea1a908473"}},{"code_sha256_prefix":"a9865f96feffb830","entry":"heatmap","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/beta_code/muti_heatmap_demo.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/beta_code/muti_heatmap_demo.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a9865f96feffb830"}},{"code_sha256_prefix":"69598ced7806d8c3","entry":"scatter","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/gpt/data_parallel.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/gpt/data_parallel.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"69598ced7806d8c3"}},{"code_sha256_prefix":"aa1de448b0528802","entry":"scatter_kwargs","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/gpt/data_parallel.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/gpt/data_parallel.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"aa1de448b0528802"}},{"code_sha256_prefix":"db65515177159aa1","entry":"single_model_print","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/beta_code/matlibplot_heatmap.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/beta_code/matlibplot_heatmap.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"db65515177159aa1"}},{"code_sha256_prefix":"6f5ddea9dd9cffbb","entry":"top_k_top_p_filtering","repo":"anonNo2/crosstalk-generation","repo_kind":"official","path":"src/cpm/generate_eval_data.py","file_url":"https://github.com/anonNo2/crosstalk-generation/blob/HEAD/src/cpm/generate_eval_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6f5ddea9dd9cffbb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}