{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/comparison-of-diverse-decoding-methods-from","title":"Comparison of Diverse Decoding Methods from Conditional Language Models","arxiv_id":"1906.06362","date":"2019-06-14","proceeding":"ACL 2019 7","authors":["Daphne Ippolito","Reno Kriz","Maria Kustikova","João Sedoc","Chris Callison-Burch"],"abstract":"While conditional language models have greatly improved in their ability to output high-quality natural language, many NLP applications benefit from being able to generate a diverse set of candidate sequences. Diverse decoding strategies aim to, within a given-sized candidate list, cover as much of the space of high-quality outputs as possible, leading to improvements for tasks that re-rank and combine candidate outputs. Standard decoding methods, such as beam search, optimize for generating high likelihood sequences rather than diverse ones, though recent work has focused on increasing diversity in these methods. In this work, we perform an extensive survey of decoding-time strategies for generating diverse outputs from conditional language models. We also show how diversity can be improved without sacrificing quality by over-sampling additional candidates, then filtering to the desired number.","url_abs":"https://arxiv.org/abs/1906.06362v1","url_pdf":"https://arxiv.org/pdf/1906.06362v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"comparison-of-diverse-decoding-methods-from","repo_url":"https://github.com/rekriz11/DeDiv","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1906.06362","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.06362"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/rekriz11/DeDiv","reach":null}],"summary":{"ran_honours":2,"ran_draft_wrong":1},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"55ebe4d0591c8d8d","entry":"eval_distinct_k","repo":"rekriz11/DeDiv","repo_kind":"official","path":"analyze_diversity.py","file_url":"https://github.com/rekriz11/DeDiv/blob/HEAD/analyze_diversity.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"55ebe4d0591c8d8d"}},{"code_sha256_prefix":"24b6fb888941b0b3","entry":"eval_emb_stats","repo":"rekriz11/DeDiv","repo_kind":"official","path":"analyze_diversity.py","file_url":"https://github.com/rekriz11/DeDiv/blob/HEAD/analyze_diversity.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"24b6fb888941b0b3"}},{"code_sha256_prefix":"0cbe28df2561237f","entry":"timeit","repo":"rekriz11/DeDiv","repo_kind":"official","path":"analyze_diversity.py","file_url":"https://github.com/rekriz11/DeDiv/blob/HEAD/analyze_diversity.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0cbe28df2561237f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}