{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/distort-distract-decode-instruction-tuned","title":"Instructive Decoding: Instruction-Tuned Large Language Models are Self-Refiner from Noisy Instructions","arxiv_id":"2311.00233","date":"2023-11-01","proceeding":null,"authors":["Taehyeon Kim","Joonkee Kim","Gihun Lee","Se-Young Yun"],"abstract":"While instruction-tuned language models have demonstrated impressive zero-shot generalization, these models often struggle to generate accurate responses when faced with instructions that fall outside their training set. This paper presents Instructive Decoding (ID), a simple yet effective approach that augments the efficacy of instruction-tuned models. Specifically, ID adjusts the logits for next-token prediction in a contrastive manner, utilizing predictions generated from a manipulated version of the original instruction, referred to as a noisy instruction. This noisy instruction aims to elicit responses that could diverge from the intended instruction yet remain plausible. We conduct experiments across a spectrum of such noisy instructions, ranging from those that insert semantic noise via random words to others like 'opposite' that elicit the deviated responses. Our approach achieves considerable performance gains across various instruction-tuned models and tasks without necessitating any additional parameter updates. Notably, utilizing 'opposite' as the noisy instruction in ID, which exhibits the maximum divergence from the original instruction, consistently produces the most significant performance gains across multiple models and tasks.","url_abs":"https://arxiv.org/abs/2311.00233v2","url_pdf":"https://arxiv.org/pdf/2311.00233v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"distort-distract-decode-instruction-tuned","repo_url":"https://github.com/joonkeekim/Instructive-Decoding","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"few-shot-nli","task_name":"Few-Shot NLI"},{"task_slug":"instruction-following","task_name":"Instruction Following"},{"task_slug":"natural-language-understanding","task_name":"Natural Language Understanding"},{"task_slug":"zero-shot-generalization","task_name":"Zero-shot Generalization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2311.00233","atlas_url":"https://app.syntology.ai/?focus=2311.00233","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.00233"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/joonkeekim/Instructive-Decoding","reach":null}],"summary":{"unverified":2},"by_repo_kind":{"official":{"samples":2,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"ab6e902ea840d9eb","entry":"Generator","repo":"joonkeekim/Instructive-Decoding","repo_kind":"official","path":"src/sni_generator.py","file_url":"https://github.com/joonkeekim/Instructive-Decoding/blob/HEAD/src/sni_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ab6e902ea840d9eb"}},{"code_sha256_prefix":"55632733bed873ee","entry":"SniGenerator","repo":"joonkeekim/Instructive-Decoding","repo_kind":"official","path":"src/sni_generator.py","file_url":"https://github.com/joonkeekim/Instructive-Decoding/blob/HEAD/src/sni_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"55632733bed873ee"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}