{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-prompt-report-a-systematic-survey-of","title":"The Prompt Report: A Systematic Survey of Prompting Techniques","arxiv_id":"2406.06608","date":"2024-06-06","proceeding":null,"authors":["Sander Schulhoff","Michael Ilie","Nishant Balepur","Konstantine Kahadze","Amanda Liu","Chenglei Si","Yinheng Li","Aayush Gupta","Hyojung Han","Sevien Schulhoff","Pranav Sandeep Dulepet","Saurav Vidyadhara","Dayeon Ki","Sweta Agrawal","Chau Pham","Gerson Kroiz","Feileen Li","Hudson Tao","Ashay Srivastava","Hevander Da Costa","Saloni Gupta","Megan L. Rogers","Inna Goncearenco","Giuseppe Sarli","Igor Galynker","Denis Peskoff","Marine Carpuat","Jules White","Shyamal Anadkat","Alexander Hoyle","Philip Resnik"],"abstract":"Generative Artificial Intelligence (GenAI) systems are increasingly being deployed across diverse industries and research domains. Developers and end-users interact with these systems through the use of prompting and prompt engineering. Although prompt engineering is a widely adopted and extensively researched area, it suffers from conflicting terminology and a fragmented ontological understanding of what constitutes an effective prompt due to its relatively recent emergence. We establish a structured understanding of prompt engineering by assembling a taxonomy of prompting techniques and analyzing their applications. We present a detailed vocabulary of 33 vocabulary terms, a taxonomy of 58 LLM prompting techniques, and 40 techniques for other modalities. Additionally, we provide best practices and guidelines for prompt engineering, including advice for prompting state-of-the-art (SOTA) LLMs such as ChatGPT. We further present a meta-analysis of the entire literature on natural language prefix-prompting. As a culmination of these efforts, this paper presents the most comprehensive survey on prompt engineering to date.","url_abs":"https://arxiv.org/abs/2406.06608v5","url_pdf":"https://arxiv.org/pdf/2406.06608v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-prompt-report-a-systematic-survey-of","repo_url":"https://github.com/trigaten/Prompt_Systematic_Review","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"the-prompt-report-a-systematic-survey-of","repo_url":"https://github.com/trigaten/the_prompt_report","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"the-prompt-report-a-systematic-survey-of","repo_url":"https://github.com/trigaten/learn_prompting","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"prompt-engineering","task_name":"Prompt Engineering"},{"task_slug":"survey","task_name":"Survey"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2406.06608","atlas_url":"https://app.syntology.ai/?focus=2406.06608","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.06608"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/trigaten/Prompt_Systematic_Review","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/trigaten/the_prompt_report","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/trigaten/learn_prompting","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":3,"unverified":2},"by_repo_kind":{"official":{"samples":5,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"7c810210b06d6018","entry":"evaluate_mmlu_response","repo":"trigaten/Prompt_Systematic_Review","repo_kind":"official","path":"src/prompt_systematic_review/experiments/benchmarking.py","file_url":"https://github.com/trigaten/Prompt_Systematic_Review/blob/HEAD/src/prompt_systematic_review/experiments/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7c810210b06d6018"}},{"code_sha256_prefix":"10114a988f110cf8","entry":"extract_predicted_answer","repo":"trigaten/Prompt_Systematic_Review","repo_kind":"official","path":"src/prompt_systematic_review/experiments/benchmarking.py","file_url":"https://github.com/trigaten/Prompt_Systematic_Review/blob/HEAD/src/prompt_systematic_review/experiments/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"10114a988f110cf8"}},{"code_sha256_prefix":"6d756b13d340f97f","entry":"move_and_rename_extracted_contents","repo":"trigaten/Prompt_Systematic_Review","repo_kind":"official","path":"src/prompt_systematic_review/experiments/download_mmlu.py","file_url":"https://github.com/trigaten/Prompt_Systematic_Review/blob/HEAD/src/prompt_systematic_review/experiments/download_mmlu.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d756b13d340f97f"}},{"code_sha256_prefix":"590036abca2df4b6","entry":"query_model","repo":"trigaten/Prompt_Systematic_Review","repo_kind":"official","path":"src/prompt_systematic_review/experiments/benchmarking.py","file_url":"https://github.com/trigaten/Prompt_Systematic_Review/blob/HEAD/src/prompt_systematic_review/experiments/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"590036abca2df4b6"}},{"code_sha256_prefix":"af498d3aa50682eb","entry":"review_abstract_title_categorical","repo":"trigaten/Prompt_Systematic_Review","repo_kind":"official","path":"src/prompt_systematic_review/automated_review.py","file_url":"https://github.com/trigaten/Prompt_Systematic_Review/blob/HEAD/src/prompt_systematic_review/automated_review.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"af498d3aa50682eb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}