{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/repository-level-prompt-generation-for-large","title":"Repository-Level Prompt Generation for Large Language Models of Code","arxiv_id":"2206.12839","date":"2022-06-26","proceeding":null,"authors":["Disha Shrivastava","Hugo Larochelle","Daniel Tarlow"],"abstract":"With the success of large language models (LLMs) of code and their use as code assistants (e.g. Codex used in GitHub Copilot), techniques for introducing domain-specific knowledge in the prompt design process become important. In this work, we propose a framework called Repo-Level Prompt Generator that learns to generate example-specific prompts using prompt proposals. The prompt proposals take context from the entire repository, thereby incorporating both the structure of the repository and the context from other relevant files (e.g. imports, parent class files). Our technique doesn't require any access to the weights of the LLM, making it applicable in cases where we only have black-box access to the LLM. We conduct experiments on the task of single-line code-autocompletion using code repositories taken from Google Code archives. We demonstrate that an oracle constructed from our prompt proposals gives a remarkably high relative improvement of 36% over Codex, showing the quality of these proposals. Further, we show that when we train a model to predict a prompt proposal, we can achieve significant performance gains over Codex and other baselines. We release our code, data, and trained checkpoints at: \\url{https://github.com/shrivastavadisha/repo_level_prompt_generation}.","url_abs":"https://arxiv.org/abs/2206.12839v3","url_pdf":"https://arxiv.org/pdf/2206.12839v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"repository-level-prompt-generation-for-large","repo_url":"https://github.com/shrivastavadisha/repo_level_prompt_generation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2206.12839","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2206.12839"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/shrivastavadisha/repo_level_prompt_generation","reach":null}],"summary":{"ran":1,"ran_draft_wrong":2,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d45240153f12f419","entry":"getContext","repo":"shrivastavadisha/repo_level_prompt_generation","repo_kind":"official","path":"context.py","file_url":"https://github.com/shrivastavadisha/repo_level_prompt_generation/blob/HEAD/context.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d45240153f12f419"}},{"code_sha256_prefix":"177a8218c0d26146","entry":"get_accuracy","repo":"shrivastavadisha/repo_level_prompt_generation","repo_kind":"official","path":"rule_classifier_preprocessed_data.py","file_url":"https://github.com/shrivastavadisha/repo_level_prompt_generation/blob/HEAD/rule_classifier_preprocessed_data.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"177a8218c0d26146"}},{"code_sha256_prefix":"424eba856a96c926","entry":"get_prediction","repo":"shrivastavadisha/repo_level_prompt_generation","repo_kind":"official","path":"rule_classifier_preprocessed_data.py","file_url":"https://github.com/shrivastavadisha/repo_level_prompt_generation/blob/HEAD/rule_classifier_preprocessed_data.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"424eba856a96c926"}},{"code_sha256_prefix":"52537942ad763c95","entry":"calculate_loss","repo":"shrivastavadisha/repo_level_prompt_generation","repo_kind":"official","path":"rule_classifier_preprocessed_data.py","file_url":"https://github.com/shrivastavadisha/repo_level_prompt_generation/blob/HEAD/rule_classifier_preprocessed_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"52537942ad763c95"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}