{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/inters-unlocking-the-power-of-large-language","title":"INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning","arxiv_id":"2401.06532","date":"2024-01-12","proceeding":null,"authors":["Yutao Zhu","Peitian Zhang","Chenghao Zhang","Yifei Chen","Binyu Xie","Zheng Liu","Ji-Rong Wen","Zhicheng Dou"],"abstract":"Large language models (LLMs) have demonstrated impressive capabilities in various natural language processing tasks. Despite this, their application to information retrieval (IR) tasks is still challenging due to the infrequent occurrence of many IR-specific concepts in natural language. While prompt-based methods can provide task descriptions to LLMs, they often fall short in facilitating a comprehensive understanding and execution of IR tasks, thereby limiting LLMs' applicability. To address this gap, in this work, we explore the potential of instruction tuning to enhance LLMs' proficiency in IR tasks. We introduce a novel instruction tuning dataset, INTERS, encompassing 20 tasks across three fundamental IR categories: query understanding, document understanding, and query-document relationship understanding. The data are derived from 43 distinct datasets with manually written templates. Our empirical results reveal that INTERS significantly boosts the performance of various publicly available LLMs, such as LLaMA, Mistral, and Phi, in IR tasks. Furthermore, we conduct extensive experiments to analyze the effects of instruction design, template diversity, few-shot demonstrations, and the volume of instructions on performance. We make our dataset and the fine-tuned models publicly accessible at https://github.com/DaoD/INTERS.","url_abs":"https://arxiv.org/abs/2401.06532v3","url_pdf":"https://arxiv.org/pdf/2401.06532v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"inters-unlocking-the-power-of-large-language","repo_url":"https://github.com/daod/inters","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"information-retrieval","task_name":"Information Retrieval"},{"task_slug":"model-selection","task_name":"Model Selection"},{"task_slug":"retrieval","task_name":"Retrieval"},{"task_slug":"document-understanding","task_name":"document understanding"}],"methods":[{"method_slug":"base","method_name":"BASE"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2401.06532","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2401.06532"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/DaoD/INTERS","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3,"unverified":2},"by_repo_kind":{"official":{"samples":5,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"df02a4d06d5ad0f2","entry":"makedirs","repo":"DaoD/INTERS","repo_kind":"official","path":"evaluation/qdu-tasks/src/utils.py","file_url":"https://github.com/DaoD/INTERS/blob/HEAD/evaluation/qdu-tasks/src/utils.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df02a4d06d5ad0f2"}},{"code_sha256_prefix":"09c88bc1a2c9564a","entry":"split_file_dir_name_ext","repo":"DaoD/INTERS","repo_kind":"official","path":"evaluation/qdu-tasks/src/utils.py","file_url":"https://github.com/DaoD/INTERS/blob/HEAD/evaluation/qdu-tasks/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09c88bc1a2c9564a"}},{"code_sha256_prefix":"5cf8f57b0919504b","entry":"truncate","repo":"DaoD/INTERS","repo_kind":"official","path":"evaluation/qdu-tasks/eval_rerank.py","file_url":"https://github.com/DaoD/INTERS/blob/HEAD/evaluation/qdu-tasks/eval_rerank.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5cf8f57b0919504b"}},{"code_sha256_prefix":"74dab428120d8998","entry":"get_max_length_in_nested_lists","repo":"DaoD/INTERS","repo_kind":"official","path":"evaluation/qdu-tasks/src/utils.py","file_url":"https://github.com/DaoD/INTERS/blob/HEAD/evaluation/qdu-tasks/src/utils.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"74dab428120d8998"}},{"code_sha256_prefix":"a5ceb4dcfea73278","entry":"get_model_and_tokenizer","repo":"DaoD/INTERS","repo_kind":"official","path":"evaluation/qdu-tasks/src/modeling.py","file_url":"https://github.com/DaoD/INTERS/blob/HEAD/evaluation/qdu-tasks/src/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5ceb4dcfea73278"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}