{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/listwise-generative-retrieval-models-via-a","title":"Listwise Generative Retrieval Models via a Sequential Learning Process","arxiv_id":"2403.12499","date":"2024-03-19","proceeding":null,"authors":["Yubao Tang","Ruqing Zhang","Jiafeng Guo","Maarten de Rijke","Wei Chen","Xueqi Cheng"],"abstract":"Recently, a novel generative retrieval (GR) paradigm has been proposed, where a single sequence-to-sequence model is learned to directly generate a list of relevant document identifiers (docids) given a query. Existing GR models commonly employ maximum likelihood estimation (MLE) for optimization: this involves maximizing the likelihood of a single relevant docid given an input query, with the assumption that the likelihood for each docid is independent of the other docids in the list. We refer to these models as the pointwise approach in this paper. While the pointwise approach has been shown to be effective in the context of GR, it is considered sub-optimal due to its disregard for the fundamental principle that ranking involves making predictions about lists. In this paper, we address this limitation by introducing an alternative listwise approach, which empowers the GR model to optimize the relevance at the docid list level. Specifically, we view the generation of a ranked docid list as a sequence learning process: at each step we learn a subset of parameters that maximizes the corresponding generation likelihood of the $i$-th docid given the (preceding) top $i-1$ docids. To formalize the sequence learning process, we design a positional conditional probability for GR. To alleviate the potential impact of beam search on the generation quality during inference, we perform relevance calibration on the generation likelihood of model-generated docids according to relevance grades. We conduct extensive experiments on representative binary and multi-graded relevance datasets. Our empirical results demonstrate that our method outperforms state-of-the-art GR baselines in terms of retrieval performance.","url_abs":"https://arxiv.org/abs/2403.12499v1","url_pdf":"https://arxiv.org/pdf/2403.12499v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"listwise-generative-retrieval-models-via-a","repo_url":"https://github.com/lightningtyb/listgr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.12499","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.12499"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lightningtyb/listgr","reach":{"status":"ok"}}],"summary":{"ran":8,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":10,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"62c06ef6f483c37a","entry":"build_outputs","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/trainer.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"62c06ef6f483c37a"}},{"code_sha256_prefix":"bd2ca78177f240d9","entry":"chunk_it","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/trainer.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bd2ca78177f240d9"}},{"code_sha256_prefix":"3ba7b28af8b75e03","entry":"collate_fn","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/custom_data.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/custom_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ba7b28af8b75e03"}},{"code_sha256_prefix":"7b17172f1a55efbf","entry":"load_hash2id_all","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/data.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7b17172f1a55efbf"}},{"code_sha256_prefix":"b249cdea7660f012","entry":"load_site2domain","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/data.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b249cdea7660f012"}},{"code_sha256_prefix":"9562be8e0af789ac","entry":"make_compute_discrimination_metrics","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/trans.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/trans.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9562be8e0af789ac"}},{"code_sha256_prefix":"3bddc9b56a7d55f5","entry":"make_compute_metrics","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/trans.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/trans.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3bddc9b56a7d55f5"}},{"code_sha256_prefix":"35d582b7c8030900","entry":"make_compute_metrics_mrr","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/trans.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/trans.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"35d582b7c8030900"}},{"code_sha256_prefix":"7dfb4b3a59ee93f2","entry":"unique","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/con_loss.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/con_loss.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7dfb4b3a59ee93f2"}},{"code_sha256_prefix":"136abfa3e8ce028d","entry":"load_tf_weights_in_t5","repo":"lightningtyb/listgr","repo_kind":"official","path":"code/model.py","file_url":"https://github.com/lightningtyb/listgr/blob/HEAD/code/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"136abfa3e8ce028d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}