{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-optimal-tree-models-under-beam","title":"Learning Optimal Tree Models Under Beam Search","arxiv_id":"2006.15408","date":"2020-06-27","proceeding":"ICML 2020 1","authors":["Jingwei Zhuo","Ziru Xu","Wei Dai","Han Zhu","Han Li","Jian Xu","Kun Gai"],"abstract":"Retrieving relevant targets from an extremely large target set under computational limits is a common challenge for information retrieval and recommendation systems. Tree models, which formulate targets as leaves of a tree with trainable node-wise scorers, have attracted a lot of interests in tackling this challenge due to their logarithmic computational complexity in both training and testing. Tree-based deep models (TDMs) and probabilistic label trees (PLTs) are two representative kinds of them. Though achieving many practical successes, existing tree models suffer from the training-testing discrepancy, where the retrieval performance deterioration caused by beam search in testing is not considered in training. This leads to an intrinsic gap between the most relevant targets and those retrieved by beam search with even the optimally trained node-wise scorers. We take a first step towards understanding and analyzing this problem theoretically, and develop the concept of Bayes optimality under beam search and calibration under beam search as general analyzing tools for this purpose. Moreover, to eliminate the discrepancy, we propose a novel algorithm for learning optimal tree models under beam search. Experiments on both synthetic and real data verify the rationality of our theoretical analysis and demonstrate the superiority of our algorithm compared to state-of-the-art methods.","url_abs":"https://arxiv.org/abs/2006.15408v1","url_pdf":"https://arxiv.org/pdf/2006.15408v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-optimal-tree-models-under-beam","repo_url":"https://github.com/massquantity/dismember","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"tasks":[{"task_slug":"information-retrieval","task_name":"Information Retrieval"},{"task_slug":"recommendation-systems","task_name":"Recommendation Systems"},{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2006.15408","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.15408"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/alibaba/x-deeplearning","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/massquantity/dismember","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"summary":{"unverified":9},"by_repo_kind":{"found_in_text":{"samples":9,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"03739f18709ea58f","entry":"bidirectional_dynamic_rnn","repo":"alibaba/x-deeplearning","repo_kind":"found_in_text","path":"xdl-algorithm-solution/DIEN/script/rnn.py","file_url":"https://github.com/alibaba/x-deeplearning/blob/HEAD/xdl-algorithm-solution/DIEN/script/rnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"03739f18709ea58f"}},{"code_sha256_prefix":"196a35647d46a1c7","entry":"dice","repo":"alibaba/x-deeplearning","repo_kind":"found_in_text","path":"xdl-algorithm-solution/DIEN/script/Dice.py","file_url":"https://github.com/alibaba/x-deeplearning/blob/HEAD/xdl-algorithm-solution/DIEN/script/Dice.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"196a35647d46a1c7"}},{"code_sha256_prefix":"e45641a9995b2bd2","entry":"dynamic_rnn","repo":"alibaba/x-deeplearning","repo_kind":"found_in_text","path":"xdl-algorithm-solution/DIEN/script/rnn.py","file_url":"https://github.com/alibaba/x-deeplearning/blob/HEAD/xdl-algorithm-solution/DIEN/script/rnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e45641a9995b2bd2"}},{"code_sha256_prefix":"88e3effeb58e908b","entry":"eval_model","repo":"alibaba/x-deeplearning","repo_kind":"found_in_text","path":"xdl-algorithm-solution/DIEN/script/model.py","file_url":"https://github.com/alibaba/x-deeplearning/blob/HEAD/xdl-algorithm-solution/DIEN/script/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"88e3effeb58e908b"}},{"code_sha256_prefix":"de1047be4a671cdf","entry":"fopen","repo":"alibaba/x-deeplearning","repo_kind":"found_in_text","path":"xdl-algorithm-solution/DIEN/script/data_iterator.py","file_url":"https://github.com/alibaba/x-deeplearning/blob/HEAD/xdl-algorithm-solution/DIEN/script/data_iterator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"de1047be4a671cdf"}},{"code_sha256_prefix":"063660b9d245fc70","entry":"parametric_relu","repo":"alibaba/x-deeplearning","repo_kind":"found_in_text","path":"xdl-algorithm-solution/DIEN/script/Dice.py","file_url":"https://github.com/alibaba/x-deeplearning/blob/HEAD/xdl-algorithm-solution/DIEN/script/Dice.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"063660b9d245fc70"}},{"code_sha256_prefix":"6a120d4cbe77264b","entry":"raw_rnn","repo":"alibaba/x-deeplearning","repo_kind":"found_in_text","path":"xdl-algorithm-solution/DIEN/script/rnn.py","file_url":"https://github.com/alibaba/x-deeplearning/blob/HEAD/xdl-algorithm-solution/DIEN/script/rnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6a120d4cbe77264b"}},{"code_sha256_prefix":"e9f3f6b349708ac1","entry":"record","repo":"alibaba/x-deeplearning","repo_kind":"found_in_text","path":"xdl-algorithm-solution/CrossMedia/script/randimg.py","file_url":"https://github.com/alibaba/x-deeplearning/blob/HEAD/xdl-algorithm-solution/CrossMedia/script/randimg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e9f3f6b349708ac1"}},{"code_sha256_prefix":"601f5dedb31ec448","entry":"unicode_to_utf8","repo":"alibaba/x-deeplearning","repo_kind":"found_in_text","path":"xdl-algorithm-solution/DIEN/script/data_iterator.py","file_url":"https://github.com/alibaba/x-deeplearning/blob/HEAD/xdl-algorithm-solution/DIEN/script/data_iterator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"601f5dedb31ec448"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}