{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/detext-a-deep-text-ranking-framework-with","title":"DeText: A Deep Text Ranking Framework with BERT","arxiv_id":"2008.02460","date":"2020-08-06","proceeding":null,"authors":["Weiwei Guo","Xiao-Wei Liu","Sida Wang","Huiji Gao","Ananth Sankar","Zimeng Yang","Qi Guo","Liang Zhang","Bo Long","Bee-Chung Chen","Deepak Agarwal"],"abstract":"Ranking is the most important component in a search system. Mostsearch systems deal with large amounts of natural language data,hence an effective ranking system requires a deep understandingof text semantics. Recently, deep learning based natural languageprocessing (deep NLP) models have generated promising results onranking systems. BERT is one of the most successful models thatlearn contextual embedding, which has been applied to capturecomplex query-document relations for search ranking. However,this is generally done by exhaustively interacting each query wordwith each document word, which is inefficient for online servingin search product systems. In this paper, we investigate how tobuild an efficient BERT-based ranking model for industry use cases.The solution is further extended to a general ranking framework,DeText, that is open sourced and can be applied to various rankingproductions. Offline and online experiments of DeText on threereal-world search systems present significant improvement overstate-of-the-art approaches.","url_abs":"https://arxiv.org/abs/2008.02460v1","url_pdf":"https://arxiv.org/pdf/2008.02460v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"detext-a-deep-text-ranking-framework-with","repo_url":"https://github.com/linkedin/detext","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"BSD-2-Clause"}}],"tasks":[],"methods":[{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"attention-dropout","method_name":"Attention Dropout"},{"method_slug":"bert","method_name":"BERT"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"linear-warmup-with-linear-decay","method_name":"Linear Warmup With Linear Decay"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"weight-decay","method_name":"Weight Decay"},{"method_slug":"wordpiece","method_name":"WordPiece"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2008.02460","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.02460"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/linkedin/detext","reach":{"status":"ok","spdx":"BSD-2-Clause"}}],"summary":{"unverified":7},"by_repo_kind":{"official":{"samples":7,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"b75e09919639454f","entry":"apply_cnn_on_text","repo":"linkedin/detext","repo_kind":"official","path":"src/detext/layers/cnn_layer.py","file_url":"https://github.com/linkedin/detext/blob/HEAD/src/detext/layers/cnn_layer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"b75e09919639454f"}},{"code_sha256_prefix":"727b60595ef2a241","entry":"compute_elem_diff_for_user_doc","repo":"linkedin/detext","repo_kind":"official","path":"src/detext/layers/interaction_layer.py","file_url":"https://github.com/linkedin/detext/blob/HEAD/src/detext/layers/interaction_layer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"727b60595ef2a241"}},{"code_sha256_prefix":"91e8385962b3d548","entry":"compute_hadamard_prod_for_user_doc","repo":"linkedin/detext","repo_kind":"official","path":"src/detext/layers/interaction_layer.py","file_url":"https://github.com/linkedin/detext/blob/HEAD/src/detext/layers/interaction_layer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"91e8385962b3d548"}},{"code_sha256_prefix":"82e169006d1c66be","entry":"compute_num_sim_ftrs","repo":"linkedin/detext","repo_kind":"official","path":"src/detext/layers/interaction_layer.py","file_url":"https://github.com/linkedin/detext/blob/HEAD/src/detext/layers/interaction_layer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"82e169006d1c66be"}},{"code_sha256_prefix":"503b84a0eaf159e1","entry":"concat_on_last_axis_dense","repo":"linkedin/detext","repo_kind":"official","path":"src/detext/layers/feature_grouper.py","file_url":"https://github.com/linkedin/detext/blob/HEAD/src/detext/layers/feature_grouper.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"503b84a0eaf159e1"}},{"code_sha256_prefix":"ac8d5df370fb7447","entry":"concat_on_last_axis_sparse","repo":"linkedin/detext","repo_kind":"official","path":"src/detext/layers/feature_grouper.py","file_url":"https://github.com/linkedin/detext/blob/HEAD/src/detext/layers/feature_grouper.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"ac8d5df370fb7447"}},{"code_sha256_prefix":"d2991efcc21f42b4","entry":"create_conv_layer","repo":"linkedin/detext","repo_kind":"official","path":"src/detext/layers/cnn_layer.py","file_url":"https://github.com/linkedin/detext/blob/HEAD/src/detext/layers/cnn_layer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d2991efcc21f42b4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}