{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mt-gbm-a-multi-task-gradient-boosting-machine-1","title":"MT-GBM: A Multi-Task Gradient Boosting Machine with Shared Decision Trees","arxiv_id":"2201.06239","date":"2022-01-17","proceeding":null,"authors":["ZhenZhe Ying","Zhuoer Xu","Zhifeng Li","Weiqiang Wang","Changhua Meng"],"abstract":"Despite the success of deep learning in computer vision and natural language processing, Gradient Boosted Decision Tree (GBDT) is yet one of the most powerful tools for applications with tabular data such as e-commerce and FinTech. However, applying GBDT to multi-task learning is still a challenge. Unlike deep models that can jointly learn a shared latent representation across multiple tasks, GBDT can hardly learn a shared tree structure. In this paper, we propose Multi-task Gradient Boosting Machine (MT-GBM), a GBDT-based method for multi-task learning. The MT-GBM can find the shared tree structures and split branches according to multi-task losses. First, it assigns multiple outputs to each leaf node. Next, it computes the gradient corresponding to each output (task). Then, we also propose an algorithm to combine the gradients of all tasks and update the tree. Finally, we apply MT-GBM to LightGBM. Experiments show that our MT-GBM improves the performance of the main task significantly, which means the proposed MT-GBM is efficient and effective.","url_abs":"https://arxiv.org/abs/2201.06239v2","url_pdf":"https://arxiv.org/pdf/2201.06239v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mt-gbm-a-multi-task-gradient-boosting-machine-1","repo_url":"https://github.com/antmachineintelligence/mtgbmcode","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"multi-task-learning","task_name":"Multi-Task Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2201.06239","atlas_url":"https://app.syntology.ai/?focus=2201.06239","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2201.06239"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/antmachineintelligence/mtgbmcode","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":11,"unverified":6},"by_repo_kind":{"official":{"samples":17,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":17,"samples":[{"code_sha256_prefix":"fc3614ca41e7d68f","entry":"early_stopping","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/callback.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/callback.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"fc3614ca41e7d68f"}},{"code_sha256_prefix":"cf90f0acecfd103d","entry":"get_alias","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"helpers/parameter_generator.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/helpers/parameter_generator.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"cf90f0acecfd103d"}},{"code_sha256_prefix":"4b472b054a47b6c4","entry":"get_names","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"helpers/parameter_generator.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/helpers/parameter_generator.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"4b472b054a47b6c4"}},{"code_sha256_prefix":"dbe763a9126867b3","entry":"get_parameter_infos","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"helpers/parameter_generator.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/helpers/parameter_generator.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"dbe763a9126867b3"}},{"code_sha256_prefix":"2076b13e5ea7eb87","entry":"is_numeric","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/basic.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/basic.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"2076b13e5ea7eb87"}},{"code_sha256_prefix":"3388ef831c610fe9","entry":"is_numpy_1d_array","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/basic.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/basic.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"3388ef831c610fe9"}},{"code_sha256_prefix":"2037c2dfc76ac639","entry":"json_default_with_numpy","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/compat.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/compat.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"2037c2dfc76ac639"}},{"code_sha256_prefix":"80c971f5c5dd3da7","entry":"print_evaluation","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/callback.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/callback.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"80c971f5c5dd3da7"}},{"code_sha256_prefix":"cec8e8040d7890c5","entry":"record_evaluation","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/callback.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/callback.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"cec8e8040d7890c5"}},{"code_sha256_prefix":"603210f99dc97740","entry":"run_benchmark","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"compute/perf/perf.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/compute/perf/perf.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"603210f99dc97740"}},{"code_sha256_prefix":"d7ab03027143d595","entry":"run_perf_process","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"compute/perf/perf.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/compute/perf/perf.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"d7ab03027143d595"}},{"code_sha256_prefix":"8962ecf922822449","entry":"cv","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/engine.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/engine.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"8962ecf922822449"}},{"code_sha256_prefix":"bb28afdcbfebc88d","entry":"is_1d_list","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/basic.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/basic.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"bb28afdcbfebc88d"}},{"code_sha256_prefix":"de4153d385896ffc","entry":"plot_importance","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/plotting.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/plotting.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"de4153d385896ffc"}},{"code_sha256_prefix":"720d08aa872ef28c","entry":"plot_metric","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/plotting.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/plotting.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"720d08aa872ef28c"}},{"code_sha256_prefix":"7b2090fd9924067d","entry":"plot_split_value_histogram","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/plotting.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/plotting.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"7b2090fd9924067d"}},{"code_sha256_prefix":"a925669c260a1c9a","entry":"train","repo":"antmachineintelligence/mtgbmcode","repo_kind":"official","path":"python-package/lightgbmmt/engine.py","file_url":"https://github.com/antmachineintelligence/mtgbmcode/blob/HEAD/python-package/lightgbmmt/engine.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"a925669c260a1c9a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}