Papers › S-BDT: Distributed Differentially Private Boosted Decision Trees

S-BDT: Distributed Differentially Private Boosted Decision Trees

21 Sep 2023arXiv:2309.12041archive 2025-07-28

Thorsten Peinemann, Moritz Kirschte, Joshua Stock, Carlos Cotrini, Esfandiar Mohammadi

We introduce S-BDT: a novel (ε,δ)-differentially private distributed gradient boosted decision tree (GBDT) learner that improves the protection of single training data points (privacy) while achieving meaningful learning goals, such as accuracy or regression error (utility). S-BDT uses less noise by relying on non-spherical multivariate Gaussian noise, for which we show tight subsampling bounds for privacy amplification and incorporate that into a R\'enyi filter for individual privacy accounting. We experimentally reach the same utility while saving 50% in terms of epsilon for ε≤0.5 on the Abalone regression dataset (dataset size ≈4K), saving 30% in terms of epsilon for ε≤0.08 for the Adult classification dataset (dataset size ≈50K), and saving 30% in terms of epsilon for ε≤0.03 for the Spambase classification dataset (dataset size ≈5K). Moreover, we show that for situations where a GBDT is learning a stream of data that originates from different subpopulations (non-IID), S-BDT improves the saving of epsilon even further.

PaperPDFCode

Code

kirschte/sbdt officialmentioned in papermentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

4kPrivacy Preservingregression

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections