{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/data-subsampling-for-poisson-regression-with","title":"Data subsampling for Poisson regression with pth-root-link","arxiv_id":"2410.22872","date":"2024-10-30","proceeding":null,"authors":["Han Cheng Lie","Alexander Munteanu"],"abstract":"We develop and analyze data subsampling techniques for Poisson regression, the standard model for count data $y\\in\\mathbb{N}$. In particular, we consider the Poisson generalized linear model with ID- and square root-link functions. We consider the method of coresets, which are small weighted subsets that approximate the loss function of Poisson regression up to a factor of $1\\pm\\varepsilon$. We show $\\Omega(n)$ lower bounds against coresets for Poisson regression that continue to hold against arbitrary data reduction techniques up to logarithmic factors. By introducing a novel complexity parameter and a domain shifting approach, we show that sublinear coresets with $1\\pm\\varepsilon$ approximation guarantee exist when the complexity parameter is small. In particular, the dependence on the number of input points can be reduced to polylogarithmic. We show that the dependence on other input parameters can also be bounded sublinearly, though not always logarithmically. In particular, we show that the square root-link admits an $O(\\log(y_{\\max}))$ dependence, where $y_{\\max}$ denotes the largest count presented in the data, while the ID-link requires a $\\Theta(\\sqrt{y_{\\max}/\\log(y_{\\max})})$ dependence. As an auxiliary result for proving the tightness of the bound with respect to $y_{\\max}$ in the case of the ID-link, we show an improved bound on the principal branch of the Lambert $W_0$ function, which may be of independent interest. We further show the limitations of our analysis when $p$th degree root-link functions for $p\\geq 3$ are considered, which indicate that other analytical or computational methods would be required if such a generalization is even possible.","url_abs":"https://arxiv.org/abs/2410.22872v1","url_pdf":"https://arxiv.org/pdf/2410.22872v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"data-subsampling-for-poisson-regression-with","repo_url":"https://github.com/Tim907/poisson-regression","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"regression-1","task_name":"regression"}],"methods":[{"method_slug":"coresets","method_name":"Coresets"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.22872","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.22872"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Tim907/poisson-regression","reach":{"status":"ok"}}],"summary":{"unverified":10},"by_repo_kind":{"official":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"85bbcde0e0204c72","entry":"add_intercept","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/datasets.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"85bbcde0e0204c72"}},{"code_sha256_prefix":"119b435476768082","entry":"compute_leverage_scores","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/sampling.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"119b435476768082"}},{"code_sha256_prefix":"c758f15b061b5e94","entry":"fast_QR","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/sampling.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c758f15b061b5e94"}},{"code_sha256_prefix":"c8c367cbc656fc9a","entry":"gaussian_kernel","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/metrics.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c8c367cbc656fc9a"}},{"code_sha256_prefix":"d052868fdd91425f","entry":"get_results_dir_p","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/settings.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/settings.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d052868fdd91425f"}},{"code_sha256_prefix":"3c164ca8797dd680","entry":"mmd","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/metrics.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3c164ca8797dd680"}},{"code_sha256_prefix":"bba3230f0550e694","entry":"p_gen_norm_cdf","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/probit_model.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/probit_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bba3230f0550e694"}},{"code_sha256_prefix":"0b3d8671a851a6d8","entry":"p_gen_norm_pdf","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/probit_model.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/probit_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0b3d8671a851a6d8"}},{"code_sha256_prefix":"cb9a66905aff629b","entry":"polynomial_kernel","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/metrics.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cb9a66905aff629b"}},{"code_sha256_prefix":"02e04515634f9ff2","entry":"uniform_sampling","repo":"Tim907/poisson-regression","repo_kind":"official","path":"efficient_poisson_regression/sampling.py","file_url":"https://github.com/Tim907/poisson-regression/blob/HEAD/efficient_poisson_regression/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"02e04515634f9ff2"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}