{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2609-01761","title":"Pooling and Drift in Delayed Bandits","arxiv_id":"2609.01761","date":"2026-09-01","proceeding":null,"authors":["Melika Baghi"],"abstract":"A system often has to act long before it learns whether the act worked: a recommender sees a click in seconds and a purchase in days. With $K$ actions and a delay of $d$ rounds, the best rate known for this setting is $\\widetilde{O}(\\sqrt{(K+d)T})$ over $T$ rounds, so a longer menu is always more expensive to learn from. It need not be: if the outcome depends on the action only through the state it produced, then one late outcome informs every action that could have produced the observed state, and the price is set by how many genuinely different states the actions produce rather than by how many actions there are. We measure this using an effective dimension $v_t$ between $1$ and the number of states, and prove $\\widetilde{O}(\\sqrt{(d+1)V\\log K})$ for a rotating algorithm and $\\widetilde{O}(\\sqrt{V^{-}}+\\sqrt{dT})$ for the single-copy algorithm used in practice, for any budget fixed in advance; merging similar states lowers the price further, at an explicit bias. Even when given the exact losses from $d$ rounds ago, no algorithm escapes $Ω(\\sqrt{dE\\min\\{1+\\log J,T/d\\}})$, where $J$ counts the drifting directions and $E$ bounds how far losses move while the learner waits. On generated data, the state channel cuts regret by up to 79 percent against action-level weighting and, on the funnel family, by 32 to 68 percent against a tuned minimax-optimal method.","url_abs":"https://arxiv.org/abs/2609.01761","url_pdf":"https://arxiv.org/pdf/2609.01761","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2609.01761","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2609.01761"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/melikabaghi/state-exp3","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":23},"by_repo_kind":{"found_in_text":{"samples":23,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"5a0afb39de3d2007","entry":"aggregate","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/data_driven_grouping.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/data_driven_grouping.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5a0afb39de3d2007"}},{"code_sha256_prefix":"ac4c9cbe5bc1f5f9","entry":"boot_mean","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/analyze.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/analyze.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac4c9cbe5bc1f5f9"}},{"code_sha256_prefix":"e81af978f19131af","entry":"clustered_environment","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/data_driven_grouping.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/data_driven_grouping.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e81af978f19131af"}},{"code_sha256_prefix":"f7840c3b52b2777b","entry":"dirichlet_family","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/baselines.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/baselines.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f7840c3b52b2777b"}},{"code_sha256_prefix":"34b37e8ae251c566","entry":"drift_family","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/baselines.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/baselines.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"34b37e8ae251c566"}},{"code_sha256_prefix":"6494f2779f96fe37","entry":"env","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/state_exp3.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/state_exp3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6494f2779f96fe37"}},{"code_sha256_prefix":"220f7315688458e8","entry":"env","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/alpha_kappa.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/alpha_kappa.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"220f7315688458e8"}},{"code_sha256_prefix":"e2879cf139202834","entry":"env","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/certificate_gap.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/certificate_gap.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e2879cf139202834"}},{"code_sha256_prefix":"30c5d1668663e8c2","entry":"ftrl_hybrid","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/algo.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/algo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"30c5d1668663e8c2"}},{"code_sha256_prefix":"ff7e231ea212f8f7","entry":"funnel_family","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/baselines.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/baselines.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff7e231ea212f8f7"}},{"code_sha256_prefix":"7ea6635641c3a376","entry":"kappa_of","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/certificate_gap.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/certificate_gap.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7ea6635641c3a376"}},{"code_sha256_prefix":"e333a4dcfbdd91e0","entry":"load","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/analyze.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/analyze.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e333a4dcfbdd91e0"}},{"code_sha256_prefix":"3b178984945a0cec","entry":"make_env","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/algo.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/algo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b178984945a0cec"}},{"code_sha256_prefix":"173fab5aba513ef5","entry":"moments","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/state_exp3.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/state_exp3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"173fab5aba513ef5"}},{"code_sha256_prefix":"6d52176583924a82","entry":"oracle_groups","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/data_driven_grouping.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/data_driven_grouping.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d52176583924a82"}},{"code_sha256_prefix":"e944cf24c5624d74","entry":"run","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/state_exp3.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/state_exp3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e944cf24c5624d74"}},{"code_sha256_prefix":"c1badc08994a8130","entry":"run","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/state_exp3_experiment.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/state_exp3_experiment.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c1badc08994a8130"}},{"code_sha256_prefix":"162e56d3d7daa255","entry":"run","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/algo.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/algo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"162e56d3d7daa255"}},{"code_sha256_prefix":"7393773bdf3f1ca7","entry":"run","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/alpha_kappa.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/alpha_kappa.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7393773bdf3f1ca7"}},{"code_sha256_prefix":"121c1759b5ccb28c","entry":"run","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/cancelling_denominator.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/cancelling_denominator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"121c1759b5ccb28c"}},{"code_sha256_prefix":"9b99aaa42fafa00e","entry":"run","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/certificate_gap.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/certificate_gap.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b99aaa42fafa00e"}},{"code_sha256_prefix":"25cfa72b95b45c70","entry":"test_lt","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/analyze.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/analyze.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"25cfa72b95b45c70"}},{"code_sha256_prefix":"4972baadcaa1b57a","entry":"trial","repo":"melikabaghi/state-exp3","repo_kind":"found_in_text","path":"code/state_exp3_experiment.py","file_url":"https://github.com/melikabaghi/state-exp3/blob/HEAD/code/state_exp3_experiment.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4972baadcaa1b57a"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"stat.ML","source":"arxiv_daily_20260903.json"},"syntology_extracted_results":null}