{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/clip-ogd-an-experimental-design-for-adaptive-1","title":"Clip-OGD: An Experimental Design for Adaptive Neyman Allocation in Sequential Experiments","arxiv_id":"2305.17187","date":"2023-05-26","proceeding":null,"authors":["Jessica Dai","Paula Gradu","Christopher Harshaw"],"abstract":"From clinical development of cancer therapies to investigations into partisan bias, adaptive sequential designs have become increasingly popular method for causal inference, as they offer the possibility of improved precision over their non-adaptive counterparts. However, even in simple settings (e.g. two treatments) the extent to which adaptive designs can improve precision is not sufficiently well understood. In this work, we study the problem of Adaptive Neyman Allocation in a design-based potential outcomes framework, where the experimenter seeks to construct an adaptive design which is nearly as efficient as the optimal (but infeasible) non-adaptive Neyman design, which has access to all potential outcomes. Motivated by connections to online optimization, we propose Neyman Ratio and Neyman Regret as two (equivalent) performance measures of adaptive designs for this problem. We present Clip-OGD, an adaptive design which achieves $\\widetilde{O}(\\sqrt{T})$ expected Neyman regret and thereby recovers the optimal Neyman variance in large samples. Finally, we construct a conservative variance estimator which facilitates the development of asymptotically valid confidence intervals. To complement our theoretical results, we conduct simulations using data from a microeconomic experiment.","url_abs":"https://arxiv.org/abs/2305.17187v2","url_pdf":"https://arxiv.org/pdf/2305.17187v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"clip-ogd-an-experimental-design-for-adaptive-1","repo_url":"https://github.com/crharshaw/clip-ogd-sims","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"clip-ogd-an-experimental-design-for-adaptive-1","repo_url":"https://github.com/amazon-science/adaptive-abtester","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2305.17187","atlas_url":"https://app.syntology.ai/?focus=2305.17187","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.17187"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/amazon-science/adaptive-abtester","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/crharshaw/clip-ogd-sims","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":1,"ran_honours":1},"by_repo_kind":{"listed":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"4e539c659de6c63e","entry":"AATE","repo":"amazon-science/adaptive-abtester","repo_kind":"listed","path":"abtester/optimizers.py","file_url":"https://github.com/amazon-science/adaptive-abtester/blob/HEAD/abtester/optimizers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4e539c659de6c63e"}},{"code_sha256_prefix":"c435007515707128","entry":"compute_step_sizes","repo":"amazon-science/adaptive-abtester","repo_kind":"listed","path":"abtester/optimizers.py","file_url":"https://github.com/amazon-science/adaptive-abtester/blob/HEAD/abtester/optimizers.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c435007515707128"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}