{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/game-theoretic-formulations-of-sequential","title":"Nonparametric Two-Sample Testing by Betting","arxiv_id":"2112.09162","date":"2021-12-16","proceeding":null,"authors":["Shubhanshu Shekhar","Aaditya Ramdas"],"abstract":"We study the problem of designing consistent sequential two-sample tests in a nonparametric setting. Guided by the principle of testing by betting, we reframe this task into that of selecting a sequence of payoff functions that maximize the wealth of a fictitious bettor, betting against the null in a repeated game. In this setting, the relative increase in the bettor's wealth has a precise interpretation as the measure of evidence against the null, and thus our sequential test rejects the null when the wealth crosses an appropriate threshold. We develop a general framework for setting up the betting game for two-sample testing, in which the payoffs are selected by a prediction strategy as data-driven predictable estimates of the witness function associated with the variational representation of some statistical distance measures, such as integral probability metrics (IPMs). We then formally relate the statistical properties of the test~(such as consistency, type-II error exponent and expected sample size) to the regret of the corresponding prediction strategy. We construct a practical sequential two-sample test by instantiating our general strategy with the kernel-MMD metric, and demonstrate its ability to adapt to the difficulty of the unknown alternative through theoretical and empirical results. Our framework is versatile, and easily extends to other problems; we illustrate this by applying our approach to construct consistent tests for the following problems: (i) time-varying two-sample testing with non-exchangeable observations, and (ii) an abstract class of \"invariant\" testing problems, including symmetry and independence testing.","url_abs":"https://arxiv.org/abs/2112.09162v5","url_pdf":"https://arxiv.org/pdf/2112.09162v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"game-theoretic-formulations-of-sequential","repo_url":"https://github.com/sshekhar17/nonparametric-testing-by-betting","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2112.09162","atlas_url":"https://app.syntology.ai/?focus=2112.09162","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2112.09162"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sshekhar17/nonparametric-testing-by-betting","reach":null}],"summary":{"ran_honours":1,"ran_fixture":1,"ran_violates":1},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"e1733fe8ed0070c3","entry":"BatchKS2samp","repo":"sshekhar17/nonparametric-testing-by-betting","repo_kind":"official","path":"src/KStest.py","file_url":"https://github.com/sshekhar17/nonparametric-testing-by-betting/blob/HEAD/src/KStest.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e1733fe8ed0070c3"}},{"code_sha256_prefix":"eb8424978fc6eb59","entry":"KSprediction","repo":"sshekhar17/nonparametric-testing-by-betting","repo_kind":"official","path":"src/KStest.py","file_url":"https://github.com/sshekhar17/nonparametric-testing-by-betting/blob/HEAD/src/KStest.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"eb8424978fc6eb59"}},{"code_sha256_prefix":"d8de36079ced0545","entry":"getKSstatistic2samp","repo":"sshekhar17/nonparametric-testing-by-betting","repo_kind":"official","path":"src/KStest.py","file_url":"https://github.com/sshekhar17/nonparametric-testing-by-betting/blob/HEAD/src/KStest.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d8de36079ced0545"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}