Browse State-of-the-Art › Two-sample testing
Two-sample testing
84 papers with code · 5 benchmarks · 1 dataset archive 2025-07-28
In statistical hypothesis testing, a two-sample test is a test performed on the data of two random samples, each independently obtained from a different given population. The purpose of the test is to determine whether the difference between these two populations is statistically significant. The statistics used in two-sample tests can be used to solve many machine learning problems, such as domain adaptation, covariate shift and generative adversarial networks.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
5 leaderboard tables shown for this task, 5 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 338 · with a code link: 84 · where Syntology ran a sample: 21 (19 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (21 of 338 tagged: 19 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 4: papers 1 to 100 of 338, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
12 Dec 2017 7 repositories listedGenerative adversarial networks (GANs) are innovative techniques for learning generative models of complex data distributions from samples.
-
14 Dec 2018 5 repositories listedWe thus first propose a measure of `sensitivity' and show empirically that normal samples and adversarial samples have distinguishable sensitivity.
-
3 Jul 2019 4 repositories listedWe introduce hyppo, a unified library for performing multivariate hypothesis testing, including independence, two-sample, and k-sample testing.
-
9 Jun 2019 4 repositories listedBased on automatic deep learning segmentations, we extracted three features which quantify two-dimensional and three-dimensional characteristics of the tumors.
-
17 Jun 2022 3 repositories listed Syntology official (archive's flag): 8 ran · 10 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 8 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 2 pointer-only (licence)Two-sample tests are important in statistics and machine learning, both as tools for scientific discovery as well as to detect distribution shifts.
-
28 Oct 2021 3 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 14 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 15 harvested samples)In practice, this parameter is unknown and, hence, the optimal MMD test with this particular kernel cannot be used.
-
7 May 2019 3 repositories listedMore precisely, the privacy guarantees of any hypothesis testing based definition of privacy (including original DP) converges to GDP in the limit under composition.
-
10 Feb 2015 3 repositories listedWe consider the problem of learning deep generative models from data.
-
5 Oct 2020 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples) · 8 pointer-only (licence)To overcome this difficulty, we introduce a conditional selective inference (SI) framework -- a new statistical inference framework for data-driven hypotheses that has recently received considerable attention -- to…
-
23 Jun 2020 2 repositories listed Syntology official (archive's flag): 3 ran · 8 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 11 pointer-only (licence)However, the adoption of such policies in practice is often challenging, as they are hard to interpret within the application context, and lack measures of uncertainty for the learned policy value and its decisions.
-
18 Jun 2020 2 repositories listed Syntology 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 20 harvested samples)We present an improved method for symbolic regression that seeks to fit data to formulas that are Pareto-optimal, in the sense of having the best accuracy for a given complexity.
-
24 Feb 2020 2 repositories listedIn this paper, we present ACORE (Approximate Computation via Odds Ratio Estimation), a frequentist approach to LFI that first formulates the classical likelihood ratio test (LRT) as a parametrized classification…
-
17 Feb 2020 2 repositories listedTo make decisions based on a model fit with auto-encoding variational Bayes (AEVB), practitioners often let the variational distribution serve as a surrogate for the posterior distribution.
-
19 Sep 2019 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)Here, we show that Lᵖ distances (with p≥1) between these distribution representatives give metrics on the space of distributions that are well-behaved to detect differences between distributions as they metrize the weak…
-
16 Apr 2019 2 repositories listedThroughout the last decade, random forests have established themselves as among the most accurate and popular supervised learning methods.
-
29 Oct 2018 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)We might hope that when faced with unexpected inputs, well-designed software systems would fire off warnings.
-
1 Aug 2018 2 repositories listedAs a result, a simple chi-squared test is obtained, where a test statistic depends on a mean and covariance of empirical differences between the samples, which we perturb for a privacy guarantee.
-
27 Feb 2017 2 repositories listedUnder Markovian assumptions, we leverage a Central Limit Theorem (CLT) for the empirical measure in the test statistic of the composite hypothesis Hoeffding test so as to establish weak convergence results for the test…
-
19 Feb 2017 2 repositories listedRobust PCA methods are typically batch algorithms which requires loading all observations into memory before processing.
-
13 Nov 2024 1 repository listedWe explore the trade-off between privacy and statistical utility in private two-sample testing under local differential privacy (LDP) for both multinomial and continuous data.
-
26 Oct 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)Users often interact with large language models through black-box inference APIs, both for closed- and open-weight models (e. g., Llama models are popularly accessed via Amazon Bedrock and Azure AI Studio).
-
22 Oct 2024 1 repository listedOur first framework allows us to convert any conditional independence test into a conditional two-sample test in a black-box manner, while preserving the asymptotic properties of the original conditional independence…
-
16 Oct 2024 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 4 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples)We introduce credal two-sample testing, a new hypothesis testing framework for comparing credal sets -- convex sets of probability measures where each element captures aleatoric uncertainty and the set itself represents…
-
12 Sep 2024 1 repository listedThe focus of this study is to evaluate the effectiveness of Machine Learning (ML) methods for two-sample testing with right-censored observations.
-
12 Jul 2024 1 repository listedDespite its success and widespread adoption, the primary limitation of the MMD test has been its quadratic-time complexity, which poses challenges for large-scale analysis.
-
30 Oct 2023 1 repository listedWe propose a general framework for constructing powerful, sequential hypothesis tests for a large class of nonparametric testing problems.
-
17 Aug 2023 1 repository listedGiven n observations from two balanced classes, consider the task of labeling an additional m inputs that are known to all belong to one of the two classes.
-
14 Jun 2023 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 15 harvested samples)We propose novel statistics which maximise the power of a two-sample test based on the Maximum Mean Discrepancy (MMD), by adapting over the set of kernels used in defining it.
-
25 May 2023 1 repository listedWe then compute the Jensen-Shannon divergence between these operators, thereby establishing a proper divergence measure between probability distributions in the input space.
-
8 Mar 2023 1 repository listedMachine learning and deep learning have been used extensively to classify physical surfaces through images and time-series contact data.
-
14 Jan 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
27 Nov 2022 1 repository listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
15 Nov 2022 1 repository listed
-
20 Jan 2022 1 repository listed
-
17 Nov 2021 1 repository listed
-
6 Oct 2021 1 repository listed
-
14 Jun 2021 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
10 Feb 2021 1 repository listed
-
28 Oct 2020 1 repository listed
-
23 Oct 2020 1 repository listed
-
22 Oct 2020 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
6 Oct 2020 1 repository listed
-
20 Jul 2020 1 repository listed
-
8 Jun 2020 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 15 harvested samples)
-
2 Jun 2020 1 repository listed
-
9 Mar 2020 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
27 Feb 2020 1 repository listed
-
26 Feb 2020 1 repository listed
-
24 Feb 2020 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples)
-
21 Feb 2020 1 repository listed
-
21 Feb 2020 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
31 Jan 2020 1 repository listed
-
13 Jan 2020 1 repository listed
-
29 Dec 2019 1 repository listed
-
28 Dec 2019 1 repository listed
-
19 Dec 2019 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 15 harvested samples)
-
1 Dec 2019 1 repository listed
-
14 Oct 2019 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
8 Oct 2019 1 repository listed
-
28 Sep 2019 1 repository listed
-
25 Sep 2019 1 repository listed
-
1 Aug 2019 1 repository listed
-
9 Jul 2019 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
18 Jun 2019 1 repository listed
-
14 May 2019 1 repository listed
-
29 Mar 2019 1 repository listed
-
30 Nov 2018 1 repository listed
-
26 Nov 2018 1 repository listed
-
18 Nov 2018 1 repository listed
-
4 Jul 2018 1 repository listed
-
30 Oct 2017 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
6 May 2017 1 repository listed
-
24 Apr 2017 1 repository listed
-
29 Mar 2017 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
28 Sep 2016 1 repository listed
-
19 May 2016 1 repository listed
-
6 Apr 2016 1 repository listed
-
29 Mar 2016 1 repository listed
-
8 Sep 2015 1 repository listed
-
15 Jun 2015 1 repository listed
-
10 Jun 2015 1 repository listed
-
3 Mar 2015 1 repository listed
-
4 Feb 2014 1 repository listed
-
8 Jul 2013 1 repository listed
-
Leveraging Optimal Transport for Distributed Two-Sample Testing: An Integrated Transportation Distance-based Framework19 Jun 2025 0 repositories listed
-
Signature Maximum Mean Discrepancy Two-Sample Statistical Tests2 Jun 2025 0 repositories listed
-
From Two Sample Testing to Singular Gaussian Discrimination7 May 2025 0 repositories listed
-
Advanced Tutorial: Label-Efficient Two-Sample Tests7 Jan 2025 0 repositories listed
-
Optimal Algorithms for Augmented Testing of Discrete Distributions1 Dec 2024 0 repositories listed
-
A Unified Data Representation Learning for Non-parametric Two-sample Testing30 Nov 2024 0 repositories listed
-
Network two-sample test for block models10 Jun 2024 0 repositories listed
-
Statistical and Computational Guarantees of Kernel Max-Sliced Wasserstein Distances24 May 2024 0 repositories listed
-
Collaborative non-parametric two-sample testing8 Feb 2024 0 repositories listed
-
Variable Selection in Maximum Mean Discrepancy for Interpretable Distribution Comparison2 Nov 2023 0 repositories listed
-
A framework for paired-sample hypothesis testing for high-dimensional data28 Sep 2023 0 repositories listed
-
On the Exploration of Local Significant Differences For Two-Sample Test21 Sep 2023 0 repositories listed
-
Adaptive learning of density ratios in RKHS30 Jul 2023 0 repositories listed
-
Bootstrapped Edge Count Tests for Nonparametric Two-Sample Inference Under Heterogeneity26 Apr 2023 0 repositories listed
-
Active Sequential Two-Sample Testing30 Jan 2023 0 repositories listed
-
Semi-Autoregressive Energy Flows: Exploring Likelihood-Free Training of Normalizing Flows14 Jun 2022 0 repositories listed
Syntology lines on 23 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections