Permutation Test Calculator
Exact two-sided permutation test on the difference of two group means; all C(nA+nB, nA) group assignments of the pooled sample (each sample capped at 8 values) are enumerated deterministically.
Description
Exact two-sided permutation test on the difference of two group means; all C(nA+nB, nA) group assignments of the pooled sample (each sample capped at 8 values) are enumerated deterministically.
Permutation Test Calculator is a focused tool for the following task. Exact two-sided permutation test on the difference of two group means; all C(nA+nB, nA) group assignments of the pooled sample (each sample capped at 8 values) are enumerated deterministically. It reports Observed difference, p value, Assignment count from the values you provide rather than inventing measurements, coefficients, or professional judgment that are not part of the input.
When to use Permutation Test
Use this calculation to reproduce a defined quantitative method when the observations, units, sampling process, and assumptions match the method shown here.
- Sample A
- Required list. First sample values.
- Sample B
- Required list. Second sample values.
The cited overview of Permutation test supplies background for the terminology and domain context used by this tool.1
How Permutation Test works
Exact two-sided permutation test on the difference of two group means; all C(nA+nB, nA) group assignments of the pooled sample (each sample capped at 8 values) are enumerated deterministically. Inputs are interpreted exactly in the displayed units and the calculation returns the following fields without presentation rounding.
- Observed difference
- Returned number. Observed mean(A) minus mean(B).
- p value
- Returned number. Two-sided exact p value over all enumerated assignments.
- Assignment count
- Returned integer. Number of distinct label assignments C(nA+nB, nA).
Limitations and assumptions
- A numerical result does not by itself establish data quality, causation, representativeness, independence, distributional fit, or practical significance.
- Sample A must be no greater than 8.
- Sample B must be no greater than 8.
- Use finite inputs in the displayed units, preserve source measurements and assumptions, and independently verify consequential decisions.
Alternative or Complementary approaches
Inspect the underlying data, visualize its distribution, report uncertainty and sample size, and compare the result with a robust or domain-specific method where appropriate.
References
-
Permutation test — Wikipedia contributors
Similar or alternative tools
- Fisher's Exact Test
Compute the two-sided Fisher exact p-value for a 2×2 contingency table with fixed margins. Tables above 10,000 total observations are rejected to bound exact enumeration.
- Two-Sample T-Test Calculator
Calculate Welch's or pooled two-sample t-test statistic.
- Pooled Standard Deviation Calculator
Calculate pooled sample standard deviation from two sample variances and sizes.