statistical cross-validation vs R + SciPy

vs SciPy 1.17.1 on targeted (df, λ) grids

comparisons1,083
passing990 (91.4%)
failing0
deep-tail / underflow92
pathological1
SciPy per-category breakdown · Python 3.13.1
categorypassfaildeep-tailunderflowpathologicaltotal
chi2cdf21090030
chi2inv30000030
fcdf11601200128
ncchi2cdf800160096
ncf_sf22702900256
nctcdf31802600344
norminv13000013
qtukey1490001150
tinv36000036

vs R 4.5.3 on real built-in datasets

comparisons529
passing524 (100.0%)
failing0
past R's floor5
max |Δ|3.16e-2
Shapiro-Wilk 50/50 pass
dataset n metric R Plöttr |Δ|
iris Sepal.Length 150 W 0.97609 0.97609 1.11e-10 ✓
iris Sepal.Length 150 p 0.0101812 0.0101811 2.51e-8 ✓
iris Sepal.Width 150 W 0.984918 0.984918 9.58e-12 ✓
iris Sepal.Width 150 p 0.101154 0.101154 6.54e-8 ✓
iris Petal.Length 150 W 0.876268 0.876268 1.49e-10 ✓
iris Petal.Length 150 p 7.412e-10 7.440e-10 3.69e-3 ✓
iris Petal.Width 150 W 0.901835 0.901835 1.88e-10 ✓
iris Petal.Width 150 p 1.680e-8 1.685e-8 2.51e-3 ✓
PlantGrowth weight 30 W 0.982683 0.982683 3.10e-10 ✓
PlantGrowth weight 30 p 0.891507 0.891507 7.14e-8 ✓
mtcars mpg 32 W 0.947565 0.947565 6.61e-10 ✓
mtcars mpg 32 p 0.122881 0.122881 6.05e-8 ✓
mtcars hp 32 W 0.933419 0.933419 8.14e-10 ✓
mtcars hp 32 p 0.0488082 0.0488082 2.16e-8 ✓
sleep extra 20 W 0.946073 0.946073 8.77e-10 ✓
sleep extra 20 p 0.311375 0.311375 1.37e-8 ✓
women height 15 W 0.963593 0.963593 3.92e-9 ✓
women height 15 p 0.754533 0.754533 6.28e-9 ✓
trees Height 31 W 0.965454 0.965454 1.85e-11 ✓
trees Height 31 p 0.403418 0.403418 4.93e-8 ✓
airquality Temp 153 W 0.976173 0.976173 9.58e-11 ✓
airquality Temp 153 p 0.00931936 0.00931934 1.91e-6 ✓
ToothGrowth len 60 W 0.967429 0.967429 3.42e-10 ✓
ToothGrowth len 60 p 0.1091 0.109101 6.01e-8 ✓
faithful eruptions 272 W 0.845916 0.845916 4.46e-11 ✓
faithful eruptions 272 p 9.036e-16 9.036e-16 4.95e-9 ✓
faithful waiting 272 W 0.922147 0.922147 4.65e-11 ✓
faithful waiting 272 p 1.015e-10 1.020e-10 4.52e-3 ✓
quakes mag 1000 W 0.953833 0.953833 3.29e-12 ✓
quakes mag 1000 p 3.448e-17 3.448e-17 2.11e-9 ✓
USArrests Murder 50 W 0.957027 0.957027 5.78e-10 ✓
USArrests Murder 50 p 0.0667428 0.0667428 2.36e-8 ✓
swiss Fertility 47 W 0.973067 0.973067 3.36e-10 ✓
swiss Fertility 47 p 0.344947 0.344947 5.46e-8 ✓
morley Speed 100 W 0.988074 0.988074 5.11e-11 ✓
morley Speed 100 p 0.513704 0.513704 6.17e-8 ✓
CO2 uptake 84 W 0.941049 0.941049 3.66e-10 ✓
CO2 uptake 84 p 7.908e-4 7.908e-4 8.34e-5 ✓
LakeHuron 98 W 0.984922 0.984922 1.04e-10 ✓
LakeHuron 98 p 0.327066 0.327066 1.59e-8 ✓
attitude rating 30 W 0.956698 0.956698 6.50e-10 ✓
attitude rating 30 p 0.254469 0.254469 7.95e-8 ✓
precip 70 W 0.964559 0.964559 1.23e-10 ✓
precip 70 p 0.0449253 0.0449253 3.07e-8 ✓
n=3 evenly spaced (W=1) 3 W 1 1 0 ✓
n=3 evenly spaced (W=1) 3 p 1 1 0 ✓
n=3 one outlier 3 W 0.832192 0.832192 1.92e-12 ✓
n=3 one outlier 3 p 0.193918 0.193918 1.45e-12 ✓
n=3 clustered low + far high 3 W 0.7653 0.7653 4.38e-13 ✓
n=3 clustered low + far high 3 p 0.0340992 0.0340992 3.92e-13 ✓
Levene (Brown-Forsythe) 24/24 pass
dataset n metric R Plöttr |Δ|
iris Sepal.Length by Species 150 F 6.35272 6.35272 1.73e-11 ✓
iris Sepal.Length by Species 150 p 0.00225853 0.00225853 9.73e-12 ✓
iris Petal.Length by Species 150 F 19.4803 19.4803 2.36e-11 ✓
iris Petal.Length by Species 150 p 3.129e-8 3.129e-8 2.78e-12 ✓
PlantGrowth weight by group 30 F 1.11919 1.11919 2.96e-11 ✓
PlantGrowth weight by group 30 p 0.341227 0.341227 4.53e-12 ✓
ToothGrowth len by supp 60 F 1.21357 1.21357 5.50e-12 ✓
ToothGrowth len by supp 60 p 0.275176 0.275176 4.40e-12 ✓
ToothGrowth len by dose 60 F 0.645734 0.645734 3.15e-12 ✓
ToothGrowth len by dose 60 p 0.528069 0.528069 4.01e-12 ✓
chickwts weight by feed 71 F 0.749264 0.749264 3.74e-12 ✓
chickwts weight by feed 71 p 0.58961 0.58961 9.02e-13 ✓
InsectSprays count by spray 72 F 3.82136 3.82136 2.59e-11 ✓
InsectSprays count by spray 72 p 0.00422279 0.00422279 1.85e-12 ✓
CO2 uptake by Treatment 84 F 1.29985 1.29985 2.42e-11 ✓
CO2 uptake by Treatment 84 p 0.257559 0.257559 2.54e-12 ✓
CO2 uptake by Type 84 F 0.17044 0.17044 3.60e-12 ✓
CO2 uptake by Type 84 p 0.680799 0.680799 3.52e-12 ✓
morley Speed by Expt 100 F 1.67494 1.67494 1.52e-11 ✓
morley Speed by Expt 100 p 0.162196 0.162196 3.01e-13 ✓
ChickWeight@21 weight by Diet 45 F 1.15972 1.15972 2.06e-11 ✓
ChickWeight@21 weight by Diet 45 p 0.336739 0.336739 2.45e-12 ✓
OrchardSprays decrease by treatment 64 F 1.51316 1.51316 3.19e-12 ✓
OrchardSprays decrease by treatment 64 p 0.181743 0.181743 3.94e-12 ✓
Student t 12/12 pass
dataset n metric R Plöttr |Δ|
iris Sepal.Length: setosa vs versicolor 100 t -10.521 -10.521 4.91e-11 ✓
iris Sepal.Length: setosa vs versicolor 100 p 8.985e-18 8.985e-18 1.44e-12 ✓
iris Sepal.Length: versicolor vs virginica 100 t -5.62917 -5.62917 1.98e-11 ✓
iris Sepal.Length: versicolor vs virginica 100 p 1.725e-7 1.725e-7 2.62e-11 ✓
iris Petal.Length: setosa vs versicolor 100 t -39.4927 -39.4927 3.81e-11 ✓
iris Petal.Length: setosa vs versicolor 100 p 5.405e-62 5.405e-62 7.73e-12 ✓
sleep: group 1 vs group 2 20 t -1.86081 -1.86081 1.31e-11 ✓
sleep: group 1 vs group 2 20 p 0.0791867 0.0791867 6.18e-14 ✓
CO2 uptake: Quebec vs Mississippi 84 t 6.5969 6.5969 4.95e-11 ✓
CO2 uptake: Quebec vs Mississippi 84 p 3.835e-9 3.835e-9 6.89e-12 ✓
morley Speed: Expt 1 vs Expt 5 40 t 2.93455 2.93455 2.36e-11 ✓
morley Speed: Expt 1 vs Expt 5 40 p 0.00563869 0.00563869 8.16e-12 ✓
Welch t 12/12 pass
dataset n metric R Plöttr |Δ|
ToothGrowth len: OJ vs VC 60 t 1.91527 1.91527 4.73e-12 ✓
ToothGrowth len: OJ vs VC 60 p 0.0606345 0.0606345 6.50e-14 ✓
mtcars mpg: vs=0 vs vs=1 32 t -4.66705 -4.66705 4.86e-11 ✓
mtcars mpg: vs=0 vs vs=1 32 p 1.098e-4 1.098e-4 3.33e-11 ✓
warpbreaks breaks: wool A vs wool B 54 t 1.63354 1.63354 2.57e-11 ✓
warpbreaks breaks: wool A vs wool B 54 p 0.10983 0.10983 3.66e-12 ✓
CO2 uptake: nonchilled vs chilled 84 t 3.04846 3.04846 1.80e-11 ✓
CO2 uptake: nonchilled vs chilled 84 p 0.00310694 0.00310694 2.18e-13 ✓
ChickWeight@21: Diet 1 vs Diet 4 25 t -2.95245 -2.95245 4.05e-11 ✓
ChickWeight@21: Diet 1 vs Diet 4 25 p 0.00758698 0.00758698 4.59e-12 ✓
swiss Fertility: high vs low Catholic 47 t 2.70037 2.70037 2.63e-11 ✓
swiss Fertility: high vs low Catholic 47 p 0.0118634 0.0118634 4.58e-13 ✓
Mann-Whitney U 12/12 pass
dataset n metric R Plöttr |Δ|
ToothGrowth len: dose=0.5 vs dose=2.0 40 U 1.5 1.5 0 ✓
ToothGrowth len: dose=0.5 vs dose=2.0 40 p 8.406e-8 8.425e-8 2.19e-3 ✓
mtcars mpg: am=0 vs am=1 32 U 42 42 0 ✓
mtcars mpg: am=0 vs am=1 32 p 0.00187139 0.00187153 7.24e-5 ✓
InsectSprays: spray A vs spray F 24 U 58 58 0 ✓
InsectSprays: spray A vs spray F 24 p 0.434228 0.434228 1.37e-7 ✓
CO2 uptake: Quebec vs Mississippi 84 U 1489 1489 0 ✓
CO2 uptake: Quebec vs Mississippi 84 p 5.759e-8 5.773e-8 2.32e-3 ✓
ChickWeight@21: Diet 1 vs Diet 3 26 U 25.5 25.5 0 ✓
ChickWeight@21: Diet 1 vs Diet 3 26 p 0.00438605 0.00438618 2.92e-5 ✓
OrchardSprays: A vs H 16 U 0 0 0 ✓
OrchardSprays: A vs H 16 p 9.069e-4 9.070e-4 1.26e-4 ✓
one-way ANOVA 16/16 pass
dataset n metric R Plöttr |Δ|
iris Sepal.Length by Species 150 F 119.265 119.265 4.52e-12 ✓
iris Sepal.Length by Species 150 p 1.670e-31 1.670e-31 1.82e-11 ✓
iris Petal.Length by Species 150 F 1180.16 1180.16 1.98e-11 ✓
iris Petal.Length by Species 150 p 2.857e-91 2.857e-91 1.34e-11 ✓
PlantGrowth weight by group 30 F 4.84609 4.84609 1.99e-11 ✓
PlantGrowth weight by group 30 p 0.01591 0.01591 3.77e-13 ✓
ToothGrowth len by dose 60 F 67.4157 67.4157 4.24e-11 ✓
ToothGrowth len by dose 60 p 9.533e-16 9.533e-16 2.13e-14 ✓
CO2 uptake by Treatment 84 F 9.29312 9.29312 4.30e-11 ✓
CO2 uptake by Treatment 84 p 0.00309573 0.00309573 1.34e-11 ✓
morley Speed by Expt 100 F 4.2878 4.2878 3.78e-11 ✓
morley Speed by Expt 100 p 0.00311445 0.00311445 1.40e-11 ✓
ChickWeight@21 weight by Diet 45 F 4.65471 4.65471 1.04e-11 ✓
ChickWeight@21 weight by Diet 45 p 0.00685796 0.00685796 1.22e-12 ✓
OrchardSprays decrease by treatment 64 F 19.0618 19.0618 3.79e-11 ✓
OrchardSprays decrease by treatment 64 p 9.499e-13 9.499e-13 1.46e-12 ✓
Welch ANOVA 12/12 pass
dataset n metric R Plöttr |Δ|
iris Sepal.Width by Species 150 F 45.012 45.012 2.96e-11 ✓
iris Sepal.Width by Species 150 p 1.433e-14 1.433e-14 1.73e-11 ✓
chickwts weight by feed 71 F 19.6617 19.6617 3.69e-11 ✓
chickwts weight by feed 71 p 1.177e-8 1.177e-8 2.85e-11 ✓
InsectSprays count by spray 72 F 36.0654 36.0654 2.27e-11 ✓
InsectSprays count by spray 72 p 7.999e-12 7.999e-12 3.33e-12 ✓
morley Speed by Expt 100 F 3.00607 3.00607 2.65e-11 ✓
morley Speed by Expt 100 p 0.0273779 0.0273779 8.58e-14 ✓
ChickWeight@21 weight by Diet 45 F 4.66182 4.66182 2.66e-11 ✓
ChickWeight@21 weight by Diet 45 p 0.0121893 0.0121893 4.97e-13 ✓
OrchardSprays decrease by treatment 64 F 33.5146 33.5146 2.75e-11 ✓
OrchardSprays decrease by treatment 64 p 1.476e-10 1.476e-10 4.68e-12 ✓
Kruskal-Wallis 12/12 pass
dataset n metric R Plöttr |Δ|
InsectSprays count by spray 72 H 54.6913 54.6913 2.86e-11 ✓
InsectSprays count by spray 72 p 1.511e-10 1.511e-10 2.27e-7 ✓
chickwts weight by feed 71 H 37.3427 37.3427 4.38e-11 ✓
chickwts weight by feed 71 p 5.113e-7 5.113e-7 1.73e-11 ✓
PlantGrowth weight by group 30 H 7.98823 7.98823 4.37e-11 ✓
PlantGrowth weight by group 30 p 0.0184238 0.0184238 4.72e-13 ✓
morley Speed by Expt 100 H 15.0221 15.0221 4.66e-11 ✓
morley Speed by Expt 100 p 0.00465555 0.00465555 7.05e-12 ✓
ChickWeight@21 weight by Diet 45 H 10.5845 10.5845 5.73e-12 ✓
ChickWeight@21 weight by Diet 45 p 0.0141985 0.0141985 1.95e-13 ✓
OrchardSprays decrease by treatment 64 H 48.8735 48.8735 2.65e-11 ✓
OrchardSprays decrease by treatment 64 p 2.402e-8 2.402e-8 7.50e-10 ✓
Tukey HSD 157/160 pass 3 past R's floor
dataset n metric R Plöttr |Δ|
iris Sepal.Length by Species [setosa vs versicolor] 150 pAdj 3.308e-14 2.634e-15 2.53e+0 R-floor
iris Sepal.Length by Species [setosa vs versicolor] 150 diff 0.93 0.93 5.55e-16 ✓
iris Sepal.Length by Species [setosa vs versicolor] 150 lwr 0.686227 0.686227 3.81e-8 ✓
iris Sepal.Length by Species [setosa vs versicolor] 150 upr 1.17377 1.17377 3.81e-8 ✓
iris Sepal.Length by Species [setosa vs virginica] 150 pAdj 2.220e-15 1.034e-32 3.99e+1 R-floor
iris Sepal.Length by Species [setosa vs virginica] 150 diff 1.582 1.582 1.11e-15 ✓
iris Sepal.Length by Species [setosa vs virginica] 150 lwr 1.33823 1.33823 3.81e-8 ✓
iris Sepal.Length by Species [setosa vs virginica] 150 upr 1.82577 1.82577 3.81e-8 ✓
iris Sepal.Length by Species [versicolor vs virginica] 150 pAdj 8.288e-9 8.292e-9 5.32e-4 ✓
iris Sepal.Length by Species [versicolor vs virginica] 150 diff 0.652 0.652 1.67e-15 ✓
iris Sepal.Length by Species [versicolor vs virginica] 150 lwr 0.408227 0.408227 3.81e-8 ✓
iris Sepal.Length by Species [versicolor vs virginica] 150 upr 0.895773 0.895773 3.81e-8 ✓
PlantGrowth weight by group [ctrl vs trt1] 30 pAdj 0.390871 0.390871 1.16e-9 ✓
PlantGrowth weight by group [ctrl vs trt1] 30 diff -0.371 -0.371 4.44e-16 ✓
PlantGrowth weight by group [ctrl vs trt1] 30 lwr -1.06222 -1.06222 1.05e-7 ✓
PlantGrowth weight by group [ctrl vs trt1] 30 upr 0.320216 0.320216 1.05e-7 ✓
PlantGrowth weight by group [ctrl vs trt2] 30 pAdj 0.197996 0.197996 6.98e-9 ✓
PlantGrowth weight by group [ctrl vs trt2] 30 diff 0.494 0.494 2.22e-16 ✓
PlantGrowth weight by group [ctrl vs trt2] 30 lwr -0.197216 -0.197216 1.05e-7 ✓
PlantGrowth weight by group [ctrl vs trt2] 30 upr 1.18522 1.18522 1.05e-7 ✓
PlantGrowth weight by group [trt1 vs trt2] 30 pAdj 0.0120064 0.0120065 6.13e-8 ✓
PlantGrowth weight by group [trt1 vs trt2] 30 diff 0.865 0.865 2.22e-16 ✓
PlantGrowth weight by group [trt1 vs trt2] 30 lwr 0.173784 0.173784 1.05e-7 ✓
PlantGrowth weight by group [trt1 vs trt2] 30 upr 1.55622 1.55622 1.05e-7 ✓
ToothGrowth len by dose [0.5 vs 1] 60 pAdj 2.002e-8 2.002e-8 2.76e-4 ✓
ToothGrowth len by dose [0.5 vs 1] 60 diff 9.13 9.13 1.78e-15 ✓
ToothGrowth len by dose [0.5 vs 1] 60 lwr 5.90181 5.9018 5.91e-7 ✓
ToothGrowth len by dose [0.5 vs 1] 60 upr 12.3582 12.3582 5.91e-7 ✓
ToothGrowth len by dose [0.5 vs 2] 60 pAdj 1.123e-11 4.022e-16 1.02e+1 R-floor
ToothGrowth len by dose [0.5 vs 2] 60 diff 15.495 15.495 5.33e-15 ✓
ToothGrowth len by dose [0.5 vs 2] 60 lwr 12.2668 12.2668 5.91e-7 ✓
ToothGrowth len by dose [0.5 vs 2] 60 upr 18.7232 18.7232 5.91e-7 ✓
ToothGrowth len by dose [1 vs 2] 60 pAdj 4.248e-5 4.248e-5 8.02e-5 ✓
ToothGrowth len by dose [1 vs 2] 60 diff 6.365 6.365 5.33e-15 ✓
ToothGrowth len by dose [1 vs 2] 60 lwr 3.13681 3.1368 5.91e-7 ✓
ToothGrowth len by dose [1 vs 2] 60 upr 9.59319 9.5932 5.91e-7 ✓
chickwts weight by feed [casein vs horsebean] 71 pAdj 3.070e-8 3.071e-8 3.06e-4 ✓
chickwts weight by feed [casein vs horsebean] 71 diff -163.383 -163.383 3.33e-11 ✓
chickwts weight by feed [casein vs horsebean] 71 lwr -232.347 -232.347 2.81e-5 ✓
chickwts weight by feed [casein vs horsebean] 71 upr -94.4198 -94.4198 2.81e-5 ✓
chickwts weight by feed [casein vs linseed] 71 pAdj 2.100e-4 2.100e-4 7.93e-5 ✓
chickwts weight by feed [casein vs linseed] 71 diff -104.833 -104.833 3.33e-11 ✓
chickwts weight by feed [casein vs linseed] 71 lwr -170.587 -170.588 2.68e-5 ✓
chickwts weight by feed [casein vs linseed] 71 upr -39.0792 -39.0791 2.68e-5 ✓
chickwts weight by feed [casein vs meatmeal] 71 pAdj 0.332458 0.332458 4.36e-8 ✓
chickwts weight by feed [casein vs meatmeal] 71 diff -46.6742 -46.6742 4.24e-11 ✓
chickwts weight by feed [casein vs meatmeal] 71 lwr -113.906 -113.906 2.74e-5 ✓
chickwts weight by feed [casein vs meatmeal] 71 upr 20.5577 20.5577 2.74e-5 ✓
chickwts weight by feed [casein vs soybean] 71 pAdj 0.00836531 0.00836544 1.61e-5 ✓
chickwts weight by feed [casein vs soybean] 71 diff -77.1548 -77.1548 3.81e-11 ✓
chickwts weight by feed [casein vs soybean] 71 lwr -140.517 -140.517 2.58e-5 ✓
chickwts weight by feed [casein vs soybean] 71 upr -13.7925 -13.7924 2.58e-5 ✓
chickwts weight by feed [casein vs sunflower] 71 pAdj 0.99989 0.99989 4.42e-8 ✓
chickwts weight by feed [casein vs sunflower] 71 diff 5.33333 5.33333 3.34e-11 ✓
chickwts weight by feed [casein vs sunflower] 71 lwr -60.4208 -60.4209 2.68e-5 ✓
chickwts weight by feed [casein vs sunflower] 71 upr 71.0875 71.0875 2.68e-5 ✓
chickwts weight by feed [horsebean vs linseed] 71 pAdj 0.141333 0.141333 5.58e-8 ✓
chickwts weight by feed [horsebean vs linseed] 71 diff 58.55 58.55 1.42e-14 ✓
chickwts weight by feed [horsebean vs linseed] 71 lwr -10.4135 -10.4136 2.81e-5 ✓
chickwts weight by feed [horsebean vs linseed] 71 upr 127.514 127.514 2.81e-5 ✓
chickwts weight by feed [horsebean vs meatmeal] 71 pAdj 1.062e-4 1.062e-4 9.60e-5 ✓
chickwts weight by feed [horsebean vs meatmeal] 71 diff 116.709 116.709 9.05e-12 ✓
chickwts weight by feed [horsebean vs meatmeal] 71 lwr 46.3351 46.3351 2.87e-5 ✓
chickwts weight by feed [horsebean vs meatmeal] 71 upr 187.083 187.083 2.87e-5 ✓
chickwts weight by feed [horsebean vs soybean] 71 pAdj 0.00421665 0.00421676 2.42e-5 ✓
chickwts weight by feed [horsebean vs soybean] 71 diff 86.2286 86.2286 2.86e-11 ✓
chickwts weight by feed [horsebean vs soybean] 71 lwr 19.5417 19.5417 2.72e-5 ✓
chickwts weight by feed [horsebean vs soybean] 71 upr 152.915 152.915 2.72e-5 ✓
chickwts weight by feed [horsebean vs sunflower] 71 pAdj 1.220e-8 1.220e-8 2.51e-4 ✓
chickwts weight by feed [horsebean vs sunflower] 71 diff 168.717 168.717 3.33e-11 ✓
chickwts weight by feed [horsebean vs sunflower] 71 lwr 99.7531 99.7531 2.81e-5 ✓
chickwts weight by feed [horsebean vs sunflower] 71 upr 237.68 237.68 2.81e-5 ✓
chickwts weight by feed [linseed vs meatmeal] 71 pAdj 0.127696 0.127697 6.95e-8 ✓
chickwts weight by feed [linseed vs meatmeal] 71 diff 58.1591 58.1591 9.07e-12 ✓
chickwts weight by feed [linseed vs meatmeal] 71 lwr -9.07287 -9.0729 2.74e-5 ✓
chickwts weight by feed [linseed vs meatmeal] 71 upr 125.391 125.391 2.74e-5 ✓
chickwts weight by feed [linseed vs soybean] 71 pAdj 0.793285 0.793285 2.39e-7 ✓
chickwts weight by feed [linseed vs soybean] 71 diff 27.6786 27.6786 2.86e-11 ✓
chickwts weight by feed [linseed vs soybean] 71 lwr -35.6837 -35.6837 2.58e-5 ✓
chickwts weight by feed [linseed vs soybean] 71 upr 91.0409 91.0409 2.58e-5 ✓
chickwts weight by feed [linseed vs sunflower] 71 pAdj 8.843e-5 8.844e-5 1.01e-4 ✓
chickwts weight by feed [linseed vs sunflower] 71 diff 110.167 110.167 3.33e-11 ✓
chickwts weight by feed [linseed vs sunflower] 71 lwr 44.4125 44.4125 2.68e-5 ✓
chickwts weight by feed [linseed vs sunflower] 71 upr 175.921 175.921 2.68e-5 ✓
chickwts weight by feed [meatmeal vs soybean] 71 pAdj 0.739136 0.739135 1.95e-7 ✓
chickwts weight by feed [meatmeal vs soybean] 71 diff -30.4805 -30.4805 1.95e-11 ✓
chickwts weight by feed [meatmeal vs soybean] 71 lwr -95.3751 -95.3751 2.64e-5 ✓
chickwts weight by feed [meatmeal vs soybean] 71 upr 34.4141 34.4141 2.64e-5 ✓
chickwts weight by feed [meatmeal vs sunflower] 71 pAdj 0.220696 0.220696 4.33e-9 ✓
chickwts weight by feed [meatmeal vs sunflower] 71 diff 52.0076 52.0076 2.43e-11 ✓
chickwts weight by feed [meatmeal vs sunflower] 71 lwr -15.2244 -15.2244 2.74e-5 ✓
chickwts weight by feed [meatmeal vs sunflower] 71 upr 119.24 119.24 2.74e-5 ✓
chickwts weight by feed [soybean vs sunflower] 71 pAdj 0.00388452 0.00388462 2.52e-5 ✓
chickwts weight by feed [soybean vs sunflower] 71 diff 82.4881 82.4881 4.73e-12 ✓
chickwts weight by feed [soybean vs sunflower] 71 lwr 19.1258 19.1258 2.58e-5 ✓
chickwts weight by feed [soybean vs sunflower] 71 upr 145.85 145.85 2.58e-5 ✓
ChickWeight@21 weight by Diet [1 vs 2] 45 pAdj 0.48681 0.486809 4.61e-9 ✓
ChickWeight@21 weight by Diet [1 vs 2] 45 diff 36.95 36.95 1.42e-14 ✓
ChickWeight@21 weight by Diet [1 vs 2] 45 lwr -32.1106 -32.1107 1.94e-5 ✓
ChickWeight@21 weight by Diet [1 vs 2] 45 upr 106.011 106.011 1.94e-5 ✓
ChickWeight@21 weight by Diet [1 vs 3] 45 pAdj 0.00469589 0.00469596 1.42e-5 ✓
ChickWeight@21 weight by Diet [1 vs 3] 45 diff 92.55 92.55 1.42e-14 ✓
ChickWeight@21 weight by Diet [1 vs 3] 45 lwr 23.4894 23.4893 1.94e-5 ✓
ChickWeight@21 weight by Diet [1 vs 3] 45 upr 161.611 161.611 1.94e-5 ✓
ChickWeight@21 weight by Diet [1 vs 4] 45 pAdj 0.119266 0.119266 4.11e-8 ✓
ChickWeight@21 weight by Diet [1 vs 4] 45 diff 60.8056 60.8056 4.45e-11 ✓
ChickWeight@21 weight by Diet [1 vs 4] 45 lwr -10.5771 -10.5771 2.01e-5 ✓
ChickWeight@21 weight by Diet [1 vs 4] 45 upr 132.188 132.188 2.01e-5 ✓
ChickWeight@21 weight by Diet [2 vs 3] 45 pAdj 0.226392 0.226392 1.32e-10 ✓
ChickWeight@21 weight by Diet [2 vs 3] 45 diff 55.6 55.6 2.13e-14 ✓
ChickWeight@21 weight by Diet [2 vs 3] 45 lwr -21.0159 -21.0159 2.15e-5 ✓
ChickWeight@21 weight by Diet [2 vs 3] 45 upr 132.216 132.216 2.15e-5 ✓
ChickWeight@21 weight by Diet [2 vs 4] 45 pAdj 0.848678 0.848678 7.85e-10 ✓
ChickWeight@21 weight by Diet [2 vs 4] 45 diff 23.8556 23.8556 4.44e-11 ✓
ChickWeight@21 weight by Diet [2 vs 4] 45 lwr -54.8598 -54.8598 2.21e-5 ✓
ChickWeight@21 weight by Diet [2 vs 4] 45 upr 102.571 102.571 2.21e-5 ✓
ChickWeight@21 weight by Diet [3 vs 4] 45 pAdj 0.703625 0.703625 2.31e-8 ✓
ChickWeight@21 weight by Diet [3 vs 4] 45 diff -31.7444 -31.7444 4.45e-11 ✓
ChickWeight@21 weight by Diet [3 vs 4] 45 lwr -110.46 -110.46 2.21e-5 ✓
ChickWeight@21 weight by Diet [3 vs 4] 45 upr 46.9709 46.9709 2.21e-5 ✓
morley Speed by Expt [1 vs 2] 100 pAdj 0.167988 0.167988 1.78e-8 ✓
morley Speed by Expt [1 vs 2] 100 diff -53 -53 0 ✓
morley Speed by Expt [1 vs 2] 100 lwr -118.28 -118.28 1.88e-5 ✓
morley Speed by Expt [1 vs 2] 100 upr 12.2801 12.2801 1.88e-5 ✓
morley Speed by Expt [1 vs 3] 100 pAdj 0.0574625 0.0574626 1.17e-7 ✓
morley Speed by Expt [1 vs 3] 100 diff -64 -64 0 ✓
morley Speed by Expt [1 vs 3] 100 lwr -129.28 -129.28 1.88e-5 ✓
morley Speed by Expt [1 vs 3] 100 upr 1.28006 1.28008 1.88e-5 ✓
morley Speed by Expt [1 vs 4] 100 pAdj 0.00257329 0.00257337 2.91e-5 ✓
morley Speed by Expt [1 vs 4] 100 diff -88.5 -88.5 0 ✓
morley Speed by Expt [1 vs 4] 100 lwr -153.78 -153.78 1.88e-5 ✓
morley Speed by Expt [1 vs 4] 100 upr -23.2199 -23.2199 1.88e-5 ✓
morley Speed by Expt [1 vs 5] 100 pAdj 0.0115793 0.0115794 1.32e-7 ✓
morley Speed by Expt [1 vs 5] 100 diff -77.5 -77.5 0 ✓
morley Speed by Expt [1 vs 5] 100 lwr -142.78 -142.78 1.88e-5 ✓
morley Speed by Expt [1 vs 5] 100 upr -12.2199 -12.2199 1.88e-5 ✓
morley Speed by Expt [2 vs 3] 100 pAdj 0.989966 0.989966 3.79e-8 ✓
morley Speed by Expt [2 vs 3] 100 diff -11 -11 0 ✓
morley Speed by Expt [2 vs 3] 100 lwr -76.2801 -76.2801 1.88e-5 ✓
morley Speed by Expt [2 vs 3] 100 upr 54.2801 54.2801 1.88e-5 ✓
morley Speed by Expt [2 vs 4] 100 pAdj 0.557167 0.557167 1.52e-8 ✓
morley Speed by Expt [2 vs 4] 100 diff -35.5 -35.5 0 ✓
morley Speed by Expt [2 vs 4] 100 lwr -100.78 -100.78 1.88e-5 ✓
morley Speed by Expt [2 vs 4] 100 upr 29.7801 29.7801 1.88e-5 ✓
morley Speed by Expt [2 vs 5] 100 pAdj 0.834336 0.834336 6.24e-9 ✓
morley Speed by Expt [2 vs 5] 100 diff -24.5 -24.5 0 ✓
morley Speed by Expt [2 vs 5] 100 lwr -89.7801 -89.7801 1.88e-5 ✓
morley Speed by Expt [2 vs 5] 100 upr 40.7801 40.7801 1.88e-5 ✓
morley Speed by Expt [3 vs 4] 100 pAdj 0.834336 0.834336 6.24e-9 ✓
morley Speed by Expt [3 vs 4] 100 diff -24.5 -24.5 0 ✓
morley Speed by Expt [3 vs 4] 100 lwr -89.7801 -89.7801 1.88e-5 ✓
morley Speed by Expt [3 vs 4] 100 upr 40.7801 40.7801 1.88e-5 ✓
morley Speed by Expt [3 vs 5] 100 pAdj 0.978406 0.978406 2.45e-8 ✓
morley Speed by Expt [3 vs 5] 100 diff -13.5 -13.5 0 ✓
morley Speed by Expt [3 vs 5] 100 lwr -78.7801 -78.7801 1.88e-5 ✓
morley Speed by Expt [3 vs 5] 100 upr 51.7801 51.7801 1.88e-5 ✓
morley Speed by Expt [4 vs 5] 100 pAdj 0.989966 0.989966 3.79e-8 ✓
morley Speed by Expt [4 vs 5] 100 diff 11 11 0 ✓
morley Speed by Expt [4 vs 5] 100 lwr -54.2801 -54.2801 1.88e-5 ✓
morley Speed by Expt [4 vs 5] 100 upr 76.2801 76.2801 1.88e-5 ✓
Games-Howell 33/34 pass 1 past R's floor
dataset n metric R Plöttr |Δ|
iris Sepal.Width by Species [setosa vs versicolor] 150 pAdj 4.712e-10 7.434e-15 1.11e+1 R-floor
iris Sepal.Width by Species [setosa vs virginica] 150 pAdj 1.413e-8 1.369e-8 3.16e-2 ✓
iris Sepal.Width by Species [versicolor vs virginica] 150 pAdj 0.00512957 0.00512963 1.19e-5 ✓
chickwts weight by feed [casein vs horsebean] 71 pAdj 9.436e-6 9.436e-6 4.75e-5 ✓
chickwts weight by feed [casein vs linseed] 71 pAdj 0.00310158 0.00310163 1.66e-5 ✓
chickwts weight by feed [casein vs meatmeal] 71 pAdj 0.52927 0.52927 8.79e-8 ✓
chickwts weight by feed [casein vs soybean] 71 pAdj 0.0360428 0.0360429 1.38e-7 ✓
chickwts weight by feed [casein vs sunflower] 71 pAdj 0.9999 0.9999 4.17e-8 ✓
chickwts weight by feed [horsebean vs linseed] 71 pAdj 0.0649384 0.0649386 1.29e-7 ✓
chickwts weight by feed [horsebean vs meatmeal] 71 pAdj 0.00123741 0.00123743 1.83e-5 ✓
chickwts weight by feed [horsebean vs soybean] 71 pAdj 0.00190148 0.00190152 2.07e-5 ✓
chickwts weight by feed [horsebean vs sunflower] 71 pAdj 2.307e-7 2.307e-7 1.04e-4 ✓
chickwts weight by feed [linseed vs meatmeal] 71 pAdj 0.220931 0.220931 2.28e-8 ✓
chickwts weight by feed [linseed vs soybean] 71 pAdj 0.7689 0.768899 2.07e-7 ✓
chickwts weight by feed [linseed vs sunflower] 71 pAdj 3.042e-4 3.043e-4 3.53e-5 ✓
chickwts weight by feed [meatmeal vs soybean] 71 pAdj 0.805998 0.805998 2.20e-7 ✓
chickwts weight by feed [meatmeal vs sunflower] 71 pAdj 0.303003 0.303003 1.67e-8 ✓
chickwts weight by feed [soybean vs sunflower] 71 pAdj 0.00508811 0.00508819 1.46e-5 ✓
ChickWeight@21 weight by Diet [1 vs 2] 45 pAdj 0.585013 0.585013 8.15e-9 ✓
ChickWeight@21 weight by Diet [1 vs 3] 45 pAdj 0.015882 0.0158821 7.22e-8 ✓
ChickWeight@21 weight by Diet [1 vs 4] 45 pAdj 0.0352968 0.0352969 8.89e-8 ✓
ChickWeight@21 weight by Diet [2 vs 3] 45 pAdj 0.37313 0.37313 5.51e-9 ✓
ChickWeight@21 weight by Diet [2 vs 4] 45 pAdj 0.8378 0.8378 1.54e-9 ✓
ChickWeight@21 weight by Diet [3 vs 4] 45 pAdj 0.647029 0.647029 1.30e-8 ✓
morley Speed by Expt [1 vs 2] 100 pAdj 0.313041 0.313041 1.25e-8 ✓
morley Speed by Expt [1 vs 3] 100 pAdj 0.211477 0.211477 1.03e-8 ✓
morley Speed by Expt [1 vs 4] 100 pAdj 0.020733 0.0207332 1.19e-7 ✓
morley Speed by Expt [1 vs 5] 100 pAdj 0.0473606 0.0473607 1.18e-7 ✓
morley Speed by Expt [2 vs 3] 100 pAdj 0.987619 0.987619 3.50e-8 ✓
morley Speed by Expt [2 vs 4] 100 pAdj 0.359868 0.359868 1.84e-8 ✓
morley Speed by Expt [2 vs 5] 100 pAdj 0.668221 0.668221 5.95e-9 ✓
morley Speed by Expt [3 vs 4] 100 pAdj 0.803664 0.803664 5.25e-9 ✓
morley Speed by Expt [3 vs 5] 100 pAdj 0.969207 0.969207 1.51e-8 ✓
morley Speed by Expt [4 vs 5] 100 pAdj 0.972943 0.972943 1.85e-8 ✓
Dunn (BH) 67/67 pass
dataset n metric R Plöttr |Δ|
InsectSprays count by spray [A vs B] 72 pAdj 0.808375 0.808375 1.39e-7 ✓
InsectSprays count by spray [A vs C] 72 pAdj 9.027e-6 9.038e-6 1.26e-3 ✓
InsectSprays count by spray [A vs D] 72 pAdj 0.00303919 0.00303942 7.40e-5 ✓
InsectSprays count by spray [A vs E] 72 pAdj 2.946e-4 2.948e-4 3.67e-4 ✓
InsectSprays count by spray [A vs F] 72 pAdj 0.790447 0.790447 9.73e-8 ✓
InsectSprays count by spray [B vs C] 72 pAdj 2.731e-6 2.736e-6 1.72e-3 ✓
InsectSprays count by spray [B vs D] 72 pAdj 0.00113047 0.00113065 1.64e-4 ✓
InsectSprays count by spray [B vs E] 72 pAdj 9.412e-5 9.417e-5 5.94e-4 ✓
InsectSprays count by spray [B vs F] 72 pAdj 0.926028 0.926028 1.26e-7 ✓
InsectSprays count by spray [C vs D] 72 pAdj 0.146427 0.146427 5.71e-8 ✓
InsectSprays count by spray [C vs E] 72 pAdj 0.485079 0.485079 6.76e-8 ✓
InsectSprays count by spray [C vs F] 72 pAdj 2.731e-6 2.736e-6 1.72e-3 ✓
InsectSprays count by spray [D vs E] 72 pAdj 0.579471 0.579471 1.85e-7 ✓
InsectSprays count by spray [D vs F] 72 pAdj 9.138e-4 9.140e-4 2.00e-4 ✓
InsectSprays count by spray [E vs F] 72 pAdj 7.800e-5 7.806e-5 6.75e-4 ✓
PlantGrowth weight by group [ctrl vs trt1] 30 pAdj 0.263684 0.263684 9.06e-8 ✓
PlantGrowth weight by group [ctrl vs trt2] 30 pAdj 0.136746 0.136746 8.45e-8 ✓
PlantGrowth weight by group [trt1 vs trt2] 30 pAdj 0.0150009 0.0150012 3.65e-7 ✓
chickwts weight by feed [casein vs horsebean] 71 pAdj 1.115e-5 1.116e-5 1.31e-3 ✓
chickwts weight by feed [casein vs linseed] 71 pAdj 0.002816 0.00281635 1.23e-4 ✓
chickwts weight by feed [casein vs meatmeal] 71 pAdj 0.196059 0.196059 1.22e-7 ✓
chickwts weight by feed [casein vs soybean] 71 pAdj 0.0232914 0.0232914 5.44e-8 ✓
chickwts weight by feed [casein vs sunflower] 71 pAdj 0.854822 0.854822 1.68e-8 ✓
chickwts weight by feed [horsebean vs linseed] 71 pAdj 0.145753 0.145753 5.90e-8 ✓
chickwts weight by feed [horsebean vs meatmeal] 71 pAdj 0.002816 0.00281635 1.23e-4 ✓
chickwts weight by feed [horsebean vs soybean] 71 pAdj 0.019855 0.0198551 1.46e-7 ✓
chickwts weight by feed [horsebean vs sunflower] 71 pAdj 9.174e-6 9.188e-6 1.56e-3 ✓
chickwts weight by feed [linseed vs meatmeal] 71 pAdj 0.114645 0.114644 1.90e-7 ✓
chickwts weight by feed [linseed vs soybean] 71 pAdj 0.375737 0.375737 4.49e-8 ✓
chickwts weight by feed [linseed vs sunflower] 71 pAdj 0.00240372 0.00240417 1.87e-4 ✓
chickwts weight by feed [meatmeal vs soybean] 71 pAdj 0.375737 0.375737 4.49e-8 ✓
chickwts weight by feed [meatmeal vs sunflower] 71 pAdj 0.151062 0.151062 1.92e-9 ✓
chickwts weight by feed [soybean vs sunflower] 71 pAdj 0.0178738 0.017874 2.39e-7 ✓
ChickWeight@21 weight by Diet [1 vs 2] 45 pAdj 0.299541 0.299541 1.96e-7 ✓
ChickWeight@21 weight by Diet [1 vs 3] 45 pAdj 0.0125312 0.012532 8.23e-7 ✓
ChickWeight@21 weight by Diet [1 vs 4] 45 pAdj 0.104315 0.104315 3.71e-7 ✓
ChickWeight@21 weight by Diet [2 vs 3] 45 pAdj 0.21136 0.211359 3.08e-8 ✓
ChickWeight@21 weight by Diet [2 vs 4] 45 pAdj 0.432136 0.432136 1.36e-7 ✓
ChickWeight@21 weight by Diet [3 vs 4] 45 pAdj 0.432136 0.432136 1.36e-7 ✓
OrchardSprays decrease by treatment [A vs B] 64 pAdj 0.662034 0.662034 5.81e-8 ✓
OrchardSprays decrease by treatment [A vs C] 64 pAdj 0.0902369 0.0902366 2.62e-7 ✓
OrchardSprays decrease by treatment [A vs D] 64 pAdj 0.026751 0.0267511 1.33e-7 ✓
OrchardSprays decrease by treatment [A vs E] 64 pAdj 6.313e-4 6.315e-4 3.74e-4 ✓
OrchardSprays decrease by treatment [A vs F] 64 pAdj 1.892e-4 1.893e-4 6.23e-4 ✓
OrchardSprays decrease by treatment [A vs G] 64 pAdj 1.561e-4 1.562e-4 7.20e-4 ✓
OrchardSprays decrease by treatment [A vs H] 64 pAdj 8.379e-6 8.394e-6 1.78e-3 ✓
OrchardSprays decrease by treatment [B vs C] 64 pAdj 0.222062 0.222062 1.29e-7 ✓
OrchardSprays decrease by treatment [B vs D] 64 pAdj 0.085104 0.0851037 2.76e-7 ✓
OrchardSprays decrease by treatment [B vs E] 64 pAdj 0.00310385 0.00310425 1.28e-4 ✓
OrchardSprays decrease by treatment [B vs F] 64 pAdj 0.00100907 0.00100933 2.62e-4 ✓
OrchardSprays decrease by treatment [B vs G] 64 pAdj 7.698e-4 7.701e-4 3.18e-4 ✓
OrchardSprays decrease by treatment [B vs H] 64 pAdj 6.305e-5 6.311e-5 1.02e-3 ✓
OrchardSprays decrease by treatment [C vs D] 64 pAdj 0.646969 0.646969 1.16e-7 ✓
OrchardSprays decrease by treatment [C vs E] 64 pAdj 0.103518 0.103517 2.30e-7 ✓
OrchardSprays decrease by treatment [C vs F] 64 pAdj 0.0564895 0.0564893 1.92e-7 ✓
OrchardSprays decrease by treatment [C vs G] 64 pAdj 0.0461801 0.04618 1.05e-7 ✓
OrchardSprays decrease by treatment [C vs H] 64 pAdj 0.00508702 0.00508744 8.12e-5 ✓
OrchardSprays decrease by treatment [D vs E] 64 pAdj 0.272922 0.272922 1.82e-7 ✓
OrchardSprays decrease by treatment [D vs F] 64 pAdj 0.159767 0.159767 3.68e-8 ✓
OrchardSprays decrease by treatment [D vs G] 64 pAdj 0.135025 0.135025 1.35e-7 ✓
OrchardSprays decrease by treatment [D vs H] 64 pAdj 0.026751 0.0267511 1.33e-7 ✓
OrchardSprays decrease by treatment [E vs F] 64 pAdj 0.764338 0.764339 1.31e-7 ✓
OrchardSprays decrease by treatment [E vs G] 64 pAdj 0.708189 0.70819 5.17e-8 ✓
OrchardSprays decrease by treatment [E vs H] 64 pAdj 0.275685 0.275685 1.75e-7 ✓
OrchardSprays decrease by treatment [F vs G] 64 pAdj 0.914434 0.914433 1.08e-7 ✓
OrchardSprays decrease by treatment [F vs H] 64 pAdj 0.450625 0.450624 5.99e-8 ✓
OrchardSprays decrease by treatment [G vs H] 64 pAdj 0.502321 0.50232 1.47e-7 ✓
Cohen's d (pooled) 18/18 pass
dataset n metric R Plöttr |Δ|
sleep extra: group 1 vs group 2 20 d -0.832181 -0.832181 4.61e-13 ✓
sleep extra: group 1 vs group 2 20 CI95.lo -1.73882 -1.73882 4.70e-7 ✓
sleep extra: group 1 vs group 2 20 CI95.hi 0.0954504 0.09545 4.33e-7 ✓
iris Sepal.Length: setosa vs versicolor 100 d -2.1042 -2.1042 9.82e-12 ✓
iris Sepal.Length: setosa vs versicolor 100 CI95.lo -2.59079 -2.59079 6.71e-8 ✓
iris Sepal.Length: setosa vs versicolor 100 CI95.hi -1.61057 -1.61057 6.15e-8 ✓
iris Sepal.Length: versicolor vs virginica 100 d -1.12583 -1.12583 4.40e-11 ✓
iris Sepal.Length: versicolor vs virginica 100 CI95.lo -1.54576 -1.54576 8.51e-9 ✓
iris Sepal.Length: versicolor vs virginica 100 CI95.hi -0.700927 -0.700927 9.76e-8 ✓
ChickWeight@21: Diet 1 vs Diet 4 (unequal SD) 25 d -1.12895 -1.12895 2.66e-11 ✓
ChickWeight@21: Diet 1 vs Diet 4 (unequal SD) 25 CI95.lo -1.9971 -1.9971 1.49e-7 ✓
ChickWeight@21: Diet 1 vs Diet 4 (unequal SD) 25 CI95.hi -0.239638 -0.239638 3.31e-7 ✓
swiss Fertility: high vs low Catholic (unequal SD) 47 d 0.885867 0.885867 4.79e-12 ✓
swiss Fertility: high vs low Catholic (unequal SD) 47 CI95.lo 0.265593 0.265594 2.84e-7 ✓
swiss Fertility: high vs low Catholic (unequal SD) 47 CI95.hi 1.49715 1.49715 1.60e-7 ✓
morley Speed: Expt 1 vs Expt 5 40 d 0.927987 0.927987 2.00e-12 ✓
morley Speed: Expt 1 vs Expt 5 40 CI95.lo 0.26875 0.26875 1.47e-7 ✓
morley Speed: Expt 1 vs Expt 5 40 CI95.hi 1.57624 1.57624 9.81e-8 ✓
Cohen's d_av 6/6 pass
dataset n metric R Plöttr |Δ|
sleep extra: group 1 vs group 2 20 d_av -0.833496 -0.833496 2.70e-12 ✓
iris Sepal.Length: setosa vs versicolor 100 d_av -2.14123 -2.14123 3.48e-11 ✓
iris Sepal.Length: versicolor vs virginica 100 d_av -1.13189 -1.13189 4.24e-11 ✓
ChickWeight@21: Diet 1 vs Diet 4 (unequal SD) 25 d_av -1.19168 -1.19168 8.79e-12 ✓
swiss Fertility: high vs low Catholic (unequal SD) 47 d_av 0.860229 0.860229 1.67e-12 ✓
morley Speed: Expt 1 vs Expt 5 40 d_av 0.973952 0.973952 2.44e-12 ✓
Hedges' g 6/6 pass
dataset n metric R Plöttr |Δ|
sleep extra: group 1 vs group 2 20 g -0.796935 -0.796935 1.12e-12 ✓
iris Sepal.Length: setosa vs versicolor 100 g -2.08805 -2.08805 4.20e-11 ✓
iris Sepal.Length: versicolor vs virginica 100 g -1.11719 -1.11719 4.18e-11 ✓
ChickWeight@21: Diet 1 vs Diet 4 (unequal SD) 25 g -1.09166 -1.09166 2.62e-11 ✓
swiss Fertility: high vs low Catholic (unequal SD) 47 g 0.871007 0.871007 2.74e-12 ✓
morley Speed: Expt 1 vs Expt 5 40 g 0.90953 0.90953 2.02e-12 ✓
Cohen's f (ANOVA) 6/6 pass
dataset n metric R Plöttr |Δ|
iris Sepal.Length by Species (equal n=50/50/50) 150 f 1.27383 1.27383 4.25e-11 ✓
PlantGrowth weight by group (equal n=10) 30 f 0.599141 0.599141 4.42e-12 ✓
ToothGrowth len by dose (equal n=20) 60 f 1.53801 1.53801 9.32e-13 ✓
ChickWeight@21 weight by Diet (unequal n=16,10,10,9) 45 f 0.5836 0.5836 1.79e-12 ✓
morley Speed by Expt (equal n=20) 100 f 0.424899 0.424899 6.86e-13 ✓
OrchardSprays decrease by treatment (unequal) 64 f 1.54361 1.54361 3.32e-11 ✓
pairwise distance 3/3 pass
dataset n metric R Plöttr |Δ|
100x15 Gaussian · euclidean 100 sorted d (max |Δ|) 7.1485 7.1485 1.35e-10 ✓
100x15 Gaussian · manhattan 100 sorted d (max |Δ|) 18.6404 18.6404 3.34e-10 ✓
100x15 Gaussian · correlation 100 sorted d (max |Δ|) 1.32192 1.32192 6.28e-11 ✓
hclust heights 5/5 pass
dataset n metric R Plöttr |Δ|
100x15 · euclidean · average 100 sorted h (max |Δ|) 3.51606 3.51606 8.34e-11 ✓
100x15 · euclidean · complete 100 sorted h (max |Δ|) 8.40898 8.40898 9.18e-11 ✓
100x15 · euclidean · single 100 sorted h (max |Δ|) 3.33828 3.33828 8.37e-11 ✓
100x15 · manhattan · average 100 sorted h (max |Δ|) 13.5989 13.5989 1.99e-10 ✓
100x15 · correlation · average 100 sorted h (max |Δ|) 1.03312 1.03312 4.09e-11 ✓
Pearson r 32/32 pass
dataset n metric R Plöttr |Δ|
iris Sepal.Length vs Sepal.Width 150 r -0.11757 -0.11757 3.00e-12 ✓
iris Sepal.Length vs Sepal.Width 150 p 0.151898 0.151898 1.42e-12 ✓
iris Sepal.Length vs Sepal.Width 150 ci_lo -0.272693 -0.272693 1.24e-10 ✓
iris Sepal.Length vs Sepal.Width 150 ci_hi 0.0435116 0.0435116 1.30e-10 ✓
iris Petal.Length vs Petal.Width 150 r 0.962865 0.962865 2.80e-12 ✓
iris Petal.Length vs Petal.Width 150 p 4.675e-86 4.675e-86 7.22e-12 ✓
iris Petal.Length vs Petal.Width 150 ci_lo 0.949052 0.949052 1.18e-11 ✓
iris Petal.Length vs Petal.Width 150 ci_hi 0.972985 0.972985 5.74e-12 ✓
mtcars mpg vs hp 32 r -0.776168 -0.776168 3.41e-12 ✓
mtcars mpg vs hp 32 p 1.788e-7 1.788e-7 1.18e-11 ✓
mtcars mpg vs hp 32 ci_lo -0.885269 -0.885269 5.90e-11 ✓
mtcars mpg vs hp 32 ci_hi -0.586099 -0.586099 1.97e-10 ✓
mtcars wt vs mpg 32 r -0.867659 -0.867659 2.77e-12 ✓
mtcars wt vs mpg 32 p 1.294e-10 1.294e-10 3.82e-11 ✓
mtcars wt vs mpg 32 ci_lo -0.933826 -0.933826 4.25e-11 ✓
mtcars wt vs mpg 32 ci_hi -0.744087 -0.744087 1.31e-10 ✓
trees Girth vs Height 31 r 0.51928 0.51928 6.29e-14 ✓
trees Girth vs Height 31 p 0.00275781 0.00275781 1.53e-11 ✓
trees Girth vs Height 31 ci_lo 0.202133 0.202133 2.85e-10 ✓
trees Girth vs Height 31 ci_hi 0.737854 0.737854 1.41e-10 ✓
swiss Education vs Fertility 47 r -0.663789 -0.663789 4.93e-12 ✓
swiss Education vs Fertility 47 p 3.659e-7 3.659e-7 1.03e-11 ✓
swiss Education vs Fertility 47 ci_lo -0.798708 -0.798708 8.16e-11 ✓
swiss Education vs Fertility 47 ci_hi -0.465321 -0.465321 1.89e-10 ✓
women height vs weight 15 r 0.995495 0.995495 4.22e-12 ✓
women height vs weight 15 p 1.091e-14 1.091e-14 1.99e-13 ✓
women height vs weight 15 ci_lo 0.986097 0.986097 1.18e-11 ✓
women height vs weight 15 ci_hi 0.998545 0.998545 2.16e-12 ✓
tied-on-both (8 pairs) 8 r 0.8 0.8 0 ✓
tied-on-both (8 pairs) 8 p 0.01712 0.01712 1.04e-17 ✓
tied-on-both (8 pairs) 8 ci_lo 0.218509 0.218509 6.74e-10 ✓
tied-on-both (8 pairs) 8 ci_hi 0.962228 0.962228 5.29e-11 ✓
Spearman rho 15/16 pass 1 past R's floor
dataset n metric R Plöttr |Δ|
iris Sepal.Length vs Sepal.Width 150 rho -0.166778 -0.166778 3.23e-12 ✓
iris Sepal.Length vs Sepal.Width 150 p 0.041368 0.041368 1.53e-13 ✓
iris Petal.Length vs Petal.Width 150 rho 0.937667 0.937667 3.66e-12 ✓
iris Petal.Length vs Petal.Width 150 p 8.157e-70 8.157e-70 3.13e-12 ✓
mtcars mpg vs hp 32 rho -0.894665 -0.894665 3.75e-14 ✓
mtcars mpg vs hp 32 p 5.086e-12 5.086e-12 4.83e-12 ✓
mtcars wt vs mpg 32 rho -0.886422 -0.886422 2.98e-13 ✓
mtcars wt vs mpg 32 p 1.488e-11 1.488e-11 1.85e-11 ✓
trees Girth vs Height 31 rho 0.440839 0.440839 2.48e-12 ✓
trees Girth vs Height 31 p 0.013056 0.013056 3.58e-13 ✓
swiss Education vs Fertility 47 rho -0.443258 -0.443258 9.88e-13 ✓
swiss Education vs Fertility 47 p 0.00180597 0.00180597 2.57e-11 ✓
women height vs weight 15 rho 1 1 0 ✓
women height vs weight 15 p 3.509e-101 0 3.51e-101 R-floor
tied-on-both (8 pairs) 8 rho 0.8 0.8 0 ✓
tied-on-both (8 pairs) 8 p 0.01712 0.01712 1.04e-17 ✓
Kendall tau 16/16 pass
dataset n metric R Plöttr |Δ|
iris Sepal.Length vs Sepal.Width 150 tau -0.0769968 -0.0769968 4.83e-13 ✓
iris Sepal.Length vs Sepal.Width 150 p 0.182921 0.182921 1.25e-7 ✓
iris Petal.Length vs Petal.Width 150 tau 0.806891 0.806891 1.52e-12 ✓
iris Petal.Length vs Petal.Width 150 p 2.443e-44 2.443e-44 1.35e-11 ✓
mtcars mpg vs hp 32 tau -0.742813 -0.742813 1.33e-12 ✓
mtcars mpg vs hp 32 p 4.332e-9 4.346e-9 3.27e-3 ✓
mtcars wt vs mpg 32 tau -0.727832 -0.727832 1.57e-12 ✓
mtcars wt vs mpg 32 p 6.706e-9 6.727e-9 3.10e-3 ✓
trees Girth vs Height 31 tau 0.316864 0.316864 4.72e-12 ✓
trees Girth vs Height 31 p 0.0139904 0.0139904 1.11e-8 ✓
swiss Education vs Fertility 47 tau -0.330611 -0.330611 1.94e-12 ✓
swiss Education vs Fertility 47 p 0.00139407 0.0013942 9.23e-5 ✓
women height vs weight 15 tau 1 1 0 ✓
women height vs weight 15 p 2.035e-7 2.038e-7 1.90e-3 ✓
tied-on-both (8 pairs) 8 tau 0.666667 0.666667 3.33e-12 ✓
tied-on-both (8 pairs) 8 p 0.0354981 0.035498 1.26e-7 ✓
Multi-set intersection (cpsets) 10/10 pass
dataset n metric R Plöttr |Δ|
k=2 hypergeometric 100 p 0.790837 0.790837 4.11e-12 ✓
k=2 moderate-large N 200 p 0.977532 0.977532 2.87e-12 ✓
k=2 small (near-1) 1000 p 0.0960315 0.0960315 1.63e-13 ✓
k=3 moderate 100 p 0.441005 0.441005 2.99e-12 ✓
k=3 N=1000 p~1e-3 1000 p 0.00304692 0.00304692 1.25e-11 ✓
k=3 N=5000 deeper 5000 p 1.724e-4 1.724e-4 1.37e-11 ✓
k=5 shallow 200 p 8.709e-4 8.709e-4 4.59e-7 ✓
k=5 N=10000 deep 10000 p 2.250e-15 2.250e-15 2.09e-7 ✓
k=2 deep tail ~1e-31 1000 p 6.086e-31 6.086e-31 1.32e-10 ✓
k=2 very deep tail ~1e-14 500 p 3.122e-14 3.122e-14 2.28e-12 ✓