You signed in with another tab or window.Reload to refresh your session.You signed out in another tab or window.Reload to refresh your session.You switched accounts on another tab or window.Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.Rmd
+3-5Lines changed: 3 additions & 5 deletions
Original file line number
Diff line number
Diff line change
@@ -33,7 +33,7 @@ temp %>%
33
33
rm(list = ls())
34
34
```
35
35
36
-
Each simulated experiment is based on a sample size of 500. Each combination of true hypothesis, parameter value, and testare repeated 5,000 times.
36
+
Each simulated experiment is based on a sample size of 500. Each combination of true hypothesis, parameter value, and testis repeated 5,000 times.
37
37
38
38
Detailed statistical analysis can be found in the type I and type II folders. Code to run the simulation is in the R Code folder.
39
39
@@ -192,9 +192,7 @@ rm(list = ls())
192
192
```
193
193
194
194
#One Way Type I Error Rate
195
-
Compared to the one sample tests, type I error rates are further from the .05 target.
196
-
197
-
For the one sample tests, all 500 data points are associated with one group. The one parameter is estimated using all 500 data points. For the one way tests, there are two groups and therefore two parameters estimated. Each parameter is based on only 250 data points. The cost of less data per parameter is a type I error further from the target 5%.
195
+
Compared to the one sample tests, type I error rates are further from the .05 target. The worst performing tests are within half a percentage point.
In addition to error rates, confidence interval coverage rates are estimated.Most functions have a coverage rate of 95%. The worst performing confidence intervals are within one percentage point.
473
+
Most functions have a coverage rate of 95%. The worst performing confidence intervals are within one percentage point.
Copy file name to clipboardExpand all lines: type II/README.Rmd
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -35,7 +35,7 @@ temp %>%
35
35
rm(list = ls())
36
36
```
37
37
38
-
Like type I calculations, each simulated experiment is based on a sample size of 500. Each combination of effect size and testare repeated 5,000 times. Where possible, exact tests are included for comparison.
38
+
Like type I calculations, each simulated experiment is based on a sample size of 500. Each combination of effect size and testis repeated 5,000 times. Where possible, exact tests are included for comparison.
39
39
40
40
#Overall Type II Error Rate
41
41
All tests achieve near 0% type II error for a large enough effect size.