Date of this Version
The American Statistician
In a randomized 2×2 factorial trial, more than one hypothesis is to be tested, so some method must be used to control the probability of falsely rejecting at least one true hypothesis. We contrast familiar elementary methods of controlling the family-wise error rate based on the Bonferroni–Holm procedure with a less familiar but equally elementary form of structured testing associated with the large class of procedures that descend from the closed testing approach of Marcus, Peritz, and Gabriel. In a range of plausible situations, giving priority to main effects in structured testing typically yielded greater power to detect main effects for a given sample size or reduced sample size for a given power; it also permitted testing for interaction when main effects are found.
This is an Accepted Manuscript of an article published by Taylor & Francis in The American Statistician on 01 Jan 2012, available online: http://wwww.tandfonline.com/10.1198/tast.2011.10130.
factorial experiment, familywise error rate, multiple testing, ordered family of hypotheses
Small, D., Volpp, K. G., & Rosenbaum, P. R. (2011). Structured Testing of 2×2 Factorial Effects: An Analytic Plan Requiring Fewer Observations. The American Statistician, 65 (1), 11-15. http://dx.doi.org/10.1198/tast.2011.10130
Date Posted: 27 November 2017