Post hoc tests are commonly used as a follow up to an F-test (such as one-way-ANOVA, factorial ANOVA, …). These tests may be performed only if the F-test shows that there exists a significant difference between the means of the tested groups. If not, post hoc tests are not be used!
There exist many different tests, more or less conservative and adpated to your design, and finding the right test to use is often a challenge as one may be tempted to use a less conservative test to find lower p-value, with the increased risk to get type I errors (incorrect rejection of the null hypothesis stating that there is no difference between means).
This section of bioSTATS is not intended to tell you which test to choose in each situation; there are plenty of courses and online resources that do it already in a great way. Instead we show you the way to perform some of these common tests in R.
Here are a few useful functions in R that run post hoc tests. Let’s have a closer look at them:
pairwise.t.test()
,TukeyHSD()
.