Contrasts

Confidence interval of the difference between two group means is calculated as follows:
\[\hat{d} \pm t_{1-\alpha/2,N-I}\times \sqrt{MSE \bigg(\frac{1}{n_i}+\frac{1}{n_j} \bigg)}\]
If the confidence interval contains a zero there is not a significant difference between the two group means.
Details
If there is a significant difference between treatment groups there may be a interest in what that difference is. The difference between two treatment groups is a contrast and often called pairwise comparison. The difference between the means of two treatment groups is defined as:
\begin{equation*}
d=\mu_i-\mu_j
\end{equation*}
and is estimated as
\begin{equation*}
\hat{d}=\hat{\mu}_i-\hat{\mu}_j=\bar{y}_i.-\bar{y}_j.
\end{equation*}
The expected value of $\hat{d}$ is $E[\hat{d}]=\mu_i-\mu_j$ and the variance of $\hat{d}$ is $V[\hat{d}]=\sigma^2(\frac{1}{n_i}+\frac{1}{n_j})$ which is estimated by $MSE(\frac{1}{n_i}+\frac{1}{n_j})$. The difference $d$ is normally distributed and therefore a confidence interval of the difference is:
\[\hat{d} \pm t_{1-\alpha/2,N-I}\times \sqrt{MSE \bigg(\frac{1}{n_i}+\frac{1}{n_j} \bigg)}\]

If the interest is in testing if there is a difference between more than two treatment group means methods of multiple comparisons should be applied to control the type I error rate.
Examples
In the rat diet experiment a difference between the protein and carbohydrate diet group is:
\[\hat{d}=\hat{y}_2.-\hat{y}_3.=62.6-61.3=1.3\]
$MSE$ was found to be 14.9 and the table value of the t-distribution with 13 degrees of freedom is 2.16 and hence the confidence interval of the difference is:
\[1.3 \pm 2.16 \times \sqrt{14.9\bigg(\frac{1}{5}+\frac{1}{6}\bigg)}\]
\[-3.7 \le \mu_2-\mu_3 \le 6.3\]
A significance test can also be carried out to test if the treatment group means are the same. $\frac{\hat{d}-d}{ \sqrt{MSE (\frac{1}{n_i}+\frac{1}{n_j})}}$ follows a t-distribution with $N-I$ degrees of freedom. The null and alternative hypothesis are \[H_0: \mu_i-\mu_j=0\]
\[H_1: \mu_i-\mu_j\ne 0\]
The t statistic is then
\[t=\frac{\hat{d}-0}{ \sqrt{MSE \bigg(\frac{1}{n_i}+\frac{1}{n_j} \bigg)}}\]
In the rat diet experiment the test statistic for testing if the protein and carbohydrate group means are the same is:
\[t=\frac{1.3-0}{\sqrt{14.9\bigg(\frac{1}{5}+\frac{1}{6}\bigg)}}=0.56\]
the table value is $t_{0.975,13}=2.16$ and because $0.56=t<t_{0.975,13}=2.16$ the null hypothesis can not be rejected.\\