Lessons and exercises follow the school system and stay in its language.Les leçons et les exercices suivent le système scolaire et restent dans sa langue.Lektionen und Übungen folgen dem Schulsystem und bleiben in seiner Sprache.

Significance tests

Revision sheet

All the summary cards of the chapter on one page. Print it, or save it as a PDF from the print window.

Lesson 4 · Conclusions, errors and power

Conclusions and errors

  • P ≤ α: reject H₀. Otherwise: fail to reject.
  • Type I: reject true H₀. Type II: keep false H₀.
  • Power rises with nn.

Watch out: never "accept" or "prove" H₀.

Lesson 5 · The one-sample t test for a mean

t test for μ

t=(xˉ−μ0)/(s/n)t = (\bar{x} - \mu_0)/(s/\sqrt{n}), df =n−1= n - 1; two-sided: double the tail.

Watch out: failing to reject is not proving H₀.

Lesson 6 · Chi-square tests

Chi-square tests

χ2=∑(O−E)2/E\chi^2 = \sum (O - E)^2/E; GOF: E=npE = np; two-way: E=E = row × column / total.

Watch out: divide by EE; use counts, not percentages.

Lesson 7 · Exact p-values for a coin

Coin p-values

  • All heads: 12n\dfrac{1}{2^n}.
  • At least n−1n - 1: n+12n\dfrac{n + 1}{2^n}.

Sign tests in medicine use exactly this idea: did more patients improve than chance allows?

Lesson 8 · History of significance tests: Arbuthnot, Pearson and Fisher

Significance tests today

  • Medicine: does a new drug work better than a placebo?
  • Websites: does a new design get more clicks (A/B tests)?
  • Quality control: is a machine still making parts to specification?

Sources: MacTutor biographies of Arbuthnot, Pearson and Fisher (see "Sources and credits").