Lessons and exercises follow the school system and stay in its language.Les leçons et les exercices suivent le système scolaire et restent dans sa langue.Lektionen und Übungen folgen dem Schulsystem und bleiben in seiner Sprache.

Associations in data

Revision sheet

All the summary cards of the chapter on one page. Print it, or save it as a PDF from the print window.

Lesson 1 · Scatterplots and correlation

Correlation

  • −1≤r≤1-1 \le r \le 1; sign = direction, size = linear strength.
  • Unitless; symmetric in xx and yy.

Watch out: rr only sees straight lines.

Lesson 2 · The least-squares regression line

Least-squares line

b=r sy/sxb = r\,s_y/s_x, a=yˉ−bxˉa = \bar{y} - b\bar{x}, through (xˉ,yˉ)(\bar{x}, \bar{y}).

Watch out: sys_y on top.

Lesson 3 · Residuals and residual plots

Residuals

  • e=y−y^e = y - \hat{y}; positive is above the line.
  • Residual plot: no pattern means a linear model is appropriate.

Watch out: observed minus predicted, in that order.

Lesson 7 · The least-squares line

Least squares

  • Minimize the sum of squared residuals.
  • The line passes through (xˉ,yˉ)(\bar{x}, \bar{y}).

Every spreadsheet's 'trend line' is a least-squares line.

Lesson 8 · History of regression: Legendre, Gauss and Galton

Regression today

  • Economists predict prices and sales with regression lines.
  • Doctors relate dose and effect, or age and blood pressure.
  • Machine learning starts with least squares.

Sources: MacTutor biographies of Legendre, Gauss and Galton (see "Sources and credits").