Discover
Around 1800, astronomers had more observations of a comet than they needed, and the observations did not quite agree. How could they combine them?
- Choose the orbit that makes the squared errors as small as possible
- Keep only the best observation
Key idea
From comets to heights of children.
- Step 1Adrien-Marie Legendre 1752–1833Unknown artist. Public domain1806: Legendre's book on comet orbits gives the least-squares method in an appendix.
- Step 2Carl Friedrich Gauss 1777–1855Gottlieb Biermann / After Christian Albrecht Jensen, 1840. Public domain1809: Gauss publishes his own version of least squares.
- Step 3Francis Galton 1822–1911Eveleen Myers (née Tennant), 1890s. Public domainGalton (born 1822) compares heights of parents and children and names regression.
Legendre gave the least-squares method in an appendix to his 1806 book on comet orbits; Gauss published his version in 1809. Later Francis Galton (born 1822) studied how tall children are compared with their parents: very tall parents tend to have children closer to the average. He called this regression, and drew the regression line.
Worked example
Galton's idea with numbers: a regression slope of 0.5 means that 10 cm above average for the parents predicts…
Practice ★
- In which book did Legendre first print the method of least squares, in 1806?
- A book on the orbits of comets
- A book on heights of children
- A book on games of chance
- Galton's regression: the slope is 0.7. Parents are 17 cm above average. How many cm above average is the predicted child?
- Galton's regression: the slope is 0.5. Parents are 12 cm above average. How many cm above average is the predicted child?
- Galton's line passes through the mean point (170 cm, 170 cm) with slope 0.7. Predict the height (cm) of the child of parents 19 cm above the mean, that is 189 cm.
Summary card
Regression today
- Economists predict prices and sales with regression lines.
- Doctors relate dose and effect, or age and blood pressure.
- Machine learning starts with least squares.
Sources: MacTutor biographies of Legendre, Gauss and Galton (see "Sources and credits").