Outliers, leverage and influential points

Lessons and exercises follow the school system and stay in its language.Les leçons et les exercices suivent le système scolaire et restent dans sa langue.Lektionen und Übungen folgen dem Schulsystem und bleiben in seiner Sprache.

About this lesson

Statistics (AP-aligned) › Exploring two-variable data

To save a PDF, choose “Save as PDF” in the print dialog.

Sources and credits

Written with this source as a starting point:

sedifier rewrote the text and added its own examples and exercises.

Written with AI assistance; every answer is checked by our math engine. Not yet reviewed by a teacher.

This lesson: CC BY-SA 4.0, © sedifier · All credits

Outliers, leverage and influential points

Exploring two-variable data.

Warm-up

Three quick questions from earlier lessons.

  1. r=0.6r = 0.6, xˉ=13\bar{x} = 13, sx=5s_x = 5, yˉ=54\bar{y} = 54, sy=10s_y = 10.
    1. The slope bb:   ?\;?
    2. The intercept aa:   ?\;?
    3. A point (13,57)(13, 57) is in the data. Its residual:   ?\;?
    4. The fraction of the variation in yy explained by the line (r2r^2):
  2. y^=30+3x\hat{y} = 30 + 3x. A data point is (7,46)(7, 46). Find its residual.
  3. The residual plot of a linear model fitted to 56 points shows a clear U-shaped curve. What does that tell you?
    1. A straight line is not a good model: the relationship is curved
    2. The model is good, because residuals are both positive and negative
    3. There is one outlier

Discover

A scatterplot of 20 points has a line through them. One more point is added far to the right, well below the trend. What happens to the line?

  1. It tilts towards the new point
  2. Nothing: one point cannot change a line fitted to 20

Key idea

Some unusual points matter more than others.

An outlier in regression has a large residual. A high-leverage point has an xx-value far from xˉ\bar{x}. An influential point changes the slope (or intercept) a lot when removed; high-leverage points are often influential.

Worked example

Three unusual points.

Outlier in yy: lowers rr, barely moves the slope
x near x̄, large residual.
High leverage, not influential: it strengthens rr
x far away, on the trend.
High leverage and influential: tilts the line
x far away, off the trend.

Your turn, guided

Your turn: removing a point changes the slope from 2.1 to 0.4. By how much did the slope change?

1.71.7
2.1 − 0.4: influential.

Practice ★

  1. In a scatterplot, the xx-values lie between 10 and 51, except one point at x=153x = 153. What is that point called?
    1. A high-leverage point: its x is far from the others
    2. A point with a large residual
    3. The median point
  1. Removing one of 52 points changes the regression slope a lot. What is that point?
    1. An influential point
    2. Any outlier: all outliers change the slope a lot
    3. A typical point near the center of the data

Watch out!

Practice ★★

  1. Among 46 points, one has xx close to xˉ\bar{x} but a very large residual. Removing it mostly changes what?
    1. The correlation (it rises); the slope barely changes
    2. The slope a lot
    3. Nothing at all
  2. Among 77 points, one has xx close to xˉ\bar{x} but a very large residual. Removing it mostly changes what?
    1. The correlation (it rises); the slope barely changes
    2. The slope a lot
    3. Nothing at all

Exit ticket

Three questions to check you have got it.

  1. In a scatterplot, the xx-values lie between 10 and 51, except one point at x=153x = 153. What is that point called?
    1. A high-leverage point: its x is far from the others
    2. A point with a large residual
    3. The median point
  2. In a scatterplot, the xx-values lie between 10 and 36, except one point at x=108x = 108. What is that point called?
    1. A high-leverage point: its x is far from the others
    2. A point with a large residual
    3. The median point
  3. In a scatterplot, the xx-values lie between 10 and 30, except one point at x=90x = 90. What is that point called?
    1. A high-leverage point: its x is far from the others
    2. A point with a large residual
    3. The median point

Summary card

Unusual points

  • Outlier: large residual. Leverage: extreme xx.
  • Influential: removing it changes the line.

Watch out: leverage, not residual size, drives influence.

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. Removing one influential point changes the correlation from r=0.4r = 0.4 to r=0.7r = 0.7. By how much does r2r^2 increase?
Sources and credits

Written with this source as a starting point:

sedifier rewrote the text and added its own examples and exercises.

Written with AI assistance; every answer is checked by our math engine. Not yet reviewed by a teacher.

This lesson: CC BY-SA 4.0, © sedifier · All credits