The regression model and its conditions

Lessons and exercises follow the school system and stay in its language.Les leçons et les exercices suivent le système scolaire et restent dans sa langue.Lektionen und Übungen folgen dem Schulsystem und bleiben in seiner Sprache.

About this lesson

Statistics (AP-aligned) › Inference for regression

To save a PDF, choose “Save as PDF” in the print dialog.

Sources and credits

Written with this source as a starting point:

sedifier rewrote the text and added its own examples and exercises.

Written with AI assistance; every answer is checked by our math engine. Not yet reviewed by a teacher.

This lesson: CC BY-SA 4.0, © sedifier · All credits

The regression model and its conditions

Inference for regression.

Warm-up

Three quick questions from earlier lessons.

  1. A company claims that 80% of customers are satisfied. A researcher suspects fewer are. Which is the null hypothesis?
    1. H₀: p = 0.80
    2. H₀: p < 0.80
    3. H₀: p̂ = 0.80
  2. The mean wait at a clinic used to be 81 minutes. A manager wants to know whether it has changed, in either direction. Which alternative?
    1. Hₐ: μ ≠ 81
    2. Hₐ: μ > 81
    3. Hₐ: x̄ ≠ 81
  3. Why are hypotheses written about parameters such as p, not statistics such as p̂ (sample of 445)?
    1. Because we know p̂ exactly; the question is about the unknown population value
    2. Because statistics are harder to compute
    3. There is no difference between p and p̂

Discover

Two random samples of 30 students give regression slopes 2.1 and 2.6 for hours studied vs score. Why do they differ?

  1. Sampling variability: each sample estimates the same true slope
  2. One of the samples must be wrong

Key idea

A model for the population.

Population regression line: μy=β0+β1x\mu_y = \beta_0 + \beta_1 x, estimated by y^=a+bx\hat{y} = a + bx. Conditions for inference (LINER): Linear relationship, Independent observations, Normal residuals, Equal spread of residuals, Random sample or assignment.

Worked example

Checking the conditions with a residual plot.

Linear: residuals scattered around 0
No curve.
Equal spread across xx
No fan.
Roughly normal: no strong skew or outliers
Histogram of residuals.

Your turn, guided

Your turn: how many conditions are in LINER?

55
L, I, N, E, R.

Practice ★

  1. A regression on a random sample of 23 houses gives slope b. What does b estimate?
    1. The slope β₁ of the population regression line
    2. Nothing: b is the true slope
    3. The correlation r
  1. Which conditions are needed for inference about the slope from 75 pairs? Tick all that are.
    1. The true relationship is linear
    2. Observations are independent (random sample, 10% condition)
    3. Residuals are roughly normal
    4. Residuals have about equal spread for all x
    5. The correlation is above 0.5

Watch out!

Practice ★★

  1. The residual plot of a regression on 85 points fans out: residuals spread more as x grows. Which condition fails?
    1. Equal variance of the residuals
    2. Linearity
    3. Normality of the population

Exit ticket

Three questions to check you have got it.

  1. A regression on a random sample of 23 houses gives slope b. What does b estimate?
    1. The slope β₁ of the population regression line
    2. Nothing: b is the true slope
    3. The correlation r
  2. A regression on a random sample of 59 houses gives slope b. What does b estimate?
    1. The slope β₁ of the population regression line
    2. Nothing: b is the true slope
    3. The correlation r
  3. A regression on a random sample of 46 houses gives slope b. What does b estimate?
    1. The slope β₁ of the population regression line
    2. Nothing: b is the true slope
    3. The correlation r

Summary card

The regression model

y^=a+bx\hat{y} = a + bx estimates μy=β0+β1x\mu_y = \beta_0 + \beta_1 x. Conditions: LINER.

Watch out: no condition on the size of rr.

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. The regression model gives ŷ = 17 + 0.4x. By how much does the predicted y change when x increases by 10?
Sources and credits

Written with this source as a starting point:

sedifier rewrote the text and added its own examples and exercises.

Written with AI assistance; every answer is checked by our math engine. Not yet reviewed by a teacher.

This lesson: CC BY-SA 4.0, © sedifier · All credits