Scope of inference: generalization and causation

Lessons and exercises follow the school system and stay in its language.Les leçons et les exercices suivent le système scolaire et restent dans sa langue.Lektionen und Übungen folgen dem Schulsystem und bleiben in seiner Sprache.

About this lesson

Statistics (AP-aligned) › Collecting data

To save a PDF, choose “Save as PDF” in the print dialog.

Sources and credits

Written with this source as a starting point:

sedifier rewrote the text and added its own examples and exercises.

Written with AI assistance; every answer is checked by our math engine. Not yet reviewed by a teacher.

This lesson: CC BY-SA 4.0, © sedifier · All credits

Scope of inference: generalization and causation

Collecting data.

Warm-up

Three quick questions from earlier lessons.

  1. A school has 600 juniors and 300 seniors. A stratified sample of 90 students is taken in proportion to grade. How many juniors are in the sample?
  2. A systematic sample of 28 customers is taken from a list of 140: a random start, then every kkth name. What is kk?
  3. A district has 60 classrooms. Five are chosen at random and every student in them is surveyed. Which sampling method is this?
    1. Cluster sampling
    2. Stratified sampling
    3. A simple random sample of students

Discover

A randomized experiment on 50 volunteer athletes shows a supplement improves sprint times. Can you say it helps all adults?

  1. No, only for these volunteers
  2. Yes, it was a randomized experiment

Key idea

Two kinds of randomness, two kinds of conclusions.

Random sampling → results can be generalized to the population. Random assignment → differences can be attributed to the treatment (cause and effect). Both → causal conclusions about the population. Blinding (single or double) and placebos keep expectations from affecting the results.

Worked example

Four studies.

Volunteers, no assignment: association in these people only
Neither.
Random sample, no assignment: association in the population
Sampling only.
Volunteers, random assignment: cause, in these subjects
Assignment only.

Your turn, guided

Your turn: how many of the four combinations (sampling yes/no × assignment yes/no) allow a causal conclusion about the whole population?

11
Only both random sampling and random assignment.

Practice ★

  1. A random sample of 493 adults in a city shows that those who walk to work report less stress. No treatment was assigned. What can be concluded?
    1. The association can be generalized to adults in the city, but not cause and effect
    2. Walking causes less stress for adults in the city
    3. Nothing beyond the 493 people sampled
  1. 147 volunteers are randomly assigned to a new or old teaching method; the new method scores higher. What can be concluded?
    1. The method caused the difference for these volunteers; generalizing beyond them is risky
    2. The new method works better for all students
    3. Nothing, because there was no random sample

Watch out!

Practice ★★

  1. In a drug trial with 64 patients, neither the patients nor the doctors who assess them know who receives the drug. What is this called?
    1. A double-blind experiment
    2. A placebo
    3. Blocking

Exit ticket

Three questions to check you have got it.

  1. A random sample of 493 adults in a city shows that those who walk to work report less stress. No treatment was assigned. What can be concluded?
    1. The association can be generalized to adults in the city, but not cause and effect
    2. Walking causes less stress for adults in the city
    3. Nothing beyond the 493 people sampled
  2. A random sample of 530 adults in a city shows that those who walk to work report less stress. No treatment was assigned. What can be concluded?
    1. The association can be generalized to adults in the city, but not cause and effect
    2. Walking causes less stress for adults in the city
    3. Nothing beyond the 530 people sampled
  3. A random sample of 712 adults in a city shows that those who walk to work report less stress. No treatment was assigned. What can be concluded?
    1. The association can be generalized to adults in the city, but not cause and effect
    2. Walking causes less stress for adults in the city
    3. Nothing beyond the 712 people sampled

Summary card

Scope of inference

  • Random sampling → generalize.
  • Random assignment → cause.

Watch out: you need both for a causal claim about a population.

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. In a random sample of 200 adults from a city of 17000, 50 walk to work. Estimate how many adults in the city walk to work.
Sources and credits

Written with this source as a starting point:

sedifier rewrote the text and added its own examples and exercises.

Written with AI assistance; every answer is checked by our math engine. Not yet reviewed by a teacher.

This lesson: CC BY-SA 4.0, © sedifier · All credits