Bias in sampling

Lessons and exercises follow the school system and stay in its language.Les leçons et les exercices suivent le système scolaire et restent dans sa langue.Lektionen und Übungen folgen dem Schulsystem und bleiben in seiner Sprache.

About this lesson

Grade 7 › Probability and sampling

To save a PDF, choose “Save as PDF” in the print dialog.

Sources and credits

Written with this source as a starting point:

sedifier rewrote the text and added its own examples and exercises.

Written with AI assistance; every answer is checked by our math engine. Not yet reviewed by a teacher.

This lesson: CC BY-SA 4.0, © sedifier · All credits

Bias in sampling

Probability and sampling. probability, chance experiments, simulation, sample space, random samples, sampling

Warm-up

Three quick questions from earlier lessons.

  1. A school has 600 juniors and 300 seniors. A stratified sample of 90 students is taken in proportion to grade. How many juniors are in the sample?
  2. A systematic sample of 28 customers is taken from a list of 140: a random start, then every kkth name. What is kk?
  3. A district has 60 classrooms. Five are chosen at random and every student in them is surveyed. Which sampling method is this?
    1. Cluster sampling
    2. Stratified sampling
    3. A simple random sample of students

Discover

A TV show asks viewers to text in their opinion; 50,000 do. Is that a better sample than 1,000 randomly chosen adults?

  1. No, the random 1,000 is better
  2. Yes, it is 50 times bigger

Key idea

Bias is a systematic error from how data are collected.

Voluntary response: people choose to respond. Convenience sampling: easy-to-reach individuals. Undercoverage: part of the population cannot be chosen. Nonresponse: chosen people do not answer. Response bias: wording or setting distorts answers. A larger sample does not reduce bias.

Worked example

A survey by phone at 2 p.m. on weekdays.

Working adults are rarely reached
Who is home?
Undercoverage
They cannot be in the sample.
The bias does not shrink with more calls
The estimate leans towards people at home.

Your turn, guided

Your turn: of 1,200 people chosen, 300 answered. The response rate as a fraction:

14\tfrac{1}{4}
300 ÷ 1,200: a high risk of nonresponse bias.

Practice ★

  1. A news website asks readers to vote online; 4824 vote and 80% favor a new law. What is the main problem?
    1. Voluntary response bias: people with strong opinions choose to respond
    2. The sample is too small
    3. None: 4824 responses are representative
  1. A survey of 115 adults is done by calling landline numbers. What kind of bias is most likely?
    1. Undercoverage: people without landlines cannot be chosen
    2. Response bias from the wording
    3. None, if the numbers are chosen at random

Watch out!

Practice ★★

  1. A biased survey of 238 people is repeated with 10 times as many people, chosen the same way. What happens to the bias?
    1. It stays: a larger sample reduces random variability, not bias
    2. It disappears
    3. It becomes 10 times smaller
  2. A biased survey of 402 people is repeated with 10 times as many people, chosen the same way. What happens to the bias?
    1. It stays: a larger sample reduces random variability, not bias
    2. It disappears
    3. It becomes 10 times smaller

Exit ticket

Three questions to check you have got it.

  1. A news website asks readers to vote online; 4824 vote and 80% favor a new law. What is the main problem?
    1. Voluntary response bias: people with strong opinions choose to respond
    2. The sample is too small
    3. None: 4824 responses are representative
  2. A news website asks readers to vote online; 1714 vote and 80% favor a new law. What is the main problem?
    1. Voluntary response bias: people with strong opinions choose to respond
    2. The sample is too small
    3. None: 1714 responses are representative
  3. A news website asks readers to vote online; 3716 vote and 80% favor a new law. What is the main problem?
    1. Voluntary response bias: people with strong opinions choose to respond
    2. The sample is too small
    3. None: 3716 responses are representative

Summary card

Bias

Voluntary response, convenience, undercoverage, nonresponse, response bias.

Watch out: a bigger biased sample is still biased.

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. A phone survey of a town of 2200 adults can only reach the 52% who have a listed number. How many adults can never be chosen (undercoverage)?
Sources and credits

Written with this source as a starting point:

sedifier rewrote the text and added its own examples and exercises.

Written with AI assistance; every answer is checked by our math engine. Not yet reviewed by a teacher.

This lesson: CC BY-SA 4.0, © sedifier · All credits