Warm-up
Three quick questions from earlier lessons.
- A school has 600 juniors and 300 seniors. A stratified sample of 90 students is taken in proportion to grade. How many juniors are in the sample?
- A systematic sample of 28 customers is taken from a list of 140: a random start, then every th name. What is ?
- A district has 60 classrooms. Five are chosen at random and every student in them is surveyed. Which sampling method is this?
- Cluster sampling
- Stratified sampling
- A simple random sample of students
Discover
A TV show asks viewers to text in their opinion; 50,000 do. Is that a better sample than 1,000 randomly chosen adults?
- No, the random 1,000 is better
- Yes, it is 50 times bigger
Key idea
Bias is a systematic error from how data are collected.
Worked example
A survey by phone at 2 p.m. on weekdays.
Your turn, guided
Your turn: of 1,200 people chosen, 300 answered. The response rate as a fraction:
Practice ★
- A news website asks readers to vote online; 4824 vote and 80% favor a new law. What is the main problem?
- Voluntary response bias: people with strong opinions choose to respond
- The sample is too small
- None: 4824 responses are representative
- A survey of 115 adults is done by calling landline numbers. What kind of bias is most likely?
- Undercoverage: people without landlines cannot be chosen
- Response bias from the wording
- None, if the numbers are chosen at random
Watch out!
Practice ★★
- A biased survey of 238 people is repeated with 10 times as many people, chosen the same way. What happens to the bias?
- It stays: a larger sample reduces random variability, not bias
- It disappears
- It becomes 10 times smaller
- A biased survey of 402 people is repeated with 10 times as many people, chosen the same way. What happens to the bias?
- It stays: a larger sample reduces random variability, not bias
- It disappears
- It becomes 10 times smaller
Exit ticket
Three questions to check you have got it.
- A news website asks readers to vote online; 4824 vote and 80% favor a new law. What is the main problem?
- Voluntary response bias: people with strong opinions choose to respond
- The sample is too small
- None: 4824 responses are representative
- A news website asks readers to vote online; 1714 vote and 80% favor a new law. What is the main problem?
- Voluntary response bias: people with strong opinions choose to respond
- The sample is too small
- None: 1714 responses are representative
- A news website asks readers to vote online; 3716 vote and 80% favor a new law. What is the main problem?
- Voluntary response bias: people with strong opinions choose to respond
- The sample is too small
- None: 3716 responses are representative
Summary card
Bias
Voluntary response, convenience, undercoverage, nonresponse, response bias.
Watch out: a bigger biased sample is still biased.
One more step is optional: a challenge. Try it, or finish the lesson now.
Challenge ★★★
- A phone survey of a town of 2200 adults can only reach the 52% who have a listed number. How many adults can never be chosen (undercoverage)?