Lessons and exercises follow the school system and stay in its language.Les leçons et les exercices suivent le système scolaire et restent dans sa langue.Lektionen und Übungen folgen dem Schulsystem und bleiben in seiner Sprache.
Every lesson of the chapter, ready for paper. Exercise sets are lettered A, B, C… and answered at the end.
To save a PDF, choose “Save as PDF” in the print dialog.
Statistics (AP-aligned)
Sampling distributions
NicknameDate
Scan to open onlineenglish.sedifier.com/en-us/us-ma-2017/statistics/us.stats.sampling-distributions/
1. Sampling variability and sampling distributions
Warm-up
Three quick questions from earlier lessons.
A researcher measures the sleep of 376 randomly chosen teenagers and finds a mean of 7.1 hours. What is 7.1?
A statistic: it describes the sample
A parameter: it describes all teenagers
The population
To learn how much US college students spend on books, a team surveys 671 students at 20 colleges. What is the population?
All US college students
The 671 students surveyed
The 20 colleges
Census records show that 52% of all households in a town own a car. What is 52%?
A parameter: it describes the whole population
A statistic
A sample proportion
Discover
Five classmates each survey 20 random students about a new rule. Will they all get the same percentage in favor?
No, the percentages will vary
Yes, if they all sample at random
Key idea
A statistic has a distribution of its own.
Step 110 samples: a few values of p̂, scattered.
Step 2100 samples: a shape appears.
Step 31,000 samples (scaled): a mound centered near p — the sampling distribution.
The sampling distribution of a statistic is its distribution over all possible random samples of the same size. Its center tells us about bias; its spread (standard error) shrinks as the sample size grows.
Worked example
Imagine 1,000 samples of 50 students and the p̂ of each.
A histogram of p̂ values
Plot the 1,000 values.
Centered near the true p
Where it is centered.
Narrower: less variability
With samples of 200 instead.
Your turn, guided
Your turn: by what factor does SD(x̄) change when n goes from 25 to 100?
It is halved: factor 21
√25/√100.
Practice ★
Many random samples of size 161 are taken from the same population. Which quantity changes from sample to sample?
The sample proportion p̂ (a statistic)
The population proportion p (a parameter)
The sample size
Compared with samples of size 73, samples of size 292 give sample means that…
vary less around the population mean
vary more
are more biased
Watch out!
Practice ★★
What is the sampling distribution of the sample mean for samples of size 25?
The distribution of x̄ over all possible samples of size 25
The distribution of the 25 values in one sample
The distribution of the population
Exit ticket
Three questions to check you have got it.
Many random samples of size 161 are taken from the same population. Which quantity changes from sample to sample?
The sample proportion p̂ (a statistic)
The population proportion p (a parameter)
The sample size
Many random samples of size 224 are taken from the same population. Which quantity changes from sample to sample?
The sample proportion p̂ (a statistic)
The population proportion p (a parameter)
The sample size
Many random samples of size 490 are taken from the same population. Which quantity changes from sample to sample?
The sample proportion p̂ (a statistic)
The population proportion p (a parameter)
The sample size
Summary card
Sampling variability
Statistics vary from sample to sample.
Sampling distribution: a statistic over all samples.
Larger n: less variability.
Watch out: data distribution vs sampling distribution.
One more step is optional: a challenge. Try it, or finish the lesson now.
Challenge ★★★
Samples of size 22 give sample means with a spread (standard deviation) of s. Samples of size 352 are taken instead. By what factor does the spread shrink?
2. The sampling distribution of a sample proportion
Warm-up
Three quick questions from earlier lessons.
In a random sample of 100, p̂ = 3/10. Build a 95% interval with z* = 1.96.
The standard error: ?
The margin of error: ?
The lower end of the interval: ?
The point estimate (center of the interval):
With a sample 4 times as large, the standard error is divided by:
A machine part is faulty with probability 1/5, independently. Four parts are tested; X counts the faulty ones.
P(X=0): ?
P(X≥1): ?
E(X): ?
σ(X):
The probability that the first two parts are faulty and the other two are not:
X is binomial with n = 30 and p = 1/10. Find E(X).
Discover
In a city 40% of adults cycle. In random samples of 100, around which value will p̂ be centered?
0.40
40
Key idea
Mean, spread and shape of p̂.
For random samples of size n from a population with proportion p: μp^=p and σp^=np(1−p) (if n is at most 10% of the population). The shape is approximately normal when np≥10 and n(1−p)≥10.
Worked example
p=0.4, n=100.
μp^=0.4
Center.
σp^=0.0024≈0.049
√(0.4 × 0.6/100).
Approximately normal
40 ≥ 10 and 60 ≥ 10.
Your turn, guided
Your turn: p=0.5, n=100. Find σp^.
0.05
√(0.25/100).
Practice ★
The population proportion is p = 8/10. Find the standard deviation of p̂ for random samples of size 83.
The population proportion is p = 2/10. Find the standard deviation of p̂ for random samples of size 227.
The population proportion is p = 5/10. What is the mean of the sampling distribution of p̂ for samples of size 351?
Watch out!
Practice ★★
The population proportion is p = 1/8. What is the smallest sample size n for which np ≥ 10 and n(1 − p) ≥ 10?
The population proportion is p = 1/2. What is the smallest sample size n for which np ≥ 10 and n(1 − p) ≥ 10?
Exit ticket
Three questions to check you have got it.
The population proportion is p = 8/10. Find the standard deviation of p̂ for random samples of size 83.
The population proportion is p = 2/10. Find the standard deviation of p̂ for random samples of size 227.
The population proportion is p = 4/10. Find the standard deviation of p̂ for random samples of size 394.
Summary card
Sampling distribution of p̂
μ=p, σ=p(1−p)/n; normal if np,n(1−p)≥10.
Watch out: proportion, not count.
One more step is optional: a challenge. Try it, or finish the lesson now.
Challenge ★★★
For p = 0.5, how large must the sample be for the standard deviation of p̂ to be 1001?
3. The sampling distribution of a sample mean
Warm-up
Three quick questions from earlier lessons.
In a random sample of 100, p̂ = 3/10. Build a 95% interval with z* = 1.96.
The standard error: ?
The margin of error: ?
The lower end of the interval: ?
The point estimate (center of the interval):
With a sample 4 times as large, the standard error is divided by:
X and Y are independent with SD(X) = 3 and SD(Y) = 4. Find SD(X + Y).
X and Y are independent with SD(X) = 12 and SD(Y) = 5. Find SD(X − Y).
Discover
Heights have SD 10 cm. Is the SD of the mean of 25 random heights also 10 cm?
No, it is 2 cm
Yes
Key idea
Mean and spread of x̄.
For random samples of size n from a population with mean μ and SD σ: μxˉ=μ and σxˉ=nσ. If the population is normal, xˉ is exactly normal.
Worked example
μ=170, σ=10, n=25. How unusual is xˉ=174?
σxˉ=2
10/5.
z=2
(174 − 170)/2.
Unusual (about 2.5% are higher)
Beyond 2 SDs.
Your turn, guided
Your turn: σ=12, n=16. Find σxˉ.
3
12/4.
Practice ★
A population has standard deviation σ = 26. Find the SD of the sample mean for samples of size 9.
A population has standard deviation σ = 84. Find the SD of the sample mean for samples of size 400.
A population has standard deviation σ = 29. Find the SD of the sample mean for samples of size 4.
Watch out!
Practice ★★
Samples of size 26 give a certain SD of x̄. By what factor must the sample size be multiplied to halve it?
A population has mean 76 and SD 5. A random sample of 4 has mean 77. Find the z-score of this sample mean.
A population has mean 62 and SD 14. A random sample of 16 has mean 69. Find the z-score of this sample mean.
Exit ticket
Three questions to check you have got it.
A population has standard deviation σ = 26. Find the SD of the sample mean for samples of size 9.
A population has standard deviation σ = 84. Find the SD of the sample mean for samples of size 400.
A population has standard deviation σ = 29. Find the SD of the sample mean for samples of size 4.
Summary card
Sampling distribution of x̄
μxˉ=μ, σxˉ=σ/n.
Watch out: divide by n, not n.
One more step is optional: a challenge. Try it, or finish the lesson now.
Challenge ★★★
For which sample size is the standard deviation of x̄ equal to 2σ?
4. The central limit theorem
Warm-up
Three quick questions from earlier lessons.
A population has standard deviation σ = 26. Find the SD of the sample mean for samples of size 9.
Samples of size 26 give a certain SD of x̄. By what factor must the sample size be multiplied to halve it?
A population has mean 76 and SD 5. A random sample of 4 has mean 77. Find the z-score of this sample mean.
Discover
Waiting times at a clinic are strongly right-skewed. You average the times of 50 random patients, many times over. What shape do these averages have?
Approximately normal
Right-skewed
Key idea
Averages tend to be normal.
Central limit theorem: for random samples of size n from any population with finite SD, the sampling distribution of xˉ is approximately normal when n is large (a common guide: n≥30, more for strong skew). It is about the distribution of sample means, not of the data.
Worked example
Three situations.
Any n: xˉ is normal
Normal population.
xˉ approximately normal (CLT)
Skewed population, n = 60.
xˉ still skewed: CLT does not apply yet
Skewed population, n = 4.
Your turn, guided
Your turn: a population with σ=15 and n=36. The SD of the (approximately normal) xˉ.
2.5
15/6.
Practice ★
Household incomes are strongly right-skewed. What is the shape of the sampling distribution of x̄ for random samples of 52 households?
Approximately normal, by the central limit theorem
Right-skewed like the population
Uniform
A population is strongly skewed. Is the sampling distribution of x̄ for samples of size 3 approximately normal?
Not necessarily: n = 3 is too small for the CLT to apply to a strongly skewed population
Yes, sample means are always normal
No, sample means are never normal
Watch out!
Practice ★★
Which statement is the central limit theorem, for random samples of size 166?
The distribution of sample means is approximately normal
The data in a large sample are approximately normal
The population becomes normal when n is large
Exit ticket
Three questions to check you have got it.
Household incomes are strongly right-skewed. What is the shape of the sampling distribution of x̄ for random samples of 52 households?
Approximately normal, by the central limit theorem
Right-skewed like the population
Uniform
Household incomes are strongly right-skewed. What is the shape of the sampling distribution of x̄ for random samples of 73 households?
Approximately normal, by the central limit theorem
Right-skewed like the population
Uniform
Household incomes are strongly right-skewed. What is the shape of the sampling distribution of x̄ for random samples of 72 households?
Approximately normal, by the central limit theorem
Right-skewed like the population
Uniform
Summary card
Central limit theorem
Large n: xˉ approximately normal, whatever the population.
Watch out: it is about means, not about the data.
One more step is optional: a challenge. Try it, or finish the lesson now.
Challenge ★★★
A skewed population has mean 72 and SD 6. By the central limit theorem, x̄ for samples of 36 is approximately normal. What is its standard deviation?
5. Sampling distributions of differences
Warm-up
Three quick questions from earlier lessons.
The population proportion is p = 8/10. Find the standard deviation of p̂ for random samples of size 83.
The population proportion is p = 5/10. What is the mean of the sampling distribution of p̂ for samples of size 351?
The population proportion is p = 1/8. What is the smallest sample size n for which np ≥ 10 and n(1 − p) ≥ 10?
Discover
Two independent sample means have SDs 3 and 4. What is the SD of their difference?
5
1
Key idea
Differences between independent samples.
For independent samples: μp^1−p^2=p1−p2, σp^1−p^2=n1p1(1−p1)+n2p2(1−p2); and σxˉ1−xˉ2=n1σ12+n2σ22.
Worked example
p1=0.5, p2=0.3, n1=n2=100.
μ=0.2
Center.
σ=0.0046≈0.068
0.0025 + 0.0021.
Your turn, guided
Your turn: σ12/n1=9 and σ22/n2=16. Find σxˉ1−xˉ2.
5
√25.
Practice ★
Independent samples of size 4 come from populations with SDs 36 and 48. Find the SD of x̄₁ − x̄₂.
Independent samples of size 4 come from populations with SDs 18 and 24. Find the SD of x̄₁ − x̄₂.
Independent random samples of 100 are taken from two populations with proportions 8/10 and 1/10. Find the SD of p̂₁ − p̂₂.
Watch out!
Practice ★★
When are the variances of x̄₁ and x̄₂ added to get the variance of x̄₁ − x̄₂ (samples of 66)?
When the two samples are independent
Only when the sample sizes are equal
Always, even for paired measurements
Exit ticket
Three questions to check you have got it.
Independent samples of size 4 come from populations with SDs 36 and 48. Find the SD of x̄₁ − x̄₂.
Independent samples of size 4 come from populations with SDs 18 and 24. Find the SD of x̄₁ − x̄₂.
Independent samples of size 4 come from populations with SDs 54 and 72. Find the SD of x̄₁ − x̄₂.
Summary card
Differences
Independent samples: means subtract, variances add.
Watch out: paired data are not independent.
One more step is optional: a challenge. Try it, or finish the lesson now.
Challenge ★★★
Independent samples of size 9 come from populations with SDs 15 and 20. Find the SD of x̄₁ − x̄₂.
6. Bias, variability and the 10% condition
Warm-up
Three quick questions from earlier lessons.
The population proportion is p = 8/10. Find the standard deviation of p̂ for random samples of size 83.
The population proportion is p = 5/10. What is the mean of the sampling distribution of p̂ for samples of size 351?
The population proportion is p = 1/8. What is the smallest sample size n for which np ≥ 10 and n(1 − p) ≥ 10?
Discover
A scale always reads 2 kg too heavy, but very consistently. Is it a good scale?
No, it is biased
Yes, it is very consistent
Key idea
Good estimators are unbiased and precise.
An estimator is unbiased if the mean of its sampling distribution equals the parameter (p^ and xˉ are unbiased). Its variability shrinks as n grows. The SD formulas assume independence; when sampling without replacement, keep n at most 10% of the population.
Worked example
A town of 6,000 households.
Largest sample: 600 households
10% of 6,000.
A larger random sample
To shrink variability.
A larger sample does not fix a biased method
Bias comes from the method.
Your turn, guided
Your turn: population 2,500. The largest sample meeting the 10% condition.
250
10% of 2,500.
Practice ★
What does it mean that p̂ is an unbiased estimator of p (samples of 40)?
The mean of its sampling distribution equals p
Every sample gives p̂ = p
Its variability is small
A school has 5000 students. Sampling without replacement, what is the largest sample size that meets the 10% condition?
A school has 28900 students. Sampling without replacement, what is the largest sample size that meets the 10% condition?
Watch out!
Practice ★★
A survey method gives estimates that cluster tightly, but far from the true value. How would you describe it (samples of 116)?
Biased, with low variability
Unbiased, with low variability
Unbiased, with high variability
Exit ticket
Three questions to check you have got it.
What does it mean that p̂ is an unbiased estimator of p (samples of 40)?
The mean of its sampling distribution equals p
Every sample gives p̂ = p
Its variability is small
What does it mean that p̂ is an unbiased estimator of p (samples of 187)?
The mean of its sampling distribution equals p
Every sample gives p̂ = p
Its variability is small
What does it mean that p̂ is an unbiased estimator of p (samples of 106)?
The mean of its sampling distribution equals p
Every sample gives p̂ = p
Its variability is small
Summary card
Bias and variability
Unbiased: centered on the parameter.
Variability: shrinks with n.
10% condition for independence.
Watch out: large does not mean unbiased.
One more step is optional: a challenge. Try it, or finish the lesson now.
Challenge ★★★
Samples of 43 are drawn without replacement. What is the smallest population size that meets the 10% condition?
7. The square-root law
Discover
A sample of 100 gives a standard error of 4 for the mean. You want a standard error of 2. Is a sample of 200 enough?
No: you need 400, four times as many
Yes: double the sample, half the error
Key idea
The square-root law.
The standard error of a sample mean is
SE=nσ.
To divide the SE by k, multiply the sample size by k2.
Worked example
σ=15. Find the SE for n=25 and the n that gives SE=1.
SE=515=3
n=25.
n=225
SE divided by 3: n×9.
Your turn, guided
Your turn: σ=12, n=16. Find the SE.
3
1612.
Practice ★
A population has σ=27. Find the standard error of the mean for samples of size 25.
A population has σ=17. Find the standard error of the mean for samples of size 100.
A population has σ=3. Find the standard error of the mean for samples of size 9.
Practice ★★
A sample of 182 gives some standard error. What sample size divides that standard error by 5?
A sample of 122 gives some standard error. What sample size divides that standard error by 4?
Exit ticket
Two questions to check.
A population has σ=27. Find the standard error of the mean for samples of size 25.
A population has σ=17. Find the standard error of the mean for samples of size 100.
Summary card
Square-root law
SE=nσ.
Half the error costs four times the data.
This is why polls of about 1,000 people are common: going much further costs a lot for little gain.
8. History of sampling distributions: de Moivre, Laplace and Gosset
Discover
Toss a fair coin 1,000 times. The number of heads varies from one try to the next. In 1733, Abraham de Moivre found the shape of that variation. Which shape?
A bell curve: the normal distribution
A flat line: every count is equally likely
Key idea
Why sample statistics are predictable.
Step 1Abraham de Moivre1667–1754Joseph Highmore, 1736. Public domain13 November 1733: de Moivre approximates the binomial by the normal curve.
Step 2Pierre-Simon Laplace1749–1827Jean-Baptiste Paulin Guérin, 1838. Public domain1812: Laplace's Analytic Theory of Probability.
Step 3William Sealy Gosset1876–1937Unknown artist. Public domain1906–07: Gosset studies the sampling distribution of the mean.
On 13 November 1733 de Moivre published, in a Latin pamphlet, the approximation of the binomial distribution by the normal distribution for a large number of trials. Laplace's Analytic Theory of Probability (1812) applied probability to errors in observations. In 1906–07 William Gosset studied the sampling distribution of the mean and standard deviation in Pearson's laboratory.
Worked example
De Moivre's idea with numbers: 400 tosses of a fair coin.
μ=200, σ=400×0.5×0.5=10
Mean and SD of the count.
between 180 and 220 heads
About 95 % of tries fall within 2 SD.
Practice ★
What did de Moivre publish in 1733?
The normal approximation to the binomial distribution
The t-test for small samples
Confidence intervals
A fair coin is tossed 16 times. Find the standard deviation of the number of heads.
A fair coin is tossed 100 times. Find the standard deviation of the number of heads.
Same coin, 100 tosses. About 95 % of the counts lie within 2 SD of the mean. Give the upper limit.
Summary card
Sampling distributions today
Factories check samples of products, not every item.
Polls predict elections from about a thousand people.
Medical trials compare average results of groups.
Sources: MacTutor biographies of de Moivre, Laplace and Gosset (see "Sources and credits").
Answers: Sampling distributions
1. Sampling variability and sampling distributions
A
A statistic: it describes the sample
All US college students
A parameter: it describes the whole population
B
The sample proportion p̂ (a statistic)
C
vary less around the population mean
D
The distribution of x̄ over all possible samples of size 25
E
The sample proportion p̂ (a statistic)
The sample proportion p̂ (a statistic)
The sample proportion p̂ (a statistic)
F
4
2. The sampling distribution of a sample proportion
A
a) 10021 b) 25004921 c) 103−25004921 d) 103 e) 2
a) 625256 b) 625369 c) 54 d) 0.8 e) 62516
3
B
415283
11352227
C
0.5
D
80
20
E
415283
11352227
985591
F
2500
3. The sampling distribution of a sample mean
A
a) 10021 b) 25004921 c) 103−25004921 d) 103 e) 2
5
13
B
326
4.2
14.5
C
4
D
0.4
2
E
326
4.2
14.5
F
4
4. The central limit theorem
A
326
4
0.4
B
Approximately normal, by the central limit theorem
C
Not necessarily: n = 3 is too small for the CLT to apply to a strongly skewed population
D
The distribution of sample means is approximately normal
E
Approximately normal, by the central limit theorem
Approximately normal, by the central limit theorem
Approximately normal, by the central limit theorem
F
1
5. Sampling distributions of differences
A
415283
0.5
80
B
30
15
C
0.05
D
When the two samples are independent
E
30
15
45
F
325
6. Bias, variability and the 10% condition
A
415283
0.5
80
B
The mean of its sampling distribution equals p
C
500
2890
D
Biased, with low variability
E
The mean of its sampling distribution equals p
The mean of its sampling distribution equals p
The mean of its sampling distribution equals p
F
430
7. The square-root law
A
527
1017
1
B
4550
1952
C
527
1017
8. History of sampling distributions: de Moivre, Laplace and Gosset
A
The normal approximation to the binomial distribution