Lessons and exercises follow the school system and stay in its language.Les leçons et les exercices suivent le système scolaire et restent dans sa langue.Lektionen und Übungen folgen dem Schulsystem und bleiben in seiner Sprache.

Random variables

Print the chapter

Every lesson of the chapter, ready for paper. Exercise sets are lettered A, B, C… and answered at the end.

To save a PDF, choose “Save as PDF” in the print dialog.

1. Discrete random variables and their distributions

Warm-up

Three quick questions from earlier lessons.

  1. Two fair dice are rolled. Find the probability that the sum is 2.
  2. A fair die is rolled 2 times. Find the probability of at least one six.
  3. The probability that a flight is late is 0.78. Find the probability that it is not late.

Discover

X is the number of heads in two coin tosses. Its values are 0, 1, 2. Which list gives their probabilities?

  1. 14,12,14\tfrac{1}{4}, \tfrac{1}{2}, \tfrac{1}{4}
  2. 13,13,13\tfrac{1}{3}, \tfrac{1}{3}, \tfrac{1}{3}

Key idea

A random variable assigns a number to each outcome.

A discrete random variable XX has a list of values with probabilities P(X=x)P(X = x). Every probability is between 0 and 1, and they sum to 1. Probabilities of events such as X≥2X \ge 2 add the matching values.

Worked example

P(X=0)=0.2P(X = 0) = 0.2, P(X=1)=0.5P(X = 1) = 0.5, XX takes only 0, 1, 2.

P(X=2)=1−0.2−0.5=0.3P(X = 2) = 1 - 0.2 - 0.5 = 0.3
Sum to 1.
P(X≥1)=0.8P(X \ge 1) = 0.8
Everything but 0.

Your turn, guided

Your turn: P(X=0)=0.1P(X = 0) = 0.1, P(X=1)=0.6P(X = 1) = 0.6. Find P(X=2)P(X = 2).

0.30.3
1 − 0.1 − 0.6.

Practice ★

  1. A random variable X takes the values 0, 1 and 2, with P(X = 0) = 29/100 and P(X = 1) = 13/100. Find P(X = 2).
  2. A random variable X takes the values 0, 1 and 2, with P(X = 0) = 14/100 and P(X = 1) = 18/100. Find P(X = 2).
  1. Which list could be the probabilities of a random variable with three values?
    1. 0.1, 0.5 and 4/10
    2. 0.5, 0.5 and 0.1
    3. 0.8, 0.4 and −0.2

Watch out!

Practice ★★

  1. X takes the values 0, 1, 2 with P(X = 0) = 25/100 and P(X = 1) = 15/100. Find P(X ≥ 1).
  2. X takes the values 0, 1, 2 with P(X = 0) = 34/100 and P(X = 1) = 15/100. Find P(X ≥ 1).

Exit ticket

Three questions to check you have got it.

  1. A random variable X takes the values 0, 1 and 2, with P(X = 0) = 29/100 and P(X = 1) = 13/100. Find P(X = 2).
  2. A random variable X takes the values 0, 1 and 2, with P(X = 0) = 14/100 and P(X = 1) = 18/100. Find P(X = 2).
  3. A random variable X takes the values 0, 1 and 2, with P(X = 0) = 18/100 and P(X = 1) = 23/100. Find P(X = 2).

Summary card

Discrete distributions

  • Values with probabilities in [0,1][0, 1] summing to 1.
  • Add probabilities for events.

Watch out: values are not automatically equally likely.

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. X is equally likely to be any whole number from 1 to 9. Find P(X ≥ 3).

2. Expected value and standard deviation of a random variable

Warm-up

Three quick questions from earlier lessons.

  1. A random variable X takes the values 0, 1 and 2, with P(X = 0) = 29/100 and P(X = 1) = 13/100. Find P(X = 2).
  2. X takes the values 0, 1, 2 with P(X = 0) = 25/100 and P(X = 1) = 15/100. Find P(X ≥ 1).
  3. Which list could be the probabilities of a random variable with three values?
    1. 0.1, 0.5 and 4/10
    2. 0.5, 0.5 and 0.1
    3. 0.8, 0.4 and −0.2

Discover

A raffle ticket wins 10 dollars with probability 0.1 and nothing otherwise. What is the average win per ticket over many tickets?

  1. 1 dollar
  2. 5 dollars

Key idea

The mean and SD of a random variable.

E(X)=μX=∑x P(x)E(X) = \mu_X = \sum x\,P(x), the long-run average. Var(X)=∑(x−μ)2P(x)\text{Var}(X) = \sum (x - \mu)^2 P(x) and SD(X)=Var(X)\text{SD}(X) = \sqrt{\text{Var}(X)}. For XX equal to 1 with probability pp and 0 otherwise: μ=p\mu = p, Var=p(1−p)\text{Var} = p(1 - p).

Worked example

XX: 0, 1, 2 with probabilities 0.3, 0.4, 0.3.

E(X)=0+0.4+0.6=1E(X) = 0 + 0.4 + 0.6 = 1
Σ x P(x).
Var(X)=0.3+0+0.3=0.6\text{Var}(X) = 0.3 + 0 + 0.3 = 0.6
Σ (x − 1)² P(x).
SD(X)=0.6≈0.77\text{SD}(X) = \sqrt{0.6} \approx 0.77
Square root.

Your turn, guided

Your turn: XX = 0, 5 with probabilities 0.6, 0.4. E(X)E(X).

22
5 × 0.4.

Practice ★

  1. X takes the values 0, 1, 2 with probabilities 51/100, 15/100 and 34/100. Find E(X).
  2. X takes the values 0, 1, 2 with probabilities 56/100, 25/100 and 19/100. Find E(X).
  1. A game costs 1 dollar. You win 4 dollars (net) with probability 1/3; otherwise you lose your dollar. Find your expected net gain, in dollars.

Watch out!

Practice ★★

  1. X = 1 with probability 7/10 and X = 0 otherwise. Find the standard deviation of X.
  2. X = 1 with probability 9/10 and X = 0 otherwise. Find the standard deviation of X.

Exit ticket

Three questions to check you have got it.

  1. X takes the values 0, 1, 2 with probabilities 51/100, 15/100 and 34/100. Find E(X).
  2. X takes the values 0, 1, 2 with probabilities 56/100, 25/100 and 19/100. Find E(X).
  3. X takes the values 0, 1, 2 with probabilities 77/100, 10/100 and 13/100. Find E(X).

Summary card

Expected value and SD

E(X)=∑xP(x)E(X) = \sum x P(x); SD=∑(x−μ)2P(x)\text{SD} = \sqrt{\sum (x - \mu)^2 P(x)}.

Watch out: weight by probabilities; include losses.

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. A game costs 1 dollar. With probability 15\dfrac{1}{ 5 } you win ww dollars net; otherwise your dollar is lost. For which ww is the game fair (expected value 0)?

3. Combining random variables

Warm-up

Three quick questions from earlier lessons.

  1. A set of test scores has standard deviation 4. The teacher adds 10 points to every score. What is the new standard deviation?
  2. Lengths have standard deviation 11 cm. Each length is multiplied by 3. What is the new standard deviation, in the new units?
  3. Daily temperatures have mean 11 °C. With F=95C+32F = \tfrac{9}{5}C + 32, what is the mean in °F?

Discover

Two independent dice each have SD about 1.7. Is the SD of their sum about 3.4?

  1. No, smaller: about 2.4
  2. Yes

Key idea

Means always add; variances add for independent variables.

E(a+bX)=a+bE(X)E(a + bX) = a + bE(X), SD(a+bX)=∣b∣ SD(X)\text{SD}(a + bX) = |b|\,\text{SD}(X). E(X±Y)=E(X)±E(Y)E(X \pm Y) = E(X) \pm E(Y). If XX and YY are independent, Var(X±Y)=Var(X)+Var(Y)\text{Var}(X \pm Y) = \text{Var}(X) + \text{Var}(Y): variances add even for a difference.

Worked example

Morning commute: mean 20, SD 3; evening: mean 25, SD 4; independent.

E(total)=45E(\text{total}) = 45
Means add.
Var=9+16=25\text{Var} = 9 + 16 = 25
Variances add.
SD(total)=5\text{SD}(\text{total}) = 5
Square root.

Your turn, guided

Your turn: SD(X) = 6, SD(Y) = 8, independent. SD(X − Y).

1010
√(36 + 64).

Practice ★

  1. X and Y are independent with SD(X) = 3 and SD(Y) = 4. Find SD(X + Y).
  2. X and Y are independent with SD(X) = 81 and SD(Y) = 108. Find SD(X + Y).
  1. SD(X) = 4. Let Y = 5 + 2X. Find SD(Y).

Watch out!

Practice ★★

  1. X and Y are independent with SD(X) = 12 and SD(Y) = 5. Find SD(X − Y).
  2. X and Y are independent with SD(X) = 288 and SD(Y) = 120. Find SD(X − Y).

Exit ticket

Three questions to check you have got it.

  1. X and Y are independent with SD(X) = 3 and SD(Y) = 4. Find SD(X + Y).
  2. X and Y are independent with SD(X) = 81 and SD(Y) = 108. Find SD(X + Y).
  3. X and Y are independent with SD(X) = 9 and SD(Y) = 12. Find SD(X + Y).

Summary card

Combining random variables

  • Means add (and subtract).
  • Independent: variances add, for sums and differences.

Watch out: never add SDs directly.

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. XX and YY are independent, Var⁡(X)=8\operatorname{Var}(X) = 8 and Var⁡(Y)=2\operatorname{Var}(Y) = 2. Find Var⁡(2X−3Y)\operatorname{Var}(2X - 3Y).

4. The binomial distribution

Warm-up

Three quick questions from earlier lessons.

  1. Two independent machines fail with probabilities 0.2 and 0.2. Find the probability that both fail.
  2. P(A) = 3/10, P(B) = 6/10 and P(A and B) = 18/100. Are A and B independent?
    1. Yes: P(A and B) = P(A)·P(B)
    2. No, because P(A and B) > 0
    3. It cannot be decided
  3. A bag has 3 red and 3 blue marbles. Two are drawn without replacement. Find P(both red).

Discover

A coin is tossed 3 times. How many sequences have exactly one head?

  1. 3
  2. 1

Key idea

Count the successes in a fixed number of independent trials.

Binomial setting: nn fixed trials, two outcomes, independent, same probability pp of success. Then P(X=k)=(nk)pk(1−p)n−kP(X = k) = \binom{n}{k}p^k(1 - p)^{n - k}, where (nk)\binom{n}{k} counts the arrangements: (n1)=n\binom{n}{1} = n, (n2)=n(n−1)2\binom{n}{2} = \tfrac{n(n - 1)}{2}.

Worked example

n=5n = 5, p=0.2p = 0.2: P(X=2)P(X = 2).

(52)=10\binom{5}{2} = 10
Arrangements.
0.22×0.83=0.020480.2^2 \times 0.8^3 = 0.02048
One arrangement.
P(X=2)=0.2048P(X = 2) = 0.2048
Multiply.

Your turn, guided

Your turn: n=4n = 4, p=12p = \tfrac{1}{2}. P(X=1)P(X = 1).

14\tfrac{1}{4}
4 × (½)⁴.

Practice ★

  1. A free throw is made with probability 1/3. In 3 independent shots, find P(exactly one is made).
  2. A free throw is made with probability 1/8. In 12 independent shots, find P(exactly one is made).
  1. Which situation fits a binomial model?
    1. The number of heads in 9 tosses of a fair coin
    2. The number of tosses until the first head
    3. The number of aces in 9 cards dealt from one deck

Watch out!

Practice ★★

  1. A seed sprouts with probability 1/3, independently. 4 seeds are planted. Find P(exactly two sprout).
  2. A seed sprouts with probability 1/8, independently. 12 seeds are planted. Find P(exactly two sprout).

Exit ticket

Three questions to check you have got it.

  1. A free throw is made with probability 1/3. In 3 independent shots, find P(exactly one is made).
  2. A free throw is made with probability 1/8. In 12 independent shots, find P(exactly one is made).
  3. A free throw is made with probability 1/3. In 4 independent shots, find P(exactly one is made).

Summary card

Binomial probabilities

P(X=k)=(nk)pk(1−p)n−kP(X = k) = \binom{n}{k}p^k(1 - p)^{n - k} in a binomial setting.

Watch out: multiply by the number of arrangements.

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. XX is binomial with n=10n = 10 and p=12p = \dfrac{1}{2}. For which kk is P(X=k)P(X = k) largest?

5. Mean and standard deviation of a binomial variable

Warm-up

Three quick questions from earlier lessons.

  1. X takes the values 0, 1, 2 with probabilities 51/100, 15/100 and 34/100. Find E(X).
  2. X = 1 with probability 7/10 and X = 0 otherwise. Find the standard deviation of X.
  3. A game costs 1 dollar. You win 4 dollars (net) with probability 1/3; otherwise you lose your dollar. Find your expected net gain, in dollars.

Discover

A fair coin is tossed 100 times. About how many heads do you expect?

  1. 50
  2. 25

Key idea

Shortcuts for the binomial.

If XX is binomial with nn and pp: μX=np\mu_X = np and σX=np(1−p)\sigma_X = \sqrt{np(1 - p)}.

Worked example

n=50n = 50, p=0.3p = 0.3.

μ=15\mu = 15
np.
σ2=10.5\sigma^2 = 10.5
np(1 − p).
σ≈3.24\sigma \approx 3.24
Square root.

Your turn, guided

Your turn: n=200n = 200, p=0.1p = 0.1. The mean.

2020
200 × 0.1.

Practice ★

  1. X is binomial with n = 30 and p = 1/10. Find E(X).
  2. X is binomial with n = 523 and p = 1/4. Find E(X).
  1. X is binomial with n = 64 and p = 1/2. Find SD(X).
  2. X is binomial with n = 908 and p = 1/12. Find SD(X).

Watch out!

Practice ★★

  1. A multiple-choice test has 87 questions with 4 options each. A student guesses every answer. What does E(X) = \frac{87}{4} mean?
    1. Over many such guessed tests, the average number correct is about \frac{87}{4}
    2. The student will get exactly \frac{87}{4} right
    3. \frac{87}{4} is the largest possible score

Exit ticket

Three questions to check you have got it.

  1. X is binomial with n = 30 and p = 1/10. Find E(X).
  2. X is binomial with n = 523 and p = 1/4. Find E(X).
  3. X is binomial with n = 30 and p = 1/5. Find E(X).

Summary card

Binomial mean and SD

μ=np\mu = np, σ=np(1−p)\sigma = \sqrt{np(1 - p)}.

Watch out: the SD is the square root of np(1−p)np(1 - p).

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. XX is binomial with E(X)=20E(X) = 20 and Var⁡(X)=15\operatorname{Var}(X) = 15. Find nn.

6. The geometric distribution

Warm-up

Three quick questions from earlier lessons.

  1. A free throw is made with probability 1/3. In 3 independent shots, find P(exactly one is made).
  2. A seed sprouts with probability 1/3, independently. 4 seeds are planted. Find P(exactly two sprout).
  3. Which situation fits a binomial model?
    1. The number of heads in 9 tosses of a fair coin
    2. The number of tosses until the first head
    3. The number of aces in 9 cards dealt from one deck

Discover

You roll a die until the first six. What is the probability that the first six comes on roll 3?

  1. (56)216\left(\tfrac{5}{6}\right)^2 \tfrac{1}{6}
  2. (56)316\left(\tfrac{5}{6}\right)^3 \tfrac{1}{6}

Key idea

Waiting for the first success.

Geometric setting: independent trials with the same pp, repeated until the first success; XX = the number of the trial of the first success. P(X=k)=(1−p)k−1pP(X = k) = (1 - p)^{k - 1}p, μX=1p\mu_X = \dfrac{1}{p}.

Worked example

p=0.25p = 0.25.

P(X=2)=0.75×0.25=0.1875P(X = 2) = 0.75 \times 0.25 = 0.1875
First success on trial 2.
P(X≤2)=1−0.752=0.4375P(X \le 2) = 1 - 0.75^2 = 0.4375
Within 2 trials: complement of 2 failures.
μ=4\mu = 4
1/p.

Your turn, guided

Your turn: p=0.1p = 0.1. The mean number of trials.

1010
1/0.1.

Practice ★

  1. Each call reaches a customer with probability 1/2, independently. Find P(the first success is on call 2).
  2. Each call reaches a customer with probability 1/11, independently. Find P(the first success is on call 9).
  1. A die-like spinner shows 'win' with probability 1/3. On average, how many spins are needed to get the first win?

Watch out!

Practice ★★

  1. Each attempt succeeds with probability 1/4. Find P(the first success comes within the first two attempts).
  2. Each attempt succeeds with probability 1/15. Find P(the first success comes within the first two attempts).

Exit ticket

Three questions to check you have got it.

  1. Each call reaches a customer with probability 1/2, independently. Find P(the first success is on call 2).
  2. Each call reaches a customer with probability 1/11, independently. Find P(the first success is on call 9).
  3. Each call reaches a customer with probability 1/3, independently. Find P(the first success is on call 3).

Summary card

Geometric distribution

P(X=k)=(1−p)k−1pP(X = k) = (1 - p)^{k - 1}p, μ=1/p\mu = 1/p.

Watch out: k−1k - 1 failures before the first success.

One more step is optional: a challenge. Try it, or finish the lesson now.

Challenge ★★★

  1. Each trial succeeds with probability 16\dfrac{1}{ 6 }. Find the probability that the first success comes after trial 6.

7. Waiting for a first success

Discover

You roll a fair die until you get a six. On average, how many rolls does it take?

  1. 6 rolls
  2. 3.5 rolls

Key idea

Waiting for a first success.

If each try succeeds with probability pp, independently, the expected number of tries until the first success is

E=1pE = \dfrac{1}{p}.

Worked example

A spinner lands on red with probability 14\tfrac{1}{4}. How many spins do you expect until the first red?

E=11/4E = \dfrac{1}{1/4}
p=14p = \tfrac{1}{4}.
E=4E = 4 spins
11/4=4\dfrac{1}{1/4} = 4.

Your turn, guided

Your turn: each try succeeds with probability 110\tfrac{1}{10}. How many tries do you expect?

1010
11/10\dfrac{1}{1/10}.

Practice ★

  1. Each try succeeds with probability 111\tfrac{1}{ 11 }, independently. How many tries do you expect until the first success?
  2. Each try succeeds with probability 115\tfrac{1}{ 15 }, independently. How many tries do you expect until the first success?
  3. Each try succeeds with probability 12\tfrac{1}{ 2 }, independently. How many tries do you expect until the first success?

Practice ★★

  1. A machine part fails on a given day with probability 160\tfrac{ 1 }{ 60 }. On average, how many days pass until its first failure?
  2. A machine part fails on a given day with probability 150\tfrac{ 1 }{ 50 }. On average, how many days pass until its first failure?

Exit ticket

Two questions to check.

  1. Each try succeeds with probability 111\tfrac{1}{ 11 }, independently. How many tries do you expect until the first success?
  2. Each try succeeds with probability 115\tfrac{1}{ 15 }, independently. How many tries do you expect until the first success?

Summary card

Waiting time

  • Expected waiting time =1p= \dfrac{1}{p}.
  • Rare events: long waits on average.

Engineers use it for the expected time between failures of a machine.

8. History: Bernoulli, de Moivre and the law of large numbers

Discover

Toss a fair coin 10 times: you may well get 7 heads. Toss it 10,000 times: the share of heads is almost always very close to 12\tfrac{1}{2}. Who first proved that this must happen?

  1. Jacob Bernoulli, with his law of large numbers
  2. Nobody: it is only an observation

Key idea

From one throw to many.

17001710172017301740175017601713Bernoulli1713Bernoulli
  1. Step 117001710172017301740175017601713Bernoulli1713BernoulliJacob Bernoulli 1655–1705Niklaus Bernoulli (1662-1716), 1687. Public domain1713: Jacob Bernoulli's Ars Conjectandi is printed, eight years after his death. It proves the law of large numbers.
  2. Step 217001710172017301740175017601713Bernoulli1718de Moivre1713Bernoulli1718de MoivreAbraham de Moivre 1667–1754Joseph Highmore, 1736. Public domain1718: de Moivre's book The Doctrine of Chances.
  3. Step 317001710172017301740175017601713Bernoulli1718de Moivre1733de Moivre1713Bernoulli1718de Moivre1733de MoivreAbraham de Moivre 1667–1754Joseph Highmore, 1736. Public domain13 November 1733: de Moivre approximates the binomial distribution by the bell curve.

Jacob Bernoulli's Ars Conjectandi (printed in 1713, eight years after his death) contains the law of large numbers. On 13 November 1733 Abraham de Moivre showed that for many trials the binomial distribution looks like the bell curve, today's normal distribution.

Worked example

With nn tosses of a fair coin, the number of heads XX has mean n2\tfrac{n}{2} and standard deviation n2\tfrac{\sqrt{n}}{2}.

mean 50, standard deviation 5
For n=100n = 100:
0.0050.005: very close to 12\tfrac{1}{2}
For n=10 000n = 10\,000: the share of heads has standard deviation 5010 000\tfrac{50}{10\,000}.

Practice ★

  1. What does Jacob Bernoulli's law of large numbers (printed in 1713) say?
    1. Over many trials, the frequency gets close to the probability
    2. After many tails, heads becomes more likely
    3. Large numbers are more likely than small ones
  1. A fair coin is tossed 144 times. With σ=n2\sigma = \tfrac{\sqrt{n}}{2}, what is the standard deviation of the number of heads?
  2. A fair coin is tossed 196 times. With σ=n2\sigma = \tfrac{\sqrt{n}}{2}, what is the standard deviation of the number of heads?
  1. Ars Conjectandi was printed in 1713, eight years after Jacob Bernoulli's death. In which year did he die? Add 4 to that year.

Summary card

Random variables today

  • Polls: a sample of 1,000 people gives a share close to the true one.
  • Insurance and casinos rely on the law of large numbers.
  • Quality control counts faulty items with the binomial distribution.

Sources: MacTutor biographies of Jacob Bernoulli and Abraham de Moivre (see "Sources and credits").