Skip to content

Mathematics · Ch 7 — Probability

Independent Events

3

Independent Events

Definition of Independence

Two events AA and BB are called independent if the occurrence of one has no effect on the probability of the other. Formally, AA and BB are independent if

P(A∩B)=P(A) P(B).P(A\cap B) = P(A)\,P(B).

Equivalence with the Conditional Definition

Whenever P(B)>0P(B)>0, this multiplicative condition is exactly equivalent to

P(A∣B)=P(A∩B)P(B)=P(A)P(B)P(B)=P(A),P(A\mid B) = \frac{P(A\cap B)}{P(B)} = \frac{P(A)P(B)}{P(B)} = P(A),

and, symmetrically, P(B∣A)=P(B)P(B\mid A)=P(B) whenever P(A)>0P(A)>0. This confirms the intuitive meaning of independence directly: knowing that BB has occurred leaves the probability of AA completely unchanged, and vice versa.

Independence Is Not the Same as Mutual Exclusivity

These two ideas are frequently confused but are in fact almost opposite. Two events AA and BB (with P(A)>0,P(B)>0P(A)>0,P(B)>0) are mutually exclusive when A∩B=∅A\cap B=\varnothing, so P(A∩B)=0P(A\cap B)=0. If AA and BB were also independent, this would force P(A)P(B)=0P(A)P(B)=0, contradicting P(A)>0P(A)>0 and P(B)>0P(B)>0. So two events of positive probability can never be both mutually exclusive and independent -- mutual exclusivity means BB occurring makes AA impossible (the strongest possible dependence), the opposite of independence.

Mutual Independence of Three Events

Three events AA, BB, CC are said to be (mutually) independent when all four of the following hold simultaneously:

P(A∩B)=P(A)P(B),P(B∩C)=P(B)P(C),P(A∩C)=P(A)P(C),P(A\cap B)=P(A)P(B),\quad P(B\cap C)=P(B)P(C),\quad P(A\cap C)=P(A)P(C),

P(A∩B∩C)=P(A)P(B)P(C).P(A\cap B\cap C)=P(A)P(B)P(C).

The first three conditions alone (pairwise independence) do not guarantee the fourth -- all four must be checked to conclude mutual independence.

Worked Illustration …