Q.A laboratory blood test is 99% effective in detecting a certain disease when it is in fact, present. However, the test also yields a false positive result for 0.5% of the healthy person tested. If 0.2% of the population actually has the disease, what is the probability that a person has the disease given that his test result is positive?

The Theorem of Total Probability: From Intuition to Formula

Imagine you want to know the probability that a randomly selected student owns a bicycle. You don't have a direct number, but you do know the school is divided into three houses — Red, Blue, and Green — and you know the bicycle ownership rate within each house. How would you combine that information?

You'd reason: first pick a house at random, then within that house check for bicycle ownership. The overall probability is a weighted average of the house-specific probabilities, where the weights are the probabilities of being in each house. That's the core idea of the Theorem of Total Probability.

The Setup

We have a sample space $S$ (all possible outcomes). Suppose $S$ is partitioned into $n$ mutually exclusive and exhaustive events $A_1, A_2, \dots, A_n$. "Mutually exclusive" means no two overlap — a student belongs to exactly one house. "Exhaustive" means together they cover the whole space — every student is in some house.

Now let $B$ be any other event in the same sample space — say, "owns a bicycle." We want $P(B)$.

The Intuition

Since the $A_i$'s cover everything, $B$ can be split into pieces: $B$ happens partly when $A_1$ happens, partly when $A_2$ happens, and so on. Formally:

Because the $A_i$'s are disjoint, these intersections are also disjoint. So the probability of $B$ is just the sum of the probabilities of these pieces:

Now recall the multiplication rule: $P(B \cap A_i) = P(A_i) \cdot P(B \mid A_i)$. Substituting gives:

That's the theorem.

Why It Matters

The theorem lets you compute an "overall" probability when you only know probabilities conditioned on different scenarios. It's the bridge between conditional probabilities and unconditional ones.

A Concrete Example

A factory has two machines. Machine I produces 60% of the output, Machine II produces 40%. Machine I has a 2% defect rate, Machine II has a 5% defect rate. What's the overall defect rate? …