Skip to content

Mathematics · Ch 13 — Statistics

Shortcut Method to Find Variance and Standard Deviation

13.5.4

Shortcut Method to Find Variance and Standard Deviation

Why a Shortcut Method is Needed

When the values of xix_i in a discrete distribution, or the mid-points of classes in a continuous distribution, are large numbers, the direct calculation of mean and variance becomes tedious and time-consuming. The step-deviation method simplifies this by shifting the origin to an assumed mean and reducing the scale by the class width.

The core idea is to transform the original variable xx into a new variable yy that has much smaller, simpler values. Once we compute the mean and variance for yy, we can easily convert them back to the original scale.

Defining the Step-Deviation Variable

Let the assumed mean be AA and let the class width (the size of each class interval) be hh. For each observation xix_i (or each class mid-point in a continuous distribution), define the step-deviation yiy_i as:

yi=xi−Ahy_i = \frac{x_i - A}{h}

This can be rearranged to express xix_i in terms of yiy_i:

xi=A+hyi(1)x_i = A + h y_i \qquad(1)

The variable yiy_i is simply the number of steps (of width hh) that xix_i is away from the assumed mean AA. A negative yiy_i means xix_i is below AA, a positive yiy_i means it is above AA, and yi=0y_i = 0 when xi=Ax_i = A.

Deriving the Mean Using Step-Deviation

We know the formula for the mean of a grouped frequency distribution (where fif_i are the frequencies and N=∑fiN = \sum f_i):

xˉ=1N∑i=1nfixi(2)\bar{x} = \frac{1}{N} \sum_{i=1}^{n} f_i x_i \qquad(2)

Substitute xi=A+hyix_i = A + h y_i from (1) into (2):

xˉ=1N∑i=1nfi(A+hyi)\bar{x} = \frac{1}{N} \sum_{i=1}^{n} f_i (A + h y_i)

xˉ=1N(∑i=1nfiA+∑i=1nfihyi)\bar{x} = \frac{1}{N} \left( \sum_{i=1}^{n} f_i A + \sum_{i=1}^{n} f_i h y_i \right)

Since AA and hh are constants, they can be taken out of the sums:

xˉ=1N(A∑i=1nfi+h∑i=1nfiyi)\bar{x} = \frac{1}{N} \left( A \sum_{i=1}^{n} f_i + h \sum_{i=1}^{n} f_i y_i \right)

We know that ∑i=1nfi=N\sum_{i=1}^{n} f_i = N. Therefore:

xˉ=1N(AN+h∑i=1nfiyi)\bar{x} = \frac{1}{N} \left( A N + h \sum_{i=1}^{n} f_i y_i \right)

xˉ=A+h(1N∑i=1nfiyi)\bar{x} = A + h \left( \frac{1}{N} \sum_{i=1}^{n} f_i y_i \right)

The term in brackets is simply the mean of the yy variable, which we denote as yˉ\bar{y}. So we arrive at the key result:

xˉ=A+hyˉ(3)\boxed{\bar{x} = A + h \bar{y}} \qquad(3)

Important

The mean of the original variable xx is the assumed mean AA plus the product of the class width hh and the mean of the step-deviation variable yy.

Deriving the Variance Using Step-Deviation

The variance of xx is defined as:

σx2=1N∑i=1nfi(xi−xˉ)2\sigma_x^2 = \frac{1}{N} \sum_{i=1}^{n} f_i (x_i - \bar{x})^2

Substitute xi=A+hyix_i = A + h y_i from (1) and xˉ=A+hyˉ\bar{x} = A + h \bar{y} from (3):

σx2=1N∑i=1nfi[(A+hyi)−(A+hyˉ)]2\sigma_x^2 = \frac{1}{N} \sum_{i=1}^{n} f_i \left[ (A + h y_i) - (A + h \bar{y}) \right]^2

The AA terms cancel:

σx2=1N∑i=1nfi(hyi−hyˉ)2\sigma_x^2 = \frac{1}{N} \sum_{i=1}^{n} f_i \left( h y_i - h \bar{y} \right)^2

σx2=1N∑i=1nfi[h(yi−yˉ)]2\sigma_x^2 = \frac{1}{N} \sum_{i=1}^{n} f_i \left[ h (y_i - \bar{y}) \right]^2

σx2=1N∑i=1nfih2(yi−yˉ)2\sigma_x^2 = \frac{1}{N} \sum_{i=1}^{n} f_i h^2 (y_i - \bar{y})^2

Since h2h^2 is a constant, it can be taken out of the sum:

σx2=h2[1N∑i=1nfi(yi−yˉ)2]\sigma_x^2 = h^2 \left[ \frac{1}{N} \sum_{i=1}^{n} f_i (y_i - \bar{y})^2 \right]

The term in brackets is precisely the variance of the yy variable, σy2\sigma_y^2. Therefore:

σx2=h2σy2(4)\boxed{\sigma_x^2 = h^2 \sigma_y^2} \qquad(4)

Taking the square root gives the relationship for standard deviation:

σx=hσy(4)\boxed{\sigma_x = h \sigma_y} \qquad(4)

Watch out

When converting variance back from the yy scale to the xx scale, you multiply by h2h^2, not by hh. The standard deviation is multiplied by hh because it is the square root of the variance.

The Direct Formula for Standard Deviation

We can combine the results above into a single formula that does not require computing yˉ\bar{y} separately. Recall that the variance of yy can be written as:

σy2=1N∑i=1nfiyi2−yˉ2\sigma_y^2 = \frac{1}{N} \sum_{i=1}^{n} f_i y_i^2 - \bar{y}^2

Substituting this into σx2=h2σy2\sigma_x^2 = h^2 \sigma_y^2:

σx2=h2(1N∑i=1nfiyi2−yˉ2)\sigma_x^2 = h^2 \left( \frac{1}{N} \sum_{i=1}^{n} f_i y_i^2 - \bar{y}^2 \right)

Since yˉ=1N∑fiyi\bar{y} = \frac{1}{N} \sum f_i y_i, we have:

σx2=h2(1N∑i=1nfiyi2−(1N∑i=1nfiyi)2)\sigma_x^2 = h^2 \left( \frac{1}{N} \sum_{i=1}^{n} f_i y_i^2 - \left( \frac{1}{N} \sum_{i=1}^{n} f_i y_i \right)^2 \right)

Multiplying through by h2h^2:

σx2=h2N2[N∑i=1nfiyi2−(∑i=1nfiyi)2](5)\boxed{\sigma_x^2 = \frac{h^2}{N^2} \left[ N \sum_{i=1}^{n} f_i y_i^2 - \left( \sum_{i=1}^{n} f_i y_i \right)^2 \right]} \qquad(5)

And for standard deviation:

σx=hNN∑i=1nfiyi2−(∑i=1nfiyi)2(5)\boxed{\sigma_x = \frac{h}{N} \sqrt{ N \sum_{i=1}^{n} f_i y_i^2 - \left( \sum_{i=1}^{n} f_i y_i \right)^2 }} \qquad(5)

Shortcut Method for Standard Deviation

σx=hNN∑fiyi2−(∑fiyi)2\sigma_x = \frac{h}{N} \sqrt{ N \sum f_i y_i^2 - \left( \sum f_i y_i \right)^2 }

where yi=xi−Ahy_i = \frac{x_i - A}{h}, AA is the assumed mean, hh is the class width, and N=∑fiN = \sum f_i.

Worked Example: Full Solution

Let us apply the shortcut method to the following distribution:

Classes30-4040-5050-6060-7070-8080-9090-100
Frequency371215832

Step 1: Choose the assumed mean and identify the class width.

Choose A=65A = 65 (a value near the centre of the distribution). The class width is h=10h = 10 (each interval spans 10 units).

Step 2: Compute the mid-points and step-deviations.

For each class, find the mid-point xix_i and then compute yi=xi−6510y_i = \frac{x_i - 65}{10}.

ClassFrequency fif_iMid-point xix_iyi=xi−6510y_i = \frac{x_i - 65}{10}yi2y_i^2fiyif_i y_ifiyi2f_i y_i^2
30-40335−3-39−9-927
40-50745−2-24−14-1428
50-601255−1-11−12-1212
60-7015650000
70-808751188
80-9038524612
90-10029539618
TotalN=50N = 50∑fiyi=−15\sum f_i y_i = -15∑fiyi2=105\sum f_i y_i^2 = 105

Step 3: Compute the mean using xˉ=A+hyˉ\bar{x} = A + h \bar{y}. …

Table 13.11Mean, variance and standard deviation by the shortcut method
ClassFrequency fif_iMid-point xix_iyi=xi−6510y_i=\dfrac{x_i-65}{10}yi2y_i^2fiyif_iy_ifiyi2f_iy_i^2
30-40335−3-39−9-927
40-50745−2-24−14-1428
50-601255−1-11−12-1212
60-7015650000
70-808751188
80-9038524612