Skip to content

Statistics · Ch 2 — Linear Correlation

Karl Pearson's Coefficient of Correlation

3

Karl Pearson's Coefficient of Correlation

Karl Pearson's Coefficient of Correlation (denoted rr) is the most widely used numerical measure of the degree of linear correlation between two quantitative variables XX and YY.

Actual mean (deviation) method — deviations are taken from the actual arithmetic means X‾\overline{X} and Y‾\overline{Y}: with x=X−X‾x=X-\overline{X} and y=Y−Y‾y=Y-\overline{Y},

r=∑xy∑x2∑y2r = \dfrac{\sum xy}{\sqrt{\sum x^2 \sum y^2}}

Direct (raw-score) method — avoids computing the means first, working directly with the raw totals:

r=N∑XY−∑X∑Y[N∑X2−(∑X)2][N∑Y2−(∑Y)2]r = \dfrac{N\sum XY - \sum X \sum Y}{\sqrt{\left[N\sum X^2-(\sum X)^2\right]\left[N\sum Y^2-(\sum Y)^2\right]}}

Step-deviation (short-cut) method — convenient when the actual means are not whole numbers or the values are large: choose any convenient assumed means AA (for XX) and BB (for YY), and (optionally) common divisors hx,hyh_x, h_y; compute u=X−Ahxu=\dfrac{X-A}{h_x} and v=Y−Bhyv=\dfrac{Y-B}{h_y}, then

r=N∑uv−∑u∑v[N∑u2−(∑u)2][N∑v2−(∑v)2]r = \dfrac{N\sum uv - \sum u \sum v}{\sqrt{\left[N\sum u^2-(\sum u)^2\right]\left[N\sum v^2-(\sum v)^2\right]}}

A key property that makes the short-cut method valid: rr is independent of the change of origin and scale — subtracting any assumed mean and dividing by any constant divisor never changes the value of rr. This is exactly why the three methods above always give the same numerical answer for the same data, and it is the standard way to cross-verify a computed rr (compute it once by the direct method and once by the step-deviation method — the two must agree).

Merits: gives one precise number capturing both the direction (sign) and the strength (magnitude) of a linear relationship; the most rigorous and widely used measure for quantitative data. …

Definition 1Karl Pearson's Coefficient of Correlation (all three methods)

Actual-mean method: r=∑xy∑x2∑y2r=\dfrac{\sum xy}{\sqrt{\sum x^2\sum y^2}} with x=X−X‾x=X-\overline{X}, y=Y−Y‾y=Y-\overline{Y}. Direct method: r=N∑XY−∑X∑Y[N∑X2−(∑X)2][N∑Y2−(∑Y)2]r=\dfrac{N\sum XY-\sum X\sum Y}{\sqrt{[N\sum X^2-(\sum X)^2][N\sum Y^2-(\sum Y)^2]}}. Step-deviation method (assumed means A,BA,B, divisors hx,hyh_x,h_y): r=N∑uv−∑u∑v[N∑u2−(∑u)2][N∑v2−(∑v)2]r=\dfrac{N\sum uv-\sum u\sum v}{\sqrt{[N\sum u^2-(\sum u)^2][N\sum v^2-(\sum v)^2]}}, $u=\frac{X- …