Skip to content

Statistics · Ch 3 — Linear Regression

Relationship between Correlation and Regression Coefficients

6

Relationship between Correlation and Regression Coefficients

Regression and correlation are closely linked — regression coefficients and the correlation coefficient are computed from the very same covariance and standard-deviation values. The key relationship is:

r=±byx⋅bxyequivalentlyr2=byx⋅bxyr = \pm\sqrt{b_{yx}\cdot b_{xy}} \qquad \text{equivalently} \qquad r^{2} = b_{yx}\cdot b_{xy}

The sign of rr is taken as the common sign of byxb_{yx} and bxyb_{xy} (both positive ⇒\Rightarrow rr positive; both negative ⇒\Rightarrow rr negative).

Special cases:

  • When r=0r = 0: both byx=0b_{yx} = 0 and bxy=0b_{xy} = 0 — the two regression lines are perpendicular (parallel to the axes, through the mean point), confirming there is no linear relationship to exploit for prediction.
  • When r=±1r = \pm 1: the two regression lines coincide into a single line — every point lies exactly on it, so predicting YY from XX or XX from YY gives a perfectly consistent answer either way.
  • For every other value of rr (i.e. −1<r<0-1 < r < 0 or 0<r<10 < r < 1), the two lines are genuinely distinct, intersecting only at (Xˉ,Yˉ)(\bar{X}, \bar{Y}). …