Skip to content

Business Mathematics and Basic Statistics · Ch 16 — Bivariate Statistics — Correlation and Regression

Regression Lines and Their Point of Intersection

5

Regression Lines and Their Point of Intersection

Each regression coefficient of the previous section is the slope of a straight line — the regression line — used for prediction. Since a regression line's whole purpose is to estimate one variable from the other for data centred on the sample, both regression lines are built to pass through the same fixed point: the pair of means (xˉ,yˉ)(\bar{x}, \bar{y}).

Note

The Two Regression Lines

Regression line of yy on xx (used to estimate yy for a given xx):

y−yˉ=byx(x−xˉ)y - \bar{y} = b_{yx}(x - \bar{x})

Regression line of xx on yy (used to estimate xx for a given yy):

x−xˉ=bxy(y−yˉ)x - \bar{x} = b_{xy}(y - \bar{y})

Both equations are satisfied by x=xˉ,y=yˉx = \bar{x}, y = \bar{y} — substitute those values into either equation and both sides become zero. This means the two regression lines, however different their slopes, always intersect at exactly the point (xˉ,yˉ)(\bar{x}, \bar{y}). This single fact is useful in both directions:

  • Given the means xˉ,yˉ\bar{x}, \bar{y} and the two regression coefficients, both regression-line equations can be written down directly, and their point of intersection can be verified to be (xˉ,yˉ)(\bar{x}, \bar{y}) as a check.
  • Conversely, if only the two regression-line equations are given (without being told the means directly), solving them simultaneously, exactly as one would solve any pair of linear equations in two unknowns, recovers xˉ\bar{x} and yˉ\bar{y} — because their unique common solution point is, by the fact just shown, precisely the pair of means. …
Definition 1Regression Line of y on x

The line y−yˉ=byx(x−xˉ)y - \bar{y} = b_{yx}(x-\bar{x}), used to estimate yy for a given …

Definition 2Regression Line of x on y

The line x−xˉ=bxy(y−yˉ)x - \bar{x} = b_{xy}(y-\bar{y}), used to estimate xx for a given …