OLS from three angles
The model
Linear in the parameters – not necessarily in the variables, since and are perfectly acceptable columns.
The one-regressor case
Worth memorising in the second form: a beta is a correlation scaled by the ratio of standard deviations.
The variance of the estimator
Under homoskedastic, uncorrelated errors. The diagonal gives each coefficient’s squared standard error; the off-diagonals say how their estimation errors move together. Correlated regressors make nearly singular and blow up the diagonal of its inverse.
Remember
- , and the residual is orthogonal to every regressor.