The regression questions firms actually ask
REG · Chapter 614 min readAsked at Two Sigma, Citadel, DE Shaw, AQR
Assumes OLS from three angles.
After this lesson you should be able to
- Explain regression to the mean without invoking a force.
- Sign an omitted-variable bias from the two correlations involved.
- Say what adding noise to does, and why it differs from noise in .
There is a short list of regression questions that recur across research interviews, and they test the same thing: whether you reason from the algebra or from a memorised story. Each one below has a one-line answer and a follow-up that catches people who learned only the line.
Definition 6.1
Regression to the mean
Regression to the mean, — When and are imperfectly correlated and measured in the same units, an observation far from the mean in is expected to be closer to the mean in — by a factor of exactly . It is not a force pulling things back; it is what imperfect correlation means. The tallest fathers have sons who are tall but less so, and last year’s best fund is expected to be above average this year but not top.
Common trap. Treating regression to the mean as a mechanism — "the market corrects", "talent normalises". If that were a force it would act in one direction in time, and it does not: the sons of tall fathers are shorter, and the fathers of tall sons are also shorter. Instead. Say it is symmetric and therefore not causal. The symmetry is the cleanest way to demonstrate you understand it, and it kills the "so there is a mean-reverting force" follow-up.
Proposition 6.3
Reverse regression
Regress on and you get ; regress on and you get . The product is , so the two slopes are reciprocals only when . Plotted on the same axes the two lines both pass through the means and pinch together as the correlation rises.
Holds when
- If , both slopes equal , which makes the regression-to-the-mean statement visible directly.
- Neither line is "the relationship" — each answers a different conditional expectation.
The rest of this lesson is in Premium
You have read the opening. 12 more sections follow, including 4 worked examples and 3 quick checks.
Nothing is charged for 7 days, and you can cancel before then. Or read The law of large numbers and the central limit theorem in full, free.