Frisch–Waugh–Lovell theorem

In econometrics, the Frisch–Waugh–Lovell (FWL) theorem is named after the econometricians Ragnar Frisch, Frederick V. Waugh, and Michael C. Lovell.^[1][2][3]

The Frisch–Waugh–Lovell theorem states that if the regression we are concerned with is:

${\displaystyle Y=X_{1}\beta _{1}+X_{2}\beta _{2}+u}$

where ${\displaystyle X_{1}}$ and ${\displaystyle X_{2}}$ are ${\displaystyle n\times k_{1}}$ and ${\displaystyle n\times k_{2}}$ matrices respectively and where ${\displaystyle \beta _{1}}$ and ${\displaystyle \beta _{2}}$ are conformable, then the estimate of ${\displaystyle \beta _{2}}$ will be the same as the estimate of it from a modified regression of the form:

${\displaystyle M_{X_{1}}Y=M_{X_{1}}X_{2}\beta _{2}+M_{X_{1}}u,}$

where ${\displaystyle M_{X_{1}}}$ projects onto the orthogonal complement of the image of the projection matrix ${\displaystyle X_{1}(X_{1}^{\mathsf {T}}X_{1})^{-1}X_{1}^{\mathsf {T}}}$. Equivalently, M_X1 projects onto the orthogonal complement of the column space of X₁. Specifically,

${\displaystyle M_{X_{1}}=I-X_{1}(X_{1}^{\mathsf {T}}X_{1})^{-1}X_{1}^{\mathsf {T}},}$

and this particular orthogonal projection matrix is known as the annihilator matrix.^[4][5]

The vector ${\textstyle M_{X_{1}}Y}$ is the vector of residuals from regression of ${\textstyle Y}$ on the columns of ${\textstyle X_{1}}$.

The theorem implies that the secondary regression used for obtaining ${\displaystyle M_{X_{1}}}$ is unnecessary when the predictor variables are uncorrelated (this never happens in practice): using projection matrices to make the explanatory variables orthogonal to each other will lead to the same results as running the regression with all non-orthogonal explanators included.

References[]

Further reading[]

• Davidson, Russell; MacKinnon, James G. (1993). Estimation and Inference in Econometrics. New York: Oxford University Press. pp. 19–24. ISBN 0-19-506011-3.
• Davidson, Russell; MacKinnon, James G. (2004). Econometric Theory and Methods. New York: Oxford University Press. pp. 62–75. ISBN 0-19-512372-7.
• Hastie, Trevor; Tibshirani, Robert; Friedman, Jerome (2017). "Multiple Regression from Simple Univariate Regression" (PDF). The Elements of Statistical Learning : Data Mining, Inference, and Prediction (2nd ed.). New York: Springer. pp. 52–55. ISBN 978-0-387-84857-0.
• Ruud, P. A. (2000). An Introduction to Classical Econometric Theory. New York: Oxford University Press. pp. 54–60. ISBN 0-19-511164-8.
• Stachurski, John (2016). A Primer in Econometric Theory. MIT Press. pp. 311–314.