Newey–West estimator

A Newey–West estimator is used in statistics and econometrics to provide an estimate of the covariance matrix of the parameters of a regression-type model when this model is applied in situations where the standard assumptions of regression analysis do not apply.^[1] It was devised by Whitney K. Newey and Kenneth D. West in 1987, although there are a number of later variants.^[2][3][4][5] The estimator is used to try to overcome autocorrelation (also called serial correlation), and heteroskedasticity in the error terms in the models, often for regressions applied to time series data. The abbreviation "HAC," sometimes used for the estimator, stands for "heteroskedasticity and autocorrelation consistent."^[2]

Regression models estimated with time series data often exhibit autocorrelation; that is, the error terms are correlated over time. The heteroscedastically consistent estimator of the error covariance is constructed from a term ${\displaystyle X^{\operatorname {T} }\Sigma X}$, where ${\displaystyle X}$ is the design matrix for the regression problem and ${\displaystyle \Sigma }$ is the covariance matrix of the residuals. The least squares estimator ${\displaystyle b}$ is a consistent estimator of ${\displaystyle \beta }$. This implies that the least squares residuals ${\displaystyle e_{i}}$ are "point-wise" consistent estimators of their population counterparts ${\displaystyle E_{i}}$. The general approach, then, will be to use ${\displaystyle X}$ and ${\displaystyle e}$ to devise an estimator of ${\displaystyle X^{\operatorname {T} }\Sigma X}$.^[6] This means that as the time between error terms increases, the correlation between the error terms decreases. The estimator thus can be used to improve the ordinary least squares (OLS) regression when the residuals are heteroskedastic and/or autocorrelated.

${\displaystyle X^{\operatorname {T} }\Sigma X={\frac {1}{T}}\sum _{t=1}^{T}e_{t}^{2}x_{t}x_{t}^{\operatorname {T} }+{\frac {1}{T}}\sum _{\ell =1}^{L}\sum _{t=\ell +1}^{T}w_{\ell }e_{t}e_{t-\ell }(x_{t}x_{t-\ell }^{\operatorname {T} }+x_{t-\ell }x_{t}^{\operatorname {T} })}$

${\displaystyle w_{\ell }=1-{\frac {\ell }{L+1}}}$

where ${\displaystyle e_{t}}$ is the ${\displaystyle t_{th}}$ residual and ${\displaystyle x_{t}}$ is the <t_{th}> row of the design matrix, and ${\displaystyle w_{\ell }}$ can be thought of as a weight that decreases with increasing separation between samples. Disturbances that are farther apart from each other are given lower weight, while those with equal subscripts are given a weight of 1. This ensures that second term converges (in some appropriate sense) to a finite matrix. This weighting scheme also ensures that the resulting covariance matrix is positive semi-definite.^[2]

Software implementations[]

In Julia, the CovarianceMatrices.jl package ^[7] supports several types of heteroskedasticity and autocorrelation consistent covariance matrix estimation including Newey–West, White, and Arellano.

In R, the packages sandwich^[8] and plm^[9] include a function for the Newey–West estimator.

In Stata, the command newey produces Newey–West standard errors for coefficients estimated by OLS regression.^[10]

In MATLAB, the command hac in the Econometrics toolbox produces the Newey–West estimator (among others). ^[11]

In Python, the statsmodels^[12] module includes functions for the covariance matrix using Newey-West.

In Gretl, the option --robust to several estimation commands (such as ols) in the context of a time-series dataset produces Newey–West standard errors.^[13]

In SAS, the Newey-West corrected standard errors can be obtained in PROC AUTOREG and PROC MODEL ^[14]

See also[]

• Heteroscedasticity-consistent standard errors

References[]

Further reading[]

• Bierens, Herman J. (1994). Topics in Advanced Econometrics : Estimation, Testing, and Specification of Cross-section and Time Series Models. New York: Cambridge University Press. pp. 195–198. ISBN 978-0-521-41900-0.
• Hamilton, James D. (1994). Time Series Analysis. Princeton University Press. pp. 279–285. ISBN 978-0-691-04289-3.
• Hayashi, Fumio (2000). Econometrics. Princeton: Princeton University Press. pp. 408–410. ISBN 978-0-691-01018-2.
• Stock, James H.; Watson, Mark M. (2012). Introduction to Econometrics (Third international ed.). Harlow: Pearson. pp. 637–642. ISBN 978-1-4082-6433-1.
• Zeileis, A. (2004). "Econometric Computing with HC and HAC Covariance Matrix Estimators". Journal of Statistical Software. 11 (10): 1–17. doi:10.18637/jss.v011.i10.