Working Paper
Reality checks and nested forecast model comparisons
Abstract: This paper develops a novel and effective bootstrap method for simulating asymptotic critical values for tests of equal forecast accuracy and encompassing among many nested models. The bootstrap, which combines elements of fixed regressor and wild bootstrap methods, is simple to use. We first derive the asymptotic distributions of tests of equal forecast accuracy and encompassing applied to forecasts from multiple models that nest the benchmark model ? that is, reality check tests applied to nested models. We then prove the validity of the bootstrap for these tests. Monte Carlo experiments indicate that our proposed bootstrap has better finite-sample size and power than other methods designed for comparison of non-nested models. We conclude with empirical applications to multiple-model forecasts of commodity prices and GDP growth.
Keywords: Economic forecasting;
Access Documents
File(s): File format is application/pdf http://research.stlouisfed.org/wp/2010/2010-032.pdf
Authors
Bibliographic Information
Provider: Federal Reserve Bank of St. Louis
Part of Series: Working Papers
Publication Date: 2010
Number: 2010-032