The role of macroeconometric models in forecasting and policy analysis in the united states

This article stresses how little is known about the quality, particularly the relative quality, of macroeconometric models. Most economists make a strict distinction between the quality of a model per se and the accuracy of solutions based on that model. While this distinction is valid, it leaves unanswered how to compare the‘validity’of conditional models. The standard test, the accuracy of ex post simulations, is not definitive when models with differing degrees of exogeneity are compared. In addition, it is extremely difficult to estimate the relative quantitative importance of conceptual problems of models, such as parameter instability across‘policy regimes’ In light of the difficulty in comparisons of conditional macroeconometric models, many model-builders and users assume that the best models are those that have been used to make the most accurate forecasts are those made with the best models. Forecasting experience indicates that forecasters using macroeconometric models have produced more accurate macroeconomic forecasts than either naive or sophisticated unconditional statistical models. It also suggests that judgementally adjusted forecasts have been more accurate than model-based forecasts generated mechanically. The influence of econometrically-based forecasts is now so pervasive that it is difficult to find examples of‘purely judgemental’forecasts.     

Forecasting the Effects of a Canada–US Currency Union on Output and Prices: A Counterfactual Analysis

This paper is a counterfactual analysis investigating the consequences of the formation of a currency union for Canada and the USA: whether outputs increase and prices decrease if these countries form a currency union. We use a two‐country cointegrated model to conduct the counterfactual analysis, where the conditional forecasts are generated based on the Gaussian assumption. To deal with structural breaks and model uncertainty, conditional forecasts are generated from different models/estimation windows and the model‐averaging technique is used to combine the forecasts. We also examine the robustness of our results to parameter uncertainty using the wild bootstrap method. The results show that forming the currency union would probably boost the Canadian economy, whereas it would not have significant effects on US output or Canadian and US price levels. Copyright © 2013 John Wiley & Sons, Ltd.     

Bananas and petrol: further evidence on the forecasting accuracy of the ABS ‘headline’ and ‘underlying’ rates of inflation

In the light of the still topical nature of ‘bananas and petrol’ being blamed for driving much of the inflationary pressures in Australia in recent times, the ‘headline’ and ‘underlying’ rates of inflation are scrutinised in terms of forecasting accuracy. A general structural time‐series modelling strategy is applied to estimate models for alternative types of Consumer Price Index (CPI) measures. From this, out‐of‐sample forecasts are generated from the various models. The underlying forecasts are subsequently adjusted to facilitate comparison. The Ashley, Granger and Schmalensee (1980) test is then performed to determine whether there is a statistically significant difference between the root mean square errors of the models. The results lend weight to the recent findings of Song (2005) that forecasting models using underlying rates are not systematically inferior to those based on the headline rate. In fact, strong evidence is found that underlying measures produce superior forecasts. Copyright © 2009 John Wiley & Sons, Ltd.     

Sales forecasting using multi-equation transfer function models

The purpose of this study is first, to demonstrate how multivariate forecasting models can be effectively used to generate high performance forecasts for typical business applications. Second, this study compares the forecasts generated by a simultaneous transfer function model (STF) model and a white noise regression model with that of a univariate ARIMA model. The accuracy of these forecasting models is judged using their residual variances and forecasting errors in a post-sample period. It is found that ignoring the residual serial correlation can greatly degrade the forecasting performance of a multi-variable model, and in some situations, cause a multi-variable model to perform inferior to a univariate ARIMA model. This paper also demonstrates how a forecaster can use an STF model to compute both the multi-step ahead forecasts and their variances easily.     

Quasi-rational expectations: Experimental evidence

The theory of quasi-rational expectations was tested under the controlled conditions of the economics laboratory. Five experiments were conducted with a variety of stochastic processes. In each experiment, subjects produced one-step-ahead forecasts of the variable generated by a Monte Carlo process. Comparisons of the performance of an aggregate of subjects' forecasts versus an ARIMA model showed that for relatively simple series (such as those generated by autoregressive processes of first or second order) the aggregate forecast was indistinguishable from that of the model. These results lend support to the theory that forecasts from an ARIMA model can serve as substitutes for aggregate expectations in macroeconomic policy models under some conditions.     

Short-term forecasting of the US unemployment rate

This paper aims to assess whether Google search data are useful when predicting the US unemployment rate among other more traditional predictor variables. A weekly Google index is derived from the keyword “unemployment” and is used in diffusion index variants along with the weekly number of initial claims and monthly estimated latent factors. The unemployment rate forecasts are generated using MIDAS regression models that take into account the actual frequencies of the predictor variables. The forecasts are made in real time, and the forecasts of the best forecasting models exceed, for the most part, the root mean squared forecast error of two benchmarks. However, as the forecasting horizon increases, the forecasting performance of the best diffusion index variants decreases over time, which suggests that the forecasting methods proposed in this paper are most useful in the short term.     

Forecasting Australia's real house price index: A comparison of time series and machine learning methods

We employ 47 different algorithms to forecast Australian log real house prices and growth rates, and compare their ability to produce accurate out-of-sample predictions. The algorithms, which are specified in both single- and multi-equation frameworks, consist of traditional time series models, machine learning (ML) procedures, and deep learning neural networks. A method is adopted to compute iterated multistep forecasts from nonlinear ML specifications. While the rankings of forecast accuracy depend on the length of the forecast horizon, as well as on the choice of the dependent variable (log price or growth rate), a few generalizations can be made. For one- and two-quarter-ahead forecasts we find a large number of algorithms that outperform the random walk with drift benchmark. We also report several such outperformances at longer horizons of four and eight quarters, although these are not statistically significant at any conventional level. Six of the eight top forecasts (4 horizons × 2 dependent variables) are generated by the same algorithm, namely a linear support vector regressor (SVR). The other two highest ranked forecasts are produced as simple mean forecast combinations. Linear autoregressive moving average and vector autoregression models produce accurate olne-quarter-ahead predictions, while forecasts generated by deep learning nets rank well across medium and long forecast horizons.     

High‐frequency Markov switching models in the foreign exchange market

This paper estimates two‐state Markov models for three daily exchange rate series, and investigates the profitability of following the generated forecasts using the performance of simple chartist trading rules as benchmarks. It is shown that (1) the data are well approximated by Markov models, (2) the performance of previously profitable trading rules has dramatically declined in the 1990s, and (3) the Markov models are unstable and not suitable for forecasting in their current form. Copyright © 2000 John Wiley & Sons, Ltd.     

A BVAR model for the connecticut economy

A Bayesian vector autoregressive (BVAR) model is developed for the Connecticut economy to forecast the unemployment rate, nonagricultural employment, real personal income, and housing permits authorized. The model includes both national and state variables. The Bayesian prior is selected on the basis of the accuracy of the out-of-sample forecasts. We find that a loose prior generally produces more accurate forecasts. The out-of-sample accuracy of the BVAR forecasts is also compared with that of forecasts from an unrestricted VAR model and of benchmark forecasts generated from univariate ARIMA models. The BVAR model generally produces the most accurate short- and long-term out-of-sample forecasts for 1988 through 1992. It also correctly predicts the direction of change.     

A comparison of temperature density forecasts from GARCH and atmospheric models

Density forecasts for weather variables are useful for the many industries exposed to weather risk. Weather ensemble predictions are generated from atmospheric models and consist of multiple future scenarios for a weather variable. The distribution of the scenarios can be used as a density forecast, which is needed for pricing weather derivatives. We consider one to 10‐day‐ahead density forecasts provided by temperature ensemble predictions. More specifically, we evaluate forecasts of the mean and quantiles of the density. The mean of the ensemble scenarios is the most accurate forecast for the mean of the density. We use quantile regression to debias the quantiles of the distribution of the ensemble scenarios. The resultant quantile forecasts compare favourably with those from a GARCH model. These results indicate the strong potential for the use of ensemble prediction in temperature density forecasting. Copyright © 2004 John Wiley & Sons, Ltd.     

Choosing among competing econometric forecasts: Regression‐based forecast combination using model selection

Forecast combination based on a model selection approach is discussed and evaluated. In addition, a combination approach based on ex ante predictive ability is outlined. The model selection approach which we examine is based on the use of Schwarz (SIC) or the Akaike (AIC) Information Criteria. Monte Carlo experiments based on combination forecasts constructed using possibly (misspecified) models suggest that the SIC offers a potentially useful combination approach, and that further investigation is warranted. For example, combination forecasts from a simple averaging approach MSE‐dominate SIC combination forecasts less than 25% of the time in most cases, while other ‘standard’ combination approaches fare even worse. Alternative combination approaches are also compared by conducting forecasting experiments using nine US macroeconomic variables. In particular, artificial neural networks (ANN), linear models, and professional forecasts are used to form real‐time forecasts of the variables, and it is shown via a series of experiments that SIC, t‐statistic, and averaging combination approaches dominate various other combination approaches. An additional finding is that while ANN models may not MSE‐dominate simpler linear models, combinations of forecasts from these two models outperform either individual forecast, for a subset of the economic variables examined. Copyright © 2001 John Wiley & Sons, Ltd.     

Beating the VAR: Improving Swedish GDP Forecasts Using Error and Intercept Corrections

This paper examines the forecast accuracy of an unrestricted vector autoregressive (VAR) model for GDP, relative to a comparable vector error correction model (VECM) that recognizes that the data are characterized by co‐integration. In addition, an alternative forecast method, intercept correction, is considered for further comparison. Recursive out‐of‐sample forecasts are generated for both models and forecast techniques. The generated forecasts for each model are objectively evaluated by a selection of evaluation measures and equal accuracy tests. The result shows that the VECM consistently outperforms the VAR models. Further, intercept correction enhances the forecast accuracy when applied to the VECM, whereas there is no such indication when applied to the VAR model. For certain forecast horizons there is a significant difference in forecast ability between the intercept corrected VECM compared to the VAR model. Copyright © 2015 John Wiley & Sons, Ltd.     

A New‐Keynesian DSGE model for forecasting the South African economy

This paper develops a New‐Keynesian Dynamic Stochastic General Equilibrium (NKDSGE) model for forecasting the growth rate of output, inflation, and the nominal short‐term interest rate (91 days Treasury Bill rate) for the South African economy. The model is estimated via maximum likelihood technique for quarterly data over the period of 1970:1–2000:4. Based on a recursive estimation using the Kalman filter algorithm, out‐of‐sample forecasts from the NKDSGE model are compared with forecasts generated from the classical and Bayesian variants of vector autoregression (VAR) models for the period 2001:1–2006:4. The results indicate that in terms of out‐of‐sample forecasting, the NKDSGE model outperforms both the classical and Bayesian VARs for inflation, but not for output growth and nominal short‐term interest rate. However, differences in RMSEs are not significant across the models. Copyright © 2008 John Wiley & Sons, Ltd.     

Professional economic forecasts: Are they worth their costs?

Most economic forecast evaluations dating back 20 years show that professional forecasters add little to the forecasts generated by the simplest of models. Using various types of forecast error criteria, these evaluations usually conclude that the professional forecasts are little better than the no-change or ARIM A type forecast. It is our contention that this conclusion is mistaken because the conventional error criteria may not capture why forecasts are ma& or how they are used. Using forecast directional accuracy, the criterion which has been found to be highly correlated with profits in an interest rate setting, we find that professional GNP forecasts dominate the cheaper alternatives. Moreover, there appears to be no systematic relationship between this preferred criterion and the error measures used in previous studies.     

The Effects of Disaggregation on Forecasting Nonstationary Time Series

This paper focuses on the effects of disaggregation on forecast accuracy for nonstationary time series using dynamic factor models. We compare the forecasts obtained directly from the aggregated series based on its univariate model with the aggregation of the forecasts obtained for each component of the aggregate. Within this framework (first obtain the forecasts for the component series and then aggregate the forecasts), we try two different approaches: (i) generate forecasts from the multivariate dynamic factor model and (ii) generate the forecasts from univariate models for each component of the aggregate. In this regard, we provide analytical conditions for the equality of forecasts. The results are applied to quarterly gross domestic product (GDP) data of several European countries of the euro area and to their aggregated GDP. This will be compared to the prediction obtained directly from modeling and forecasting the aggregate GDP of these European countries. In particular, we would like to check whether long‐run relationships between the levels of the components are useful for improving the forecasting accuracy of the aggregate growth rate. We will make forecasts at the country level and then pool them to obtain the forecast of the aggregate. The empirical analysis suggests that forecasts built by aggregating the country‐specific models are more accurate than forecasts constructed using the aggregated data. Copyright © 2014 John Wiley & Sons, Ltd.     

Forecasting US employment growth using forecast combining methods

We examine different approaches to forecasting monthly US employment growth in the presence of many potentially relevant predictors. We first generate simulated out‐of‐sample forecasts of US employment growth at multiple horizons using individual autoregressive distributed lag (ARDL) models based on 30 potential predictors. We then consider different methods from the extant literature for combining the forecasts generated by the individual ARDL models. Using the mean square forecast error (MSFE) metric, we investigate the performance of the forecast combining methods over the last decade, as well as five periods centered on the last five US recessions. Overall, our results show that a number of combining methods outperform a benchmark autoregressive model. Combining methods based on principal components exhibit the best overall performance, while methods based on simple averaging, clusters, and discount MSFE also perform well. On a cautionary note, some combining methods, such as those based on ordinary least squares, often perform quite poorly. Copyright © 2008 John Wiley & Sons, Ltd.     

Forecasting the Term Structure when Short‐Term Rates are Near Zero

This paper compares the experience of forecasting the UK government bond yield curve before and after the dramatic lowering of short‐term interest rates from October 2008. Out‐of‐sample forecasts for 1, 6 and 12 months are generated from each of a dynamic Nelson–Siegel model, autoregressive models for both yields and the principal components extracted from those yields, a slope regression and a random walk model. At short forecasting horizons, there is little difference in the performance of the models both prior to and after 2008. However, for medium‐ to longer‐term horizons, the slope regression provided the best forecasts prior to 2008, while the recent experience of near‐zero short interest rates coincides with a period of forecasting superiority for the autoregressive and dynamic Nelson–Siegel models. Copyright © 2014 John Wiley & Sons, Ltd.     

Daily FX Volatility Forecasts: Can the GARCH(1,1) Model be Beaten using High‐Frequency Data?

Volatility forecasting remains an active area of research with no current consensus as to the model that provides the most accurate forecasts, though Hansen and Lunde (2005) have argued that in the context of daily exchange rate returns nothing can beat a GARCH(1,1) model. This paper extends that line of research by utilizing intra‐day data and obtaining daily volatility forecasts from a range of models based upon the higher‐frequency data. The volatility forecasts are appraised using four different measures of ‘true’ volatility and further evaluated using regression tests of predictive power, forecast encompassing and forecast combination. Our results show that the daily GARCH(1,1) model is largely inferior to all other models, whereas the intra‐day unadjusted‐data GARCH(1,1) model generally provides superior forecasts compared to all other models. Hence, while it appears that a daily GARCH(1,1) model can be beaten in obtaining accurate daily volatility forecasts, an intra‐day GARCH(1,1) model cannot be. Copyright © 2011 John Wiley & Sons, Ltd.     

A Quantile Regression Approach to Equity Premium Prediction

We propose a quantile regression approach to equity premium forecasting. Robust point forecasts are generated from a set of quantile forecasts using both fixed and time‐varying weighting schemes, thereby exploiting the entire distributional information associated with each predictor. Further gains are achieved by incorporating the forecast combination methodology into our quantile regression setting. Our approach using a time‐varying weighting scheme delivers statistically and economically significant out‐of‐sample forecasts relative to both the historical average benchmark and the combined predictive mean regression modeling approach. Copyright © 2014 John Wiley & Sons, Ltd.