N-step combinations of forecasts

While there is general agreement that a linear combination of forecasts can outperform the individual forecasts, there is controversy about the appropriateness of the combination method to be used in a given situation. Hence, in any given application it may be more beneficial to combine different sets of combined forecasts rather than picking one of them. This paper introduces the concept of N-step combinations of forecasts which involves combining the combined forecasts obtained from different combination procedures used at the preceding step. Using quarterly GNP data, evidence supporting the increase in the accuracy of the one-period-ahead ex-ante forecasts as the combination step increases is provided. The MSE, MAE, MAPE and their corresponding standard deviations are used to evaluate the accuracy of the forecasts obtained.     

A comparison of temperature density forecasts from GARCH and atmospheric models

Density forecasts for weather variables are useful for the many industries exposed to weather risk. Weather ensemble predictions are generated from atmospheric models and consist of multiple future scenarios for a weather variable. The distribution of the scenarios can be used as a density forecast, which is needed for pricing weather derivatives. We consider one to 10‐day‐ahead density forecasts provided by temperature ensemble predictions. More specifically, we evaluate forecasts of the mean and quantiles of the density. The mean of the ensemble scenarios is the most accurate forecast for the mean of the density. We use quantile regression to debias the quantiles of the distribution of the ensemble scenarios. The resultant quantile forecasts compare favourably with those from a GARCH model. These results indicate the strong potential for the use of ensemble prediction in temperature density forecasting. Copyright © 2004 John Wiley & Sons, Ltd.     

An empirical investigation of combinations of economic forecasts

This paper examines the effects of combining three econometric and three times-series forecasts of growth and inflation in the U.K. If forecasts are unbiased then a combination exploiting this fact will be more efficient than an unrestricted combination. Ex post econometric forecasts may be biased but ex ante they are unbiased. The results of the study are that a restricted linear combination of the econometric forecasts is superior to an unrestricted combination and also to the unweighted mean of the forecasts. However, it is not preferred to the best of the individual forecasts.     

Overreaction in Survey Exchange Rate Forecasts

We use survey data on five bilateral exchange rates to provide empirical evidence of the fact that professional forecasters of foreign exchange rates behave irrationally, in the specific sense that they respond inaccurately to available information in the market when forming their predictions. In particular, we find systematic biases in the forecasts resulting in the overreaction of analysts to past information contained in the exchange rate dynamics: forecasters change their prediction more than it would be rational on the basis of past realized changes. In addition, forecasters are heterogeneous in their irrationality: low performers in previous periods show a more pronounced overreaction effect. This can be read as an indication of perpetration of past errors and continued inability to learn from the past. In the second part of the paper, we exploit the novel structure of our dataset, which consists of survey data extracted from the Bloomberg platform and readily available to anyone. This feature allows us to consider their own and others' past forecasts as part of the information set that analysts use in making their predictions. By using past forecasts as proxies for relevant macroeconomic variables, we find evidence that analysts fail to correctly process not only the information contained in the spot rate past dynamics but also the information in this broader set. We see this as confirmation of the existence of inefficiency and heterogeneity between low and high performers also when full information is available. Copyright © 2014 John Wiley & Sons, Ltd.     

Combining exchange rate forecasts: What is the optimal consensus measure?

In this paper a high-quality disaggregate database is utilized to examine whether individual forecasters produce efficient exchange rate predictions and also if the properties of the forecasts change when they are combined. The paper links a number of themes in the exchange rate literature and examines various methods of forecast combination. It is demonstrated, inter alia, that some forecasters are better than others, but that most are not as good as a naive no-change prediction. Combining forecasts adds to the accuracy of the predictions, but the gains mainly reflect the removal of systematic and unstable bias.     

Enhancing survey‐based investment forecasts

We investigate the accuracy of capital investment predictors from a national business survey of South African manufacturing. Based on data available to correspondents at the time of survey completion, we propose variables that might inform the confidence that can be attached to their predictions. Having calibrated the survey predictors' directional accuracy, we model the probability of a correct directional prediction using logistic regression with the proposed variables. For point forecasting, we compare the accuracy of rescaled survey forecasts with time series benchmarks and some survey/time series hybrid models. In addition, using the same set of variables, we model the magnitude of survey prediction errors. Directional forecast tests showed that three out of four survey predictors have value but are biased and inefficient. For shorter horizons we found that survey forecasts, enhanced by time series data, significantly improved point forecasting accuracy. For longer horizons the survey predictors were at least as accurate as alternatives. The usefulness of the more accurate of the predictors examined is enhanced by auxiliary information, namely the probability of directional accuracy and the estimated error magnitude.     

How successful are dynamic factor models at forecasting output and inflation? A meta‐analytic approach

This paper uses a meta‐analysis to survey existing factor forecast applications for output and inflation and assesses what causes large factor models to perform better or more poorly at forecasting than other models. Our results suggest that factor models tend to outperform small models, whereas factor forecasts are slightly worse than pooled forecasts. Factor models deliver better predictions for US variables than for UK variables, for US output than for euro‐area output and for euro‐area inflation than for US inflation. The size of the dataset from which factors are extracted positively affects the relative factor forecast performance, whereas pre‐selecting the variables included in the dataset did not improve factor forecasts in the past. Finally, the factor estimation technique may matter as well. Copyright © 2008 John Wiley & Sons, Ltd.     

Combination forecasts of output growth in a seven‐country data set

This paper uses forecast combination methods to forecast output growth in a seven‐country quarterly economic data set covering 1959–1999, with up to 73 predictors per country. Although the forecasts based on individual predictors are unstable over time and across countries, and on average perform worse than an autoregressive benchmark, the combination forecasts often improve upon autoregressive forecasts. Despite the unstable performance of the constituent forecasts, the most successful combination forecasts, like the mean, are the least sensitive to the recent performance of the individual forecasts. While consistent with other evidence on the success of simple combination forecasts, this finding is difficult to explain using the theory of combination forecasting in a stationary environment. Copyright © 2004 John Wiley & Sons, Ltd.     

Social networks and private spaces in economic forecasting

The outputs of economic forecasting—predictions for national economic indicators such as GDP, unemployment rates and inflation—are all highly visible. The production of these forecasts is a much more private affair, however, typically being thought of as the work of individual forecasters or forecast teams using their economic model to produce a forecast that is then made public. This conception over-emphasises the individual and the technical whilst silencing the broader social context through which economic forecasters develop the expertise that is essential for the credibility of their predictions. In particular, economic forecasts are given meaning and fine-tuned through the social and institutional networks that give forecasters access to the expertise of a heterogeneous mix of academics, policy-makers and business people. Within these broader groups, individual forecasters often create private forecast ‘clubs’, where subscribers have privileged access to the expertise of the economist, but where the forecasters also have privileged access to their clients’ own expert knowledge. In examining these aspects of the forecasters’ work I show that the visible and audible activities of modelling and forecasting are made possible and plausible by virtue of the modeller’s invisible interaction with a wider network.     

Predicting exchange rates in Asia: New insights on the accuracy of survey forecasts

By linking measures of forecast accuracy as well as testing procedures with regard to forecast rationality this paper investigates aggregated survey forecasts with forecast horizons of 3, 12, and 24 months for the exchange rates of the Chinese yuan, the Hong Kong dollar, the Japanese yen, and the Singapore dollar vis-à-vis the US dollar and, hence, for four different currency regimes. The rationality of the exchange rate predictions is initially assessed utilizing tests for unbiasedness and efficiency which indicate that the investigated forecasts are irrational in the sense that the predictions are biased. As one major contribution of this paper, it is subsequently shown that these results are not consistent with an alternative, less restrictive, measure of rationality. Investigating the order of integration of the time series as well as cointegrating relationships, this empirical evidence supports the conclusion that the majority of forecasts are in fact rational. Regarding forerunning properties of the predictions, the results are rather mediocre, with shorter term forecasts for the tightly managed USD/CNY FX regime being one exception. As one additional important and novel evaluation result, it can be concluded, that the currency regime matters for the quality of exchange rate forecasts.     

Point forecasting of intraday volume using Bayesian autoregressive conditional volume models

In this paper, we apply Bayesian inference to model and forecast intraday trading volume, using autoregressive conditional volume (ACV) models, and we evaluate the quality of volume point forecasts. In the empirical application, we focus on the analysis of both in‐ and out‐of‐sample performance of Bayesian ACV models estimated for 2‐minute trading volume data for stocks quoted on the Warsaw Stock Exchange in Poland. We calculate two types of point forecasts, using either expected values or medians of predictive distributions. We conclude that, in general, all considered models generate significantly biased forecasts. We also observe that the considered models significantly outperform such benchmarks as the naïve or rolling means forecasts. Moreover, in terms of root mean squared forecast errors, point predictions obtained within the ACV model with exponential distribution emerge superior compared to those calculated in structures with more general innovation distributions, although in many cases this characteristic turns out to be statistically insignificant. On the other hand, when comparing mean absolute forecast errors, the median forecasts obtained within the ACV models with Burr and generalized gamma distribution are found to be statistically better than other forecasts.     

ARIMA models of the price level: An assessment of the multilevel adaptive learning process in the USA

This paper estimates the ARIMA processes for the observed and expected price level corresponding to the three-level adaptive expectations model proposed by Jacobs and Jones (1980). These univariate processes are then compared with the best-fit ARIMA model. The results indicate that the best-fit model for the observed price level is a restricted version of the two-level adaptive learning process specified in terms of prices, suggesting a simple adaptive rule in the inflation rate. A comparison of the time-series forecasts from the best-fit model with the mean responses to the ASA-NBER survey shows no significant difference in their accuracy. The time-series forecasts are, however, conditionally efficient. The best-fit ARIMA model for expected prices measured by the ASA-NBER consensus forecasts does not correspond to any version of the Jacobs and Jones model.     

An assessment of the economic value of non-linear foreign exchange rate forecasts

Recent research suggests that non-linear methods cannot improve the point forecasts of high-frequency exchange rates. These studies have been using standard forecasting criteria such as smallest mean squared error (MSE) and smallest mean absolute error (MAE). It is, however, premature to conclude from this evidence that non-linear forecasts of high-frequency financial returns are economically or statistically insignificant. We prove a proposition which implies that the standard forecasting criteria are not necessarily particularly suited for assessment of the economic value of predictions of non-linear processes where the predicted value and the prediction error may not be independently distributed. Adopting a simple non-linear forecasting procedure to 15 daily exchange rate series we find that although, when compared to simple random walk forecasts, all the non-linear forecasts give a higher MSE and MAE, when applied in a simple trading strategy these forecasts result in a higher mean return. It is also shown that the ranking of portfolio payoffs based on forecasts from a random walk, and linear and non-linear models, is closely related to a non-parametric test of market timing.     

Forecasting Australia's real house price index: A comparison of time series and machine learning methods

We employ 47 different algorithms to forecast Australian log real house prices and growth rates, and compare their ability to produce accurate out-of-sample predictions. The algorithms, which are specified in both single- and multi-equation frameworks, consist of traditional time series models, machine learning (ML) procedures, and deep learning neural networks. A method is adopted to compute iterated multistep forecasts from nonlinear ML specifications. While the rankings of forecast accuracy depend on the length of the forecast horizon, as well as on the choice of the dependent variable (log price or growth rate), a few generalizations can be made. For one- and two-quarter-ahead forecasts we find a large number of algorithms that outperform the random walk with drift benchmark. We also report several such outperformances at longer horizons of four and eight quarters, although these are not statistically significant at any conventional level. Six of the eight top forecasts (4 horizons × 2 dependent variables) are generated by the same algorithm, namely a linear support vector regressor (SVR). The other two highest ranked forecasts are produced as simple mean forecast combinations. Linear autoregressive moving average and vector autoregression models produce accurate olne-quarter-ahead predictions, while forecasts generated by deep learning nets rank well across medium and long forecast horizons.     

Assessing the historical accuracy of regional economic forecasts

This study addresses for the first time systematic evaluation of a widely used class of forecasts, regional economic forecasts. Ex ante regional structural equation model forecasts are analysed for 19 metropolitan areas. One- to ten-quarter-ahead forecasts are considered and the seven-year sample spans a complete business cycle. Counter to previous speculation in the literature, (1) dependency on macroeconomic forecasting model inputs does not substantially erode accuracy relative to univariate extrapolative methodologies and (2) stochastic time series models do not on average, yield more accurate regional economic predictions than structural models. Similar to findings in other studies, clear preferences among extrapolative methodologies do not emerge. Most general conclusions, however, are subject to caveats based on step-length effects and region-specific effects.     

US Inflation Expectations and Heterogeneous Loss Functions, 1968–2010

Recent literature has suggested that macroeconomic forecasters may have asymmetric loss functions, and that there may be heterogeneity across forecasters in the degree to which they weigh under‐ and over‐predictions. Using an individual‐level analysis that exploits the Survey of Professional Forecasters respondents’ histogram forecasts, we find little evidence of asymmetric loss for the inflation forecasters. Copyright © 2013 John Wiley & Sons, Ltd.     

On the Predictive Content of Autoregression Residuals: A Semiparametric,Copula‐Based Approach to Time Series Prediction

This paper proposes an adjustment of linear autoregressive conditional mean forecasts that exploits the predictive content of uncorrelated model residuals. The adjustment is motivated by non‐Gaussian characteristics of model residuals, and implemented in a semiparametric fashion by means of conditional moments of simulated bivariate distributions. A pseudo ex ante forecasting comparison is conducted for a set of 494 macroeconomic time series recently collected by Dees et al. (Journal of Applied Econometrics 2007; 22: 1–38). In total, 10,374 time series realizations are contrasted against competing short‐, medium‐ and longer‐term purely autoregressive and adjusted predictors. With regard to all forecast horizons, the adjusted predictions consistently outperform conditionally Gaussian forecasts according to cross‐sectional mean group evaluation of absolute forecast errors and directional accuracy. Copyright © 2012 John Wiley & Sons, Ltd.     

Are household subjective forecasts of personal finances accurate and useful? A directional analysis of the British Household Panel Survey

The purpose of the paper is to analyse the accuracy and usefulness of household subjective forecasts of personal finance. We use non‐parametric directional analysis to assess the subjective forecasts which are based on qualitative judgments. Using the British Household Panel Survey (BHPS) we are able to analyse a large number of individuals over a number of years. We also take into account individual characteristics such as gender, age, education and employment status when assessing their subjective forecasts. The paper extends the existing literature in two ways: the accuracy and usefulness of subjective forecasts, based on directional analysis, are assessed at the household level for the first time. Secondly, we adapt and extend the methods of directional analysis, which are applied to the household panel or longitudinal survey. Copyright © 2008 John Wiley & Sons, Ltd.     

Spreads versus professional forecasters as predictors of future output change

We examine whether real output forecasts obtained from the Survey of Professional Forecasters efficiently embody information in the term structure spread. To this end, we employ revised data as well as real‐time vintage data, and we also allow for the possible impact of asymmetric loss functions. Assuming quadratic loss, our results suggest that the term structure spread does contain information useful for forecasting not reflected in the survey forecasts, at least over the longest forecast horizon. However, if we allow agents' loss functions to become more negatively skewed with the forecast horizon, then we cannot reject the rationality of the survey forecasts. Copyright © 2009 John Wiley & Sons, Ltd.     

Choosing among competing econometric forecasts: Regression‐based forecast combination using model selection

Forecast combination based on a model selection approach is discussed and evaluated. In addition, a combination approach based on ex ante predictive ability is outlined. The model selection approach which we examine is based on the use of Schwarz (SIC) or the Akaike (AIC) Information Criteria. Monte Carlo experiments based on combination forecasts constructed using possibly (misspecified) models suggest that the SIC offers a potentially useful combination approach, and that further investigation is warranted. For example, combination forecasts from a simple averaging approach MSE‐dominate SIC combination forecasts less than 25% of the time in most cases, while other ‘standard’ combination approaches fare even worse. Alternative combination approaches are also compared by conducting forecasting experiments using nine US macroeconomic variables. In particular, artificial neural networks (ANN), linear models, and professional forecasts are used to form real‐time forecasts of the variables, and it is shown via a series of experiments that SIC, t‐statistic, and averaging combination approaches dominate various other combination approaches. An additional finding is that while ANN models may not MSE‐dominate simpler linear models, combinations of forecasts from these two models outperform either individual forecast, for a subset of the economic variables examined. Copyright © 2001 John Wiley & Sons, Ltd.