Can consumer sentiment and its components forecast Australian GDP and consumption?

This paper examines whether the disaggregation of consumer sentiment data into its sub‐components improves the real‐time capacity to forecast GDP and consumption. A Bayesian error correction approach augmented with the consumer sentiment index and permutations of the consumer sentiment sub‐indices is used to evaluate forecasting power. The forecasts are benchmarked against both composite forecasts and forecasts from standard error correction models. Using Australian data, we find that consumer sentiment data increase the accuracy of GDP and consumption forecasts, with certain components of consumer sentiment consistently providing better forecasts than aggregate consumer sentiment data. Copyright © 2009 John Wiley & Sons, Ltd.     

Testing the rationality of forecast revisions made by the IMF and the OECD

We investigate the rationality of forecast revisions made by the IMF and the OECD over the past three decades. We find that 60% of real‐GDP forecast series and 37% of GDP‐deflator forecast series are consistent with rationality. Forecast smoothing is found in real‐GDP forecasts. Copyright © 2006 John Wiley & Sons, Ltd.     

Mincer–Zarnowitz quantile and expectile regressions for forecast evaluations under aysmmetric loss functions

Forecasts are pervasive in all areas of applications in business and daily life. Hence evaluating the accuracy of a forecast is important for both the generators and consumers of forecasts. There are two aspects in forecast evaluation: (a) measuring the accuracy of past forecasts using some summary statistics, and (b) testing the optimality properties of the forecasts through some diagnostic tests. On measuring the accuracy of a past forecast, this paper illustrates that the summary statistics used should match the loss function that was used to generate the forecast. If there is strong evidence that an asymmetric loss function has been used in the generation of a forecast, then a summary statistic that corresponds to that asymmetric loss function should be used in assessing the accuracy of the forecast instead of the popular root mean square error or mean absolute error. On testing the optimality of the forecasts, it is demonstrated how the quantile regressions set in the prediction–realization framework of Mincer and Zarnowitz (in J. Mincer (Ed.), Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance (pp. 14–20), 1969) can be used to recover the unknown parameter that controls the potentially asymmetric loss function used in generating the past forecasts. Finally, the prediction–realization framework is applied to the Federal Reserve's economic growth forecast and forecast sharing in a PC manufacturing supply chain. It is found that the Federal Reserve values overprediction approximately 1.5 times more costly than underprediction. It is also found that the PC manufacturer weighs positive forecast errors (under forecasts) about four times as costly as negative forecast errors (over forecasts).     

Professional economic forecasts: Are they worth their costs?

Most economic forecast evaluations dating back 20 years show that professional forecasters add little to the forecasts generated by the simplest of models. Using various types of forecast error criteria, these evaluations usually conclude that the professional forecasts are little better than the no-change or ARIM A type forecast. It is our contention that this conclusion is mistaken because the conventional error criteria may not capture why forecasts are ma& or how they are used. Using forecast directional accuracy, the criterion which has been found to be highly correlated with profits in an interest rate setting, we find that professional GNP forecasts dominate the cheaper alternatives. Moreover, there appears to be no systematic relationship between this preferred criterion and the error measures used in previous studies.     

The use of encompassing tests for forecast combinations

This paper proposes an algorithm that uses forecast encompassing tests for combining forecasts when there are a large number of forecasts that might enter the combination. The algorithm excludes a forecast from the combination if it is encompassed by another forecast. To assess the usefulness of this approach, an extensive empirical analysis is undertaken using a US macroeconomic dataset. The results are encouraging; the algorithm forecasts outperform benchmark model forecasts, in a mean square error (MSE) sense, in a majority of cases. The paper also compares the empirical performance of different approaches to forecast combination, and provides a rule‐of‐thumb cut‐off point for the thick‐modeling approach. Copyright © 2009 John Wiley & Sons, Ltd.     

Evaluating forecasts: a look at aggregate bias and accuracy measures

In this paper an investigation is made of the properties and use of two aggregate measures of forecast bias and accuracy. These are metrics used in business to calculate aggregate forecasting performance for a family (group) of products. We find that the aggregate measures are not particularly informative if some of the one‐step‐ahead forecasts are biased. This is likely to be the case in practice if frequently employed forecasting methods are used to generate a large number of individual forecasts. In the paper, examples are constructed to illustrate some potential problems in the use of the metrics. We propose a simple graphical display of forecast bias and accuracy to supplement the information yielded by the accuracy measures. This support includes relevant boxplots of measures of individual forecasting success. This tool is simple but helpful as the graphic display has the potential to indicate forecast deterioration that can be masked by one or both of the aggregate metrics. The procedures are illustrated with data representing sales of food items. Copyright © 2005 John Wiley & Sons, Ltd.     

The maximum and minimum of primary forecasts

The purpose of this paper is to suggest that the maximum (or minimum) of a number of primary forecasts may make a valuable addition to the forecasting accuracy of a combination of forecasts. Such forecasts are readily computable. Theoretical results are presented for two unbiased forecasts with correlated normally distributed errors, showing that the maximum (minimum) of two forecasts can have a smaller error variance than either of the primary forecasts and the forecast error can have low correlation with the primary errors. Empirical results are obtained for two different sets of forecasts available in the literature, and it is observed that a combination forecast including the maximum and/or minimum has attractive forecasting properties.     

Beating the VAR: Improving Swedish GDP Forecasts Using Error and Intercept Corrections

This paper examines the forecast accuracy of an unrestricted vector autoregressive (VAR) model for GDP, relative to a comparable vector error correction model (VECM) that recognizes that the data are characterized by co‐integration. In addition, an alternative forecast method, intercept correction, is considered for further comparison. Recursive out‐of‐sample forecasts are generated for both models and forecast techniques. The generated forecasts for each model are objectively evaluated by a selection of evaluation measures and equal accuracy tests. The result shows that the VECM consistently outperforms the VAR models. Further, intercept correction enhances the forecast accuracy when applied to the VECM, whereas there is no such indication when applied to the VAR model. For certain forecast horizons there is a significant difference in forecast ability between the intercept corrected VECM compared to the VAR model. Copyright © 2015 John Wiley & Sons, Ltd.     

Flow of conjunctural information and forecast of euro area economic activity

Combining forecasts, we analyse the role of information flow in computing short‐term forecasts up to one quarter ahead for the euro area GDP and its main components. A dataset of 114 monthly indicators is set up and simple bridge equations are estimated. The individual forecasts are then pooled, using different weighting schemes. To take into consideration the release calendar of each indicator, six forecasts are compiled successively during the quarter. We found that the sequencing of information determines the weight allocated to each block of indicators, especially when the first month of hard data becomes available. This conclusion extends the findings of the recent literature. Moreover, when combining forecasts, two weighting schemes are found to outperform the equal weighting scheme in almost all cases. Compared to an AR forecast, these improve by more than 40% the forecast performance for GDP in the current and next quarter. Copyright © 2010 John Wiley & Sons, Ltd.     

The Role of Financial Variables in predicting economic activity

Previous research found that the US business cycle leads the European one by a few quarters, and can therefore be useful in predicting euro area gross domestic product (GDP). In this paper we investigate whether additional predictive power can be gained by adding selected financial variables belonging to either the USA or the euro area. We use vector autoregressions (VARs) that include the US and euro area GDPs as well as growth in the Rest of the World and selected combinations of financial variables. Out‐of‐sample root mean square forecast errors (RMSEs) evidence that adding financial variables produces a slightly smaller error in forecasting US economic activity. This weak macro‐financial linkage is even weaker in the euro area, where financial indicators do not improve short‐ and medium‐term GDP forecasts even when their timely availability relative to GDP is exploited. It can be conjectured that neither US nor European financial variables help predict euro area GDP as the US GDP has already embodied this information. However, we show that the finding that financial variables have no predictive power for future activity in the euro area relates to the unconditional nature of the RMSE metric. When forecasting ability is assessed as if in real time (i.e. conditionally on the information available at the time when forecasts are made), we find that models using financial variables would have been preferred in several episodes and in particular between 1999 and 2002. Copyright 2011 John Wiley & Sons, Ltd.     

Forecasting volatility

In this paper, we investigate the time series properties of S&P 100 volatility and the forecasting performance of different volatility models. We consider several nonparametric and parametric volatility measures, such as implied, realized and model‐based volatility, and show that these volatility processes exhibit an extremely slow mean‐reverting behavior and possible long memory. For this reason, we explicitly model the near‐unit root behavior of volatility and construct median unbiased forecasts by approximating the finite‐sample forecast distribution using bootstrap methods. Furthermore, we produce prediction intervals for the next‐period implied volatility that provide important information about the uncertainty surrounding the point forecasts. Finally, we apply intercept corrections to forecasts from misspecified models which dramatically improve the accuracy of the volatility forecasts. Copyright © 2006 John Wiley & Sons, Ltd.     

Are 16‐month‐ahead forecasts useful? A directional analysis of Japanese GDP forecasts

Past literature casts doubt on the ability of long‐term macroeconomic forecasts to predict the direction of change. We re‐examine this issue using the Japanese GDP forecast data of 37 institutions, and find that their 16‐month‐ahead forecasts contain valuable information on whether the growth rate accelerates or not. Copyright © 2006 John Wiley _ Sons, Ltd.     

Political manoeuvrings as sources of measurement errors in forecasts

We test the extent to which political manoeuvrings can be the sources of measurement errors in forecasts. Our objective is to examine the forecast error based on a simple model in which we attempt to explain deviations between the March budget forecast and the November forecast, and deviations between the outcome and the March budget forecast in the UK. The analysis is based on forecasts made by the general government. We use the forecasts of the variables as alternatives to the outcomes. We also test for political spins in the GDP forecast updates and the GDP forecast errors. We find evidence of partisan and electoral effects in forecast updates and forecast errors. Copyright © 2005 John Wiley & Sons, Ltd.     

Forecast Combination and Bayesian Model Averaging: A Prior Sensitivity Analysis

In this study we evaluate the forecast performance of model‐averaged forecasts based on the predictive likelihood carrying out a prior sensitivity analysis regarding Zellner's g prior. The main results are fourfold. First, the predictive likelihood does always better than the traditionally employed ‘marginal’ likelihood in settings where the true model is not part of the model space. Secondly, forecast accuracy as measured by the root mean square error (RMSE) is maximized for the median probability model. On the other hand, model averaging excels in predicting direction of changes. Lastly, g should be set according to Laud and Ibrahim (1995: Predictive model selection. Journal of the Royal Statistical Society B 57 : 247–262) with a hold‐out sample size of 25% to minimize the RMSE (median model) and 75% to optimize direction of change forecasts (model averaging). We finally apply the aforementioned recommendations to forecast the monthly industrial production output of six countries, beating for almost all countries the AR(1) benchmark model. Copyright © 2011 John Wiley & Sons, Ltd.     

Forecast Combination for Euro Area Inflation: A Cure in Times of Crisis?

The period of extraordinary volatility in euro area headline inflation starting in 2007 raised the question whether forecast combination methods can be used to hedge against bad forecast performance of single models during such periods and provide more robust forecasts. We investigate this issue for forecasts from a range of short‐term forecasting models. Our analysis shows that there is considerable variation of the relative performance of the different models over time. To take that into account we suggest employing performance‐based forecast combination methods—in particular, one with more weight on the recent forecast performance. We compare such an approach with equal forecast combination that has been found to outperform more sophisticated forecast combination methods in the past, and investigate whether it can improve forecast accuracy over the single best model. The time‐varying weights assign weights to the economic interpretations of the forecast stemming from different models. We also include a number of benchmark models in our analysis. The combination methods are evaluated for HICP headline inflation and HICP excluding food and energy. We investigate how forecast accuracy of the combination methods differs between pre‐crisis times, the period after the global financial crisis and the full evaluation period, including the global financial crisis with its extraordinary volatility in inflation. Overall, we find that forecast combination helps hedge against bad forecast performance and that performance‐based weighting outperforms simple averaging. Copyright © 2017 John Wiley & Sons, Ltd.     

Do IMF fiscal forecasts add value?

We used a panel of 29 advanced and emerging market countries to investigate whether the IMF's World Economic Outlook (WEO) fiscal forecasts add value in terms of forecast accuracy and information content, relative to private sector forecasts (from Consensus Economics). We find that: (i) WEO forecasts are not significantly less accurate than Consensus forecasts; (ii) WEO and Consensus forecasts tend to mutually encompass one another; and (iii) each source of forecasts appears to contain some information that is not embedded in the other source.     

Forecasting the 10‐year US Treasury rate

This study compares the performance of two forecasting models of the 10‐year Treasury rate: a random walk (RW) model and an augmented‐autoregressive (A‐A) model which utilizes the information in the expected inflation rate. For 1993–2008, the RW and A‐A forecasts (with different lead times and forecast horizons) are generally unbiased and accurately predict directional change under symmetric loss. However, the A‐A forecasts outperform the RW, suggesting that the expected inflation rate (as a leading indicator) helps improve forecast accuracy. This finding is important since bond market efficiency implies that the RW forecasts are optimal and cannot be improved. Copyright © 2009 John Wiley & Sons, Ltd.     

Correcting the January optimism effect

Each month, various professional forecasters give forecasts for next year's real gross domestic product (GDP) growth and unemployment. January is a special month, when the forecast horizon moves to the following calendar year. Instead of deleting the January data when analyzing forecast updates, I propose a periodic version of a test regression for weak-form efficiency. An application of this periodic model for many forecasts across a range of countries shows that in January GDP forecast updates are positive, whereas the forecast updates for unemployment are negative. I document that this January optimism about the new calendar year is detrimental to forecast accuracy. To empirically analyze Okun's law, I also propose a periodic test regression, and its application provides more support for this law.     

Efficient Multistep Forecast Procedures for Multivariate Time Series

Upon the evidence that infinite‐order vector autoregression setting is more realistic in time series models, we propose new model selection procedures for producing efficient multistep forecasts. They consist of order selection criteria involving the sample analog of the asymptotic approximation of the h‐step‐ahead forecast mean squared error matrix, where h is the forecast horizon. These criteria are minimized over a truncation order n_T under the assumption that an infinite‐order vector autoregression can be approximated, under suitable conditions, with a sequence of truncated models, where n_T is increasing with sample size. Using finite‐order vector autoregressive models with various persistent levels and realistic sample sizes, Monte Carlo simulations show that, overall, our criteria outperform conventional competitors. Specifically, they tend to yield better small‐sample distribution of the lag‐order estimates around the true value, while estimating it with relatively satisfactory probabilities. They also produce more efficient multistep (and even stepwise) forecasts since they yield the lowest h‐step‐ahead forecast mean squared errors for the individual components of the holding pseudo‐data to forecast. Thus estimating the actual autoregressive order as well as the best forecasting model can be achieved with the same selection procedure. Such results stand in sharp contrast to the belief that parsimony is a virtue in itself, and state that the relative accuracy of strongly consistent criteria such as the Schwarz information criterion, as claimed in the literature, is overstated. Our criteria are new tools extending those previously existing in the literature and hence can suitably be used for various practical situations when necessary. Copyright © 2015 John Wiley & Sons, Ltd.     

An empirical investigation of combinations of economic forecasts

This paper examines the effects of combining three econometric and three times-series forecasts of growth and inflation in the U.K. If forecasts are unbiased then a combination exploiting this fact will be more efficient than an unrestricted combination. Ex post econometric forecasts may be biased but ex ante they are unbiased. The results of the study are that a restricted linear combination of the econometric forecasts is superior to an unrestricted combination and also to the unweighted mean of the forecasts. However, it is not preferred to the best of the individual forecasts.