Correcting the January optimism effect

Each month, various professional forecasters give forecasts for next year's real gross domestic product (GDP) growth and unemployment. January is a special month, when the forecast horizon moves to the following calendar year. Instead of deleting the January data when analyzing forecast updates, I propose a periodic version of a test regression for weak-form efficiency. An application of this periodic model for many forecasts across a range of countries shows that in January GDP forecast updates are positive, whereas the forecast updates for unemployment are negative. I document that this January optimism about the new calendar year is detrimental to forecast accuracy. To empirically analyze Okun's law, I also propose a periodic test regression, and its application provides more support for this law.     

The accuracy of IMF and OECD forecasts for G7 countries

This paper analyses the size and nature of the errors in GDP forecasts in the G7 countries from 1971 to 1995. These GDP short‐term forecasts are produced by the Organization for Economic Cooperation and Development and by the International Monetary Fund, and published twice a year in the Economic Outlook and in the World Economic Outlook, respectively. The evaluation of the accuracy of the forecasts is based on the properties of the difference between the realization and the forecast. A forecast is considered to be accurate if it is unbiased and efficient. A forecast is unbiased if its average deviation from the outcome is zero, and it is efficient if it reflects all the information that is available at the time the forecast is made. Finally, we also examine tests of directional accuracy and offer a non‐parametric method of assessment. Copyright © 2000 John Wiley & Sons, Ltd.     

A test of the joint efficiency of macroeconomic forecasts using multivariate random forests

We contribute to recent research on the joint evaluation of the properties of macroeconomic forecasts in a multivariate setting. The specific property of forecasts that we are interested in is their joint efficiency. We study the joint efficiency of forecasts by means of multivariate random forests, which we use to model the links between forecast errors and predictor variables in a forecaster's information set. We then use permutation tests to study whether the Mahalanobis distance between the predicted forecast errors for the growth and inflation forecasts of four leading German economic research institutes and actual forecast errors is significantly smaller than under the null hypothesis of forecast efficiency. We reject joint efficiency in several cases, but also document heterogeneity across research institutes with regard to the joint efficiency of their forecasts.     

Testing the rationality of forecast revisions made by the IMF and the OECD

We investigate the rationality of forecast revisions made by the IMF and the OECD over the past three decades. We find that 60% of real‐GDP forecast series and 37% of GDP‐deflator forecast series are consistent with rationality. Forecast smoothing is found in real‐GDP forecasts. Copyright © 2006 John Wiley & Sons, Ltd.     

Are 16‐month‐ahead forecasts useful? A directional analysis of Japanese GDP forecasts

Past literature casts doubt on the ability of long‐term macroeconomic forecasts to predict the direction of change. We re‐examine this issue using the Japanese GDP forecast data of 37 institutions, and find that their 16‐month‐ahead forecasts contain valuable information on whether the growth rate accelerates or not. Copyright © 2006 John Wiley _ Sons, Ltd.     

Flow of conjunctural information and forecast of euro area economic activity

Combining forecasts, we analyse the role of information flow in computing short‐term forecasts up to one quarter ahead for the euro area GDP and its main components. A dataset of 114 monthly indicators is set up and simple bridge equations are estimated. The individual forecasts are then pooled, using different weighting schemes. To take into consideration the release calendar of each indicator, six forecasts are compiled successively during the quarter. We found that the sequencing of information determines the weight allocated to each block of indicators, especially when the first month of hard data becomes available. This conclusion extends the findings of the recent literature. Moreover, when combining forecasts, two weighting schemes are found to outperform the equal weighting scheme in almost all cases. Compared to an AR forecast, these improve by more than 40% the forecast performance for GDP in the current and next quarter. Copyright © 2010 John Wiley & Sons, Ltd.     

Evaluating volatility and interval forecasts

A widely used approach to evaluating volatility forecasts uses a regression framework which measures the bias and variance of the forecast. We show that the associated test for bias is inappropriate before introducing a more suitable procedure which is based on the test for bias in a conditional mean forecast. Although volatility has been the most common measure of the variability in a financial time series, in many situations confidence interval forecasts are required. We consider the evaluation of interval forecasts and present a regression‐based procedure which uses quantile regression to assess quantile estimator bias and variance. We use exchange rate data to illustrate the proposal by evaluating seven quantile estimators, one of which is a new non‐parametric autoregressive conditional heteroscedasticity quantile estimator. The empirical analysis shows that the new evaluation procedure provides useful insight into the quality of quantile estimators. Copyright © 1999 John Wiley & Sons, Ltd.     

The Role of Financial Variables in predicting economic activity

Previous research found that the US business cycle leads the European one by a few quarters, and can therefore be useful in predicting euro area gross domestic product (GDP). In this paper we investigate whether additional predictive power can be gained by adding selected financial variables belonging to either the USA or the euro area. We use vector autoregressions (VARs) that include the US and euro area GDPs as well as growth in the Rest of the World and selected combinations of financial variables. Out‐of‐sample root mean square forecast errors (RMSEs) evidence that adding financial variables produces a slightly smaller error in forecasting US economic activity. This weak macro‐financial linkage is even weaker in the euro area, where financial indicators do not improve short‐ and medium‐term GDP forecasts even when their timely availability relative to GDP is exploited. It can be conjectured that neither US nor European financial variables help predict euro area GDP as the US GDP has already embodied this information. However, we show that the finding that financial variables have no predictive power for future activity in the euro area relates to the unconditional nature of the RMSE metric. When forecasting ability is assessed as if in real time (i.e. conditionally on the information available at the time when forecasts are made), we find that models using financial variables would have been preferred in several episodes and in particular between 1999 and 2002. Copyright 2011 John Wiley & Sons, Ltd.     

Shrinkage‐Based Tests of Predictability

In this paper we derive a test of predictability by exploring the possibility that forecasts from a given model, adjusted by a shrinkage factor, will display lower mean squared prediction errors than forecasts from a simple random walk. This generalizes most previous tests which compare forecast errors of a benchmark model with errors of a proposed alternative model, not allowing for shrinkage. We show that our test is a particular extension of a recently developed test of the martingale difference hypothesis. Using simulations we explore the behavior of our test in small and moderate samples. Numerical results indicate that the test has good size and power properties. Finally, we illustrate the use of our test in an empirical application within the exchange rate literature. Copyright © 2012 John Wiley & Sons, Ltd.     

Can consumer sentiment and its components forecast Australian GDP and consumption?

This paper examines whether the disaggregation of consumer sentiment data into its sub‐components improves the real‐time capacity to forecast GDP and consumption. A Bayesian error correction approach augmented with the consumer sentiment index and permutations of the consumer sentiment sub‐indices is used to evaluate forecasting power. The forecasts are benchmarked against both composite forecasts and forecasts from standard error correction models. Using Australian data, we find that consumer sentiment data increase the accuracy of GDP and consumption forecasts, with certain components of consumer sentiment consistently providing better forecasts than aggregate consumer sentiment data. Copyright © 2009 John Wiley & Sons, Ltd.     

The usefulness of heuristic N(E)RLS algorithms for combining forecasts

There exists theoretical and empirical evidence on the efficiency and robustness of Non-negativity Restricted Least Squares combinations of forecasts. However, the computational complexity of the method hinders its widespread use in practice. We examine various optimizing and heuristic computational algorithms for estimating NRLS combination models and provide certain CPU-time reducing implementations. We empirically compare the combination weights identified by the alternative algorithms and their computational demands based on a total of more than 66,000 models estimated to combine the forecasts of 37 firm-specific accounting earnings series. The ex ante prediction accuracies of combined forecasts from the optimizing versus heuristic algorithms are compared. The effects of fit sample size, model specification, multicollinearity, correlations of forecast errors, and series and forecast variances on the relative accuracy of the optimizing versus heuristic algorithms are analysed. The results reveal that, in general, the computationally simple heuristic algorithms perform as well as the optimizing algorithms. No generalizable conclusions could be reached, however, about which algorithm should be used based on series and forecast characteristics. © 1997 John Wiley & Sons, Ltd.     

The maximum and minimum of primary forecasts

The purpose of this paper is to suggest that the maximum (or minimum) of a number of primary forecasts may make a valuable addition to the forecasting accuracy of a combination of forecasts. Such forecasts are readily computable. Theoretical results are presented for two unbiased forecasts with correlated normally distributed errors, showing that the maximum (minimum) of two forecasts can have a smaller error variance than either of the primary forecasts and the forecast error can have low correlation with the primary errors. Empirical results are obtained for two different sets of forecasts available in the literature, and it is observed that a combination forecast including the maximum and/or minimum has attractive forecasting properties.     

Revisions in analysts' earnings forecasts: evidence of non‐linear adaptive expectations

Prior studies use a linear adaptive expectations model to describe how analysts revise their forecasts of future earnings in response to current forecast errors. However, research shows that extreme forecast errors are less likely than small forecast errors to persist in future years. If analysts recognize this property, their marginal forecast revisions should decrease with the forecast error's magnitude. Therefore, a linear model is likely to be unsatisfactory at describing analysts' forecast revisions. We find that a non‐linear model better describes the relation between analysts' forecast revisions and their forecast errors, and provides a richer theoretical framework for explaining analysts' forecasting behaviour. Our results are consistent with analysts' recognizing the permanent and temporary nature of forecast errors of differing magnitudes. Copyright © 2000 John Wiley & Sons, Ltd.     

Are forecasters reluctant to revise their predictions? Some German evidence

People are reluctant to admit mistakes. This could also be true of economic forecasters. If revisions of past forecasts are costly, then it will become optimal for forecasters to only partially adjust a past forecast in the light of new information. The unwillingness to admit to the mistake in the old forecast generates a bias of the new forecast in the direction of the old forecast. We test this hypothesis for the joint predictions of the Association of German Economic Research Institutes over the last 35 years. We find some evidence for such a bias and compute the implied unwillingness to revise forecasts. Copyright © 2006 John Wiley & Sons, Ltd.     

Evaluating the Rationality of Fixed-event Forecasts

A test of forecast rationality based on the weak efficiency of fixed-event forecasts was proposed by Nordhaus (1987). This paper considers the scope for pooling fixed-event forecasts across ‘events’, to deliver more powerful tests of the weak-efficiency hypothesis, when only a small number of fixed-event forecasts are available. In an empirical illustration we demonstrate the usefulness of this approach. We also suggest an interpretation of the rejection of the null hypothesis of weak efficiency in favour of negative autocorrelation in series of revisions to fixed-event forecasts. The relationship between weak efficiency and rationality when loss functions are asymmetric and prediction error variances are time-varying is also considered.© 1997 John Wiley & Sons, Ltd.     

Predicting the signs of forecast errors

The signs of forecast errors can be predicted using the difference between individuals' forecasts and the average of earlier forecasts of the same variable. It is possible to improve forecasts without worsening any. It is difficult to reconcile this result with the rational expectations hypothesis because the average of earlier forecasts is in the information set of the forecasters. Copyright © 2009 John Wiley & Sons, Ltd.     

Forecast Combination for Euro Area Inflation: A Cure in Times of Crisis?

The period of extraordinary volatility in euro area headline inflation starting in 2007 raised the question whether forecast combination methods can be used to hedge against bad forecast performance of single models during such periods and provide more robust forecasts. We investigate this issue for forecasts from a range of short‐term forecasting models. Our analysis shows that there is considerable variation of the relative performance of the different models over time. To take that into account we suggest employing performance‐based forecast combination methods—in particular, one with more weight on the recent forecast performance. We compare such an approach with equal forecast combination that has been found to outperform more sophisticated forecast combination methods in the past, and investigate whether it can improve forecast accuracy over the single best model. The time‐varying weights assign weights to the economic interpretations of the forecast stemming from different models. We also include a number of benchmark models in our analysis. The combination methods are evaluated for HICP headline inflation and HICP excluding food and energy. We investigate how forecast accuracy of the combination methods differs between pre‐crisis times, the period after the global financial crisis and the full evaluation period, including the global financial crisis with its extraordinary volatility in inflation. Overall, we find that forecast combination helps hedge against bad forecast performance and that performance‐based weighting outperforms simple averaging. Copyright © 2017 John Wiley & Sons, Ltd.     

Forecasting the duration of short‐term deflation episodes

The paper proposes a simulation‐based approach to multistep probabilistic forecasting, applied for predicting the probability and duration of negative inflation. The essence of this approach is in counting runs simulated from a multivariate distribution representing the probabilistic forecasts, which enters the negative inflation regime. The marginal distributions of forecasts are estimated using the series of past forecast errors, and the joint distribution is obtained by a multivariate copula approach. This technique is applied for estimating the probability of negative inflation in China and its expected duration, with the marginal distributions computed by fitting weighted skew‐normal and two‐piece normal distributions to autoregressive moving average ex post forecast errors and using the multivariate Student t copula.     

Predicting Recessions with Factor Linear Dynamic Harmonic Regressions

We propose a new framework for building composite leading indicators for the Spanish economy using monthly targeted predictors and small‐scale dynamic factor models. Our leading indicator index, based on the low‐frequency components of four monthly economic variables, is able to predict the onset of the Spanish recessions as well as the gross domestic product (GDP) growth cycles and classical industrial production cycles, both historically and in real time. Also, our leading indicator provides substantial aid in forecasting annual and quarterly GDP growth rates. Using only real data available at the beginning of each forecast period, our indicator one‐step‐ahead forecasts shows substantial improvements over other alternatives. Copyright © 2013 John Wiley & Sons, Ltd.     

Mincer–Zarnowitz quantile and expectile regressions for forecast evaluations under aysmmetric loss functions

Forecasts are pervasive in all areas of applications in business and daily life. Hence evaluating the accuracy of a forecast is important for both the generators and consumers of forecasts. There are two aspects in forecast evaluation: (a) measuring the accuracy of past forecasts using some summary statistics, and (b) testing the optimality properties of the forecasts through some diagnostic tests. On measuring the accuracy of a past forecast, this paper illustrates that the summary statistics used should match the loss function that was used to generate the forecast. If there is strong evidence that an asymmetric loss function has been used in the generation of a forecast, then a summary statistic that corresponds to that asymmetric loss function should be used in assessing the accuracy of the forecast instead of the popular root mean square error or mean absolute error. On testing the optimality of the forecasts, it is demonstrated how the quantile regressions set in the prediction–realization framework of Mincer and Zarnowitz (in J. Mincer (Ed.), Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance (pp. 14–20), 1969) can be used to recover the unknown parameter that controls the potentially asymmetric loss function used in generating the past forecasts. Finally, the prediction–realization framework is applied to the Federal Reserve's economic growth forecast and forecast sharing in a PC manufacturing supply chain. It is found that the Federal Reserve values overprediction approximately 1.5 times more costly than underprediction. It is also found that the PC manufacturer weighs positive forecast errors (under forecasts) about four times as costly as negative forecast errors (over forecasts).