Are forecasters reluctant to revise their predictions? Some German evidence

People are reluctant to admit mistakes. This could also be true of economic forecasters. If revisions of past forecasts are costly, then it will become optimal for forecasters to only partially adjust a past forecast in the light of new information. The unwillingness to admit to the mistake in the old forecast generates a bias of the new forecast in the direction of the old forecast. We test this hypothesis for the joint predictions of the Association of German Economic Research Institutes over the last 35 years. We find some evidence for such a bias and compute the implied unwillingness to revise forecasts. Copyright © 2006 John Wiley & Sons, Ltd.     

Small sample properties of quarterly forecast errors

There are two basic approaches used in the comparative evaluation of forecasters: (1) Statistical tests of significance of differences in error measures, (2) Ordinal rankings of forecasters. To use the first approach of statistical tests, the forecast error data must satisfy the assumptions underlying those tests. This paper examines the validity of those assumptions by enquiring into the small sample properties of the forecast error data of quarterly forecasts of the U.S. economy.     

Adjusting for information content when comparing forecast performance

Cross‐institutional forecast evaluations may be severely distorted by the fact that forecasts are made at different points in time and therefore with different amounts of information. This paper proposes a method to account for these differences when analyzing an unbalanced panel of forecasts. The method computes the timing effect and the forecaster's ability simultaneously. Monte Carlo simulation demonstrates that evaluations that do not adjust for the differences in information content may be misleading. In addition, the method is applied to a real‐world dataset of 10 Swedish forecasters for the period 1999–2015. The results show that the ranking of the forecasters is affected by the proposed adjustment.     

Professional economic forecasts: Are they worth their costs?

Most economic forecast evaluations dating back 20 years show that professional forecasters add little to the forecasts generated by the simplest of models. Using various types of forecast error criteria, these evaluations usually conclude that the professional forecasts are little better than the no-change or ARIM A type forecast. It is our contention that this conclusion is mistaken because the conventional error criteria may not capture why forecasts are ma& or how they are used. Using forecast directional accuracy, the criterion which has been found to be highly correlated with profits in an interest rate setting, we find that professional GNP forecasts dominate the cheaper alternatives. Moreover, there appears to be no systematic relationship between this preferred criterion and the error measures used in previous studies.     

How well do analysts forecast interest rates?

This paper examines interest rate forecasts made for the period 1982–90 and examines three issues: (1) Is there a general agreement among analysts about the level of interest rates six months in the future? (2) Are all the forecasters equally good? (3) Are the forecasts valuable to prospective users? We use distributions of the cross-sections of forecasts, Friedman's statistic for analysis of variance by rank, and tests of independence between forecasts and outcomes to examine these questions. We conclude that there usually was a consensus among analysts, that there was no significant difference in the ability to forecast short-term rates but there was a difference with respect to the long-term predictions, and that these forecasts were not significantly better than random walk forecasts.     

Correcting the January optimism effect

Each month, various professional forecasters give forecasts for next year's real gross domestic product (GDP) growth and unemployment. January is a special month, when the forecast horizon moves to the following calendar year. Instead of deleting the January data when analyzing forecast updates, I propose a periodic version of a test regression for weak-form efficiency. An application of this periodic model for many forecasts across a range of countries shows that in January GDP forecast updates are positive, whereas the forecast updates for unemployment are negative. I document that this January optimism about the new calendar year is detrimental to forecast accuracy. To empirically analyze Okun's law, I also propose a periodic test regression, and its application provides more support for this law.     

Social networks and private spaces in economic forecasting

The outputs of economic forecasting—predictions for national economic indicators such as GDP, unemployment rates and inflation—are all highly visible. The production of these forecasts is a much more private affair, however, typically being thought of as the work of individual forecasters or forecast teams using their economic model to produce a forecast that is then made public. This conception over-emphasises the individual and the technical whilst silencing the broader social context through which economic forecasters develop the expertise that is essential for the credibility of their predictions. In particular, economic forecasts are given meaning and fine-tuned through the social and institutional networks that give forecasters access to the expertise of a heterogeneous mix of academics, policy-makers and business people. Within these broader groups, individual forecasters often create private forecast ‘clubs’, where subscribers have privileged access to the expertise of the economist, but where the forecasters also have privileged access to their clients’ own expert knowledge. In examining these aspects of the forecasters’ work I show that the visible and audible activities of modelling and forecasting are made possible and plausible by virtue of the modeller’s invisible interaction with a wider network.     

Predicting the signs of forecast errors

The signs of forecast errors can be predicted using the difference between individuals' forecasts and the average of earlier forecasts of the same variable. It is possible to improve forecasts without worsening any. It is difficult to reconcile this result with the rational expectations hypothesis because the average of earlier forecasts is in the information set of the forecasters. Copyright © 2009 John Wiley & Sons, Ltd.     

Heterogeneous Forecast Adjustment

There is ample empirical evidence that expert‐adjusted model forecasts can be improved. One way to potential improvement concerns providing various forms of feedback to the sales forecasters. It is also often recognized that the experts (forecasters) might not constitute a homogeneous group. This paper provides a data‐based methodology to discern latent clusters of forecasters, and applies it to a fully new large database with data on expert‐adjusted forecasts, model forecasts and realizations. For the data at hand, two clusters can clearly be identified. Next, the consequences of having clusters are discussed. Copyright © 2016 John Wiley & Sons, Ltd.     

Estimation and Prediction Tests of Cash Flow Forecast Accuracy

Recently, analysts' cash flow forecasts have become widely available through financial information services. Cash flow information enables practitioners to better understand the real operating performance and financial stability of a company, particularly when earnings information is noisy and of low quality. However, research suggests that analysts' cash flow forecasts are less accurate and more dispersed than earnings forecasts. We thus investigate factors influencing cash flow forecast accuracy and build a practical model to distinguish more accurate from less accurate cash flow forecasters, using past cash flow forecast accuracy and analyst characteristics. We find significant power in our cash flow forecast accuracy prediction models. We also find that analysts develop cash flow‐specific forecasting expertise and knowhow, which are distinct from those that analysts acquire from forecasting earnings. In particular, cash flow‐specific information is more useful in identifying accurate cash flow forecasters than earnings‐specific information.Copyright © 2011 John Wiley & Sons, Ltd.     

Bayesian consensus forecasts of macroeconomic variables

Economists, like other forecasters, share knowledge, data and theories in common. Consequently, their forecast errors are likely to be highly dependent. This paper reports on an empirical study of 16 macroeconomic forecasters. Composite forecasts are computed using a sequential weighting scheme that takes dependence into account; these are compared to a simple average and median forecasts. A within-sample composite is also calculated. Both these methods perform significantly better than the average or median of the forecasts. This improvement in accuracy is apparently because the dependence between the forecasters' errors is so high that the optimal composite forecasts sometimes lie outside the range of the individual forecasts.     

Strategic bias and professional affiliations of macroeconomic forecasters

This paper investigates strategic motives of macroeconomic forecasters and the effect of their professional affiliations. The ‘wishful expectations hypothesis’ suggests that a forecaster predicts what his employer wishes. The ‘publicity hypothesis’ argues that forecasters are evaluated by both accuracy and ability to generate publicity, and that forecasters in industries that emphasize publicity most will make most extreme and least accurate predictions. The ‘signaling hypothesis’ asserts that an extreme forecast signals confidence in own ability, because incompetent forecasters would mimic others to avoid public notice. Empirical evidence from a 26‐year panel of annual GDP forecasts is con‐sistent with the publicity hypothesis. This indicates that conventional tests of rationality are biased toward rejecting the rational expectations hypothesis. Copyright ? 2008 John Wiley & Sons, Ltd.     

Nonlinear identification of judgmental forecasts effects at SKU level

Prediction of demand is a key component within supply chain management. Improved accuracy in forecasts directly affects all levels of the supply chain, reducing stock costs and increasing customer satisfaction. In many application areas, demand prediction relies on statistical software which provides an initial forecast subsequently modified by the expert's judgment. This paper outlines a new methodology based on state‐dependent parameter (SDP) estimation techniques to identify the nonlinear behaviour of such managerial adjustments. This non‐parametric SDP estimate is used as a guideline to propose a nonlinear model that corrects the bias introduced by the managerial adjustments. One‐step‐ahead forecasts of stock‐keeping unit sales sampled monthly from a manufacturing company are utilized to test the proposed methodology. The results indicate that adjustments introduce a nonlinear pattern, undermining accuracy. This understanding can be used to enhance the design of the forecasting support system in order to help forecasters towards more efficient judgmental adjustments. Copyright © 2010 John Wiley & Sons, Ltd.     

A high–low model of daily stock price ranges

We observe that daily highs and lows of stock prices do not diverge over time and, hence, adopt the cointegration concept and the related vector error correction model (VECM) to model the daily high, the daily low, and the associated daily range data. The in‐sample results attest to the importance of incorporating high–low interactions in modeling the range variable. In evaluating the out‐of‐sample forecast performance using both mean‐squared forecast error and direction of change criteria, it is found that the VECM‐based low and high forecasts offer some advantages over alternative forecasts. The VECM‐based range forecasts, on the other hand, do not always dominate—the forecast rankings depend on the choice of evaluation criterion and the variables being forecast. Copyright © 2008 John Wiley & Sons, Ltd.     

The Relation Between Overreaction in Forecasts and Uncertainty: A Nonlinear Approach

This paper examines overreaction of oil price forecasters. It takes into account impacts of uncertainty, measured by VSTOXX volatility; noisy signals, measured by oil price volatility; and oil price return on forecast changes. The panel smooth transition regression model is applied with different specifications of the transition function to account for nonlinear relations. Data on oil price expectations for different time horizons are taken from the European Central Bank Survey of Professional Forecasters. The results show that forecast changes are governed by overreaction. However, overreaction is markedly reduced when high levels of uncertainty prevail. On the other hand, noisy signals and positive oil price return tend to cause higher overreaction. Copyright © 2016 John Wiley & Sons, Ltd.     

Predicting Recessions with Leading Indicators: Model Averaging and Selection over the Business Cycle

Four methods of model selection—equally weighted forecasts, Bayesian model‐averaged forecasts, and two models produced by the machine‐learning algorithm boosting—are applied to the problem of predicting business cycle turning points with a set of common macroeconomic variables. The methods address a fundamental problem faced by forecasters: the most useful model is simple but makes use of all relevant indicators. The results indicate that successful models of recession condition on different economic indicators at different forecast horizons. Predictors that describe real economic activity provide the clearest signal of recession at very short horizons. In contrast, signals from housing and financial markets produce the best forecasts at longer forecast horizons. A real‐time forecast experiment explores the predictability of the 2001 and 2007 recessions. Copyright © 2015 John Wiley & Sons, Ltd.     

The use of encompassing tests for forecast combinations

This paper proposes an algorithm that uses forecast encompassing tests for combining forecasts when there are a large number of forecasts that might enter the combination. The algorithm excludes a forecast from the combination if it is encompassed by another forecast. To assess the usefulness of this approach, an extensive empirical analysis is undertaken using a US macroeconomic dataset. The results are encouraging; the algorithm forecasts outperform benchmark model forecasts, in a mean square error (MSE) sense, in a majority of cases. The paper also compares the empirical performance of different approaches to forecast combination, and provides a rule‐of‐thumb cut‐off point for the thick‐modeling approach. Copyright © 2009 John Wiley & Sons, Ltd.     

Forecast Combination for Euro Area Inflation: A Cure in Times of Crisis?

The period of extraordinary volatility in euro area headline inflation starting in 2007 raised the question whether forecast combination methods can be used to hedge against bad forecast performance of single models during such periods and provide more robust forecasts. We investigate this issue for forecasts from a range of short‐term forecasting models. Our analysis shows that there is considerable variation of the relative performance of the different models over time. To take that into account we suggest employing performance‐based forecast combination methods—in particular, one with more weight on the recent forecast performance. We compare such an approach with equal forecast combination that has been found to outperform more sophisticated forecast combination methods in the past, and investigate whether it can improve forecast accuracy over the single best model. The time‐varying weights assign weights to the economic interpretations of the forecast stemming from different models. We also include a number of benchmark models in our analysis. The combination methods are evaluated for HICP headline inflation and HICP excluding food and energy. We investigate how forecast accuracy of the combination methods differs between pre‐crisis times, the period after the global financial crisis and the full evaluation period, including the global financial crisis with its extraordinary volatility in inflation. Overall, we find that forecast combination helps hedge against bad forecast performance and that performance‐based weighting outperforms simple averaging. Copyright © 2017 John Wiley & Sons, Ltd.     

US Inflation Expectations and Heterogeneous Loss Functions, 1968–2010

Recent literature has suggested that macroeconomic forecasters may have asymmetric loss functions, and that there may be heterogeneity across forecasters in the degree to which they weigh under‐ and over‐predictions. Using an individual‐level analysis that exploits the Survey of Professional Forecasters respondents’ histogram forecasts, we find little evidence of asymmetric loss for the inflation forecasters. Copyright © 2013 John Wiley & Sons, Ltd.     

Combining exchange rate forecasts: What is the optimal consensus measure?

In this paper a high-quality disaggregate database is utilized to examine whether individual forecasters produce efficient exchange rate predictions and also if the properties of the forecasts change when they are combined. The paper links a number of themes in the exchange rate literature and examines various methods of forecast combination. It is demonstrated, inter alia, that some forecasters are better than others, but that most are not as good as a naive no-change prediction. Combining forecasts adds to the accuracy of the predictions, but the gains mainly reflect the removal of systematic and unstable bias.