Judgemental revision of sales forecasts: The relative performance of judgementally revised versus non-revised forecasts

The judgemental revision of sales forecasts is an issue which is receiving increasing attention in the forecasting literature. This paper compares the performance of forecasts after revision by managers with that of the forecasts which were accepted by them without revision. The data set consists of sales forecasting data from an industrial company, spanning six quarterly periods and relating to some 900 individual products. The findings show that, in general, the improvements made by managers bring the forecast errors of revised forecasts more into line with non-revised forecasts, but the change is often marginal, and the best result is equivalence between revised and non-revised forecasts.     

The Effects of Disaggregation on Forecasting Nonstationary Time Series

This paper focuses on the effects of disaggregation on forecast accuracy for nonstationary time series using dynamic factor models. We compare the forecasts obtained directly from the aggregated series based on its univariate model with the aggregation of the forecasts obtained for each component of the aggregate. Within this framework (first obtain the forecasts for the component series and then aggregate the forecasts), we try two different approaches: (i) generate forecasts from the multivariate dynamic factor model and (ii) generate the forecasts from univariate models for each component of the aggregate. In this regard, we provide analytical conditions for the equality of forecasts. The results are applied to quarterly gross domestic product (GDP) data of several European countries of the euro area and to their aggregated GDP. This will be compared to the prediction obtained directly from modeling and forecasting the aggregate GDP of these European countries. In particular, we would like to check whether long‐run relationships between the levels of the components are useful for improving the forecasting accuracy of the aggregate growth rate. We will make forecasts at the country level and then pool them to obtain the forecast of the aggregate. The empirical analysis suggests that forecasts built by aggregating the country‐specific models are more accurate than forecasts constructed using the aggregated data. Copyright © 2014 John Wiley & Sons, Ltd.     

Bayesian consensus forecasts of macroeconomic variables

Economists, like other forecasters, share knowledge, data and theories in common. Consequently, their forecast errors are likely to be highly dependent. This paper reports on an empirical study of 16 macroeconomic forecasters. Composite forecasts are computed using a sequential weighting scheme that takes dependence into account; these are compared to a simple average and median forecasts. A within-sample composite is also calculated. Both these methods perform significantly better than the average or median of the forecasts. This improvement in accuracy is apparently because the dependence between the forecasters' errors is so high that the optimal composite forecasts sometimes lie outside the range of the individual forecasts.     

Professional forecasters' expectations,consistency, and international spillovers

This paper focuses on the expectation formation process of professional forecasters by relying on survey data on forecasts regarding gross domestic product growth, consumer price index inflation and 3-month interest rates for a broad set of countries. We examine the interrelation between macroeconomic forecasts and also the impact of uncertainty on forecasts by allowing for cross-country interdependencies and time variation in the coefficients. We find that professional forecasts are often in line with the Taylor rule and identify significant expectation spillovers from monetary policy in the USA.     

Combining ordinal forecasts with an application in a financial market

The literature on combining forecasts has almost exclusively focused on combining point forecasts. The issues and methods of combining ordinal forecasts have not yet been fully explored, even though ordinal forecasting has many practical applications in business and social research. In this paper, we consider the case of forecasting the movement of the stock market which has three possible states (bullish, bearish and sluggish). Given the sample of states predicted by different forecasters, several statistical and operation research methods can be applied to determine the optimal weight assigned to each forecaster in combining the ordinal forecasts. The performance of these methods is examined using Hong Kong stock market forecasting data, and their accuracies are found to be better than the consensus method and individual forecasts.     

Daily FX Volatility Forecasts: Can the GARCH(1,1) Model be Beaten using High‐Frequency Data?

Volatility forecasting remains an active area of research with no current consensus as to the model that provides the most accurate forecasts, though Hansen and Lunde (2005) have argued that in the context of daily exchange rate returns nothing can beat a GARCH(1,1) model. This paper extends that line of research by utilizing intra‐day data and obtaining daily volatility forecasts from a range of models based upon the higher‐frequency data. The volatility forecasts are appraised using four different measures of ‘true’ volatility and further evaluated using regression tests of predictive power, forecast encompassing and forecast combination. Our results show that the daily GARCH(1,1) model is largely inferior to all other models, whereas the intra‐day unadjusted‐data GARCH(1,1) model generally provides superior forecasts compared to all other models. Hence, while it appears that a daily GARCH(1,1) model can be beaten in obtaining accurate daily volatility forecasts, an intra‐day GARCH(1,1) model cannot be. Copyright © 2011 John Wiley & Sons, Ltd.     

Using the yield curve to forecast economic growth

This paper finds the yield curve to have a well-performing ability to forecast the real gross domestic product growth in the USA, compared to professional forecasters and time series models. Past studies have different arguments concerning growth lags, structural breaks, and ultimately the ability of the yield curve to forecast economic growth. This paper finds such results to be dependent on the estimation and forecasting techniques employed. By allowing various interest rates to act as explanatory variables and various window sizes for the out-of-sample forecasts, significant forecasts from many window sizes can be found. These seemingly good forecasts may face issues, including persistent forecasting errors. However, by using statistical learning algorithms, such issues can be cured to some extent. The overall result suggests, by scientifically deciding the window sizes, interest rate data, and learning algorithms, many outperforming forecasts can be produced for all lags from one quarter to 3 years, although some may be worse than the others due to the irreducible noise of the data.     

N-step combinations of forecasts

While there is general agreement that a linear combination of forecasts can outperform the individual forecasts, there is controversy about the appropriateness of the combination method to be used in a given situation. Hence, in any given application it may be more beneficial to combine different sets of combined forecasts rather than picking one of them. This paper introduces the concept of N-step combinations of forecasts which involves combining the combined forecasts obtained from different combination procedures used at the preceding step. Using quarterly GNP data, evidence supporting the increase in the accuracy of the one-period-ahead ex-ante forecasts as the combination step increases is provided. The MSE, MAE, MAPE and their corresponding standard deviations are used to evaluate the accuracy of the forecasts obtained.     

Forecasting the Italian industrial production index in real time

Daily electricity consumption data, available almost in real time, can be used in Italy to estimate the level of industrial production in any given month before the month is over. We present a number of procedures that do this using electricity consumption in the first 14 days of the month. (This is an extension of a previous model that used monthly electricity data.) We show that, with a number of adjustments, a model using half-monthly electricity data generates acceptable estimates of the monthly production index. More precisely, these estimates are more accurate than univariate forecasts but less accurate than estimates based on monthly electricity data. A further improvement can be obtained by combining ‘half-monthly’ electricity-based estimates with univariate forecasts. We also present quarterly estimates and discuss confidence intervals for various types of forecasts.     

Robust evaluation of fixed‐event forecast rationality

In this paper we introduce a new testing procedure for evaluating the rationality of fixed‐event forecasts based on a pseudo‐maximum likelihood estimator. The procedure is designed to be robust to departures in the normality assumption. A model is introduced to show that such departures are likely when forecasters experience a credibility loss when they make large changes to their forecasts. The test is illustrated using monthly fixed‐event forecasts produced by four UK institutions. Use of the robust test leads to the conclusion that certain forecasts are rational while use of the Gaussian‐based test implies that certain forecasts are irrational. The difference in the results is due to the nature of the underlying data. Copyright © 2001 John Wiley & Sons, Ltd.     

Relative accuracy of judgemental and extrapolative methods in forecasting annual earnings

This paper identifies and analyses previously published studies on annual earnings forecasts. Comparisons of forecasts produced by management, analysts, and extrapolative techniques indicated that: (1) management forecasts were superior to professional analyst forecasts (the mean absolute percentage errors were 15.9 and 17.7, respectively, based on five studies using data from 1967–1974) and (2) judgemental forecasts (both management and analysts) were superior to extrapolation forecasts on 14 of 17 comparisons from 13 studies using data from 1964–1979 (the mean absolute percentage errors were 21.0 and 28.4 for judgement and extrapolation, respectively). These conclusions, based on recent research, differ from those reported in previous reviews, which commented on less than half of the studies identified here.     

Direct multiperiod forecasting for algorithmic trading

This paper examines the performance of iterated and direct forecasts for the number of shares traded in high‐frequency intraday data. Constructing direct forecasts in the context of formulating volume weighted average price trading strategies requires the generation of a sequence of multistep‐ahead forecasts. I discuss nonlinear transformations to ensure nonnegative forecasts and lag length selection for generating a sequence of direct forecasts. In contrast to the literature based on low‐frequency macroeconomic data, I find that direct multiperiod forecasts can outperform iterated forecasts when the conditioning information set is dynamically updated in real time.     

Forecasts of inflation from var models

Why are forecasts of inflation from VAR models so much worse than their forecasts of real variables? This paper documents that relatively poor performance, and finds that the price equation of a VAR model fitted to US post-war data is poorly specified. Statistical work by other authors has found that coefficients in such price equations may not be constant. Based on specific monetary actions, two changes in monetary policy regimes are proposed. Accounting for those two shifts yields significantly more accurate forecasts and lessens the evidence of misspecification.     

Forecasting for business planning: A case study of IBM product sales

This is a case study of a closely managed product. Its purpose is to determine whether time-series methods can be appropriate for business planning. By appropriate, we mean two things: whether these methods can model and estimate the special events or features that are often present in sales data; and whether they can forecast accurately enough one, two and four quarters ahead to be useful for business planning. We use two time-series methods, Box-Jenkins modeling and Holt-Winters adaptive forecasting, to obtain forecasts of shipments of a closely managed product. We show how Box-Jenkins transfer-function models can account for the special events in the data. We develop criteria for choosing a final model which differ from the usual methods and are specifically directed towards maximizing the accuracy of next-quarter, next-half-year and next-full-year forecasts. We find that the best Box-Jenkins models give forecasts which are clearly better than those obtained from Holt-Winters forecast functions, and are also better than the judgmental forecasts of IBM's own planners. In conclusion, we judge that Box-Jenkins models can be appropriate for business planning, in particular for determining at the end of the year baseline business-as-usual annual and monthly forecasts for the next year, and in mid-year for resetting the remaining monthly forecasts.     

A comparative evaluation of objective and subjective weather forecasts in the united states

This paper is concerned primarily with the evaluation and comparison of objective and subjective weather forecasts. Operational forecasts of three weather elements are considered: (1) probability forecasts of precipitation occurrence, (2) categorical (i.e. non-probabilistic) forecasts of maximum and minimum temperatures and (3) categorical forecasts of cloud amount. The objective forecasts are prepared by numerical-statistical procedures, whereas the subjective forecasts are based on the judgements of individual forecasters. In formulating the latter, the forecasters consult information from a variety of sources, including the objective forecasts themselves. The precipitation probability forecasts are found to be both reliable and skilful, and evaluation of the temperature/cloud amount forecasts reveals that they are quite accurate/skilful. Comparison of the objective and subjective forecasts of precipitation occurrence indicates that the latter are generally more skilful than the former for shorter lead times (e.g. 12–24 hours), whereas the two types of forecasts are of approximately equal skill for longer lead times (e.g. 36–48 hours). Similar results are obtained for the maximum and minimum temperature forecasts. Objective cloud amount forecasts are more skilful than subjective cloud amount forecasts for all lead times. Examination of trends in performance over the last decade reveals that both types of forecasts for all three elements increased in skill (or accuracy) over the period, with improvements in objective forecasts equalling or exceeding improvements in subjective forecasts. The role and impact of the objective forecasts in the subjective weather forecasting process are discussed in some detail. The need to conduct controlled experiments and other studies of this process, with particular reference to the assimilation of information from different sources, is emphasized. Important characteristics of the forecasting system in meteorology are identified, and they are used to describe similarities and differences between weather forecasting and forecasting in other fields. Acquisition of some of these characteristics may be beneficial to other forecasting systems.     

Heterogeneous Forecast Adjustment

There is ample empirical evidence that expert‐adjusted model forecasts can be improved. One way to potential improvement concerns providing various forms of feedback to the sales forecasters. It is also often recognized that the experts (forecasters) might not constitute a homogeneous group. This paper provides a data‐based methodology to discern latent clusters of forecasters, and applies it to a fully new large database with data on expert‐adjusted forecasts, model forecasts and realizations. For the data at hand, two clusters can clearly be identified. Next, the consequences of having clusters are discussed. Copyright © 2016 John Wiley & Sons, Ltd.     

Predicting the signs of forecast errors

The signs of forecast errors can be predicted using the difference between individuals' forecasts and the average of earlier forecasts of the same variable. It is possible to improve forecasts without worsening any. It is difficult to reconcile this result with the rational expectations hypothesis because the average of earlier forecasts is in the information set of the forecasters. Copyright © 2009 John Wiley & Sons, Ltd.     

The predictive value of temporally disaggregated volatility: evidence from index futures markets

This paper examines the benefits to forecasters of decomposing close-to-close return volatility into close-to-open (nighttime) and open-to-close (daytime) return volatility. Specifically, we consider whether close-to-close volatility forecasts based on the former type of (temporally aggregated) data are less accurate than corresponding forecasts based on the latter (temporally disaggregated) data. Results obtained from seven different US index futures markets reveal that significant increases in forecast accuracy are possible when using temporally disaggregated volatility data. This result is primarily driven by the fact that forecasts based on such data can be updated as more information becomes available (e.g., information flow from the preceding close-to-open/nighttime trading session). Finally, we demonstrate that the main findings of this paper are robust to the index futures market considered, the way in which return volatility is constructed, and the method used to assess forecast accuracy. Copyright © 2008 John Wiley & Sons, Ltd.     

Preliminary data and econometric forecasting: an application with the Bank of Italy Quarterly Model

This paper discusses the use of preliminary data in econometric forecasting. The standard practice is to ignore the distinction between preliminary and final data, the forecasts that do so here being termed naïve forecasts. It is shown that in dynamic models a multistep‐ahead naïve forecast can achieve a lower mean square error than a single‐step‐ahead one, as it is less affected by the measurement noise embedded in the preliminary observations. The minimum mean square error forecasts are obtained by optimally combining the information provided by the model and the new information contained in the preliminary data, which can be done within the state space framework as suggested in numerous papers. Here two simple, in general suboptimal, methods of combining the two sources of information are considered: modifying the forecast initial conditions by means of standard regressions and using intercept corrections. The issues are explored using Italian national accounts data and the Bank of Italy Quarterly Econometric Model. Copyright © 2006 John Wiley & Sons, Ltd.     

Can consumer sentiment and its components forecast Australian GDP and consumption?

This paper examines whether the disaggregation of consumer sentiment data into its sub‐components improves the real‐time capacity to forecast GDP and consumption. A Bayesian error correction approach augmented with the consumer sentiment index and permutations of the consumer sentiment sub‐indices is used to evaluate forecasting power. The forecasts are benchmarked against both composite forecasts and forecasts from standard error correction models. Using Australian data, we find that consumer sentiment data increase the accuracy of GDP and consumption forecasts, with certain components of consumer sentiment consistently providing better forecasts than aggregate consumer sentiment data. Copyright © 2009 John Wiley & Sons, Ltd.