Causality and forecasting in incomplete systems

In this paper we examine how causality inference and forecasting within a bivariate VAR, consisting of y(t) and x(t), are affected by the omission of a third variable, w(t), which causes (a) none, (b) one, and (c) both variables in the bivariate system. We also derive conditions under which causality inference and forecasting are invariant to the selection of a bivariate or a trivariate model. The most general condition for the invariance of both causality and forecasting to model selection is shown to require the omitted variable not to cause any of the variables in the bivariate system, although it allows the omitted variable to be caused by the other two. We also show that the conditions for one-way causality inference to be invariant to model selection are not sufficient to ensure that forecasting will also be invariant to the model selected. Finally, we present a numerical illustration of the potential losses, in terms of the variance of the forecast, as a function of the forecast horizon and for alternative parameter values—they can be rather large, as the omission of a variable can make the incomplete model unstable. © 1997 John Wiley & Sons, Ltd.     

Semiparametric forecast intervals

Consider forecasting the economic variable Y_t+h with predictors X _t, where h is the forecast horizon. This paper introduces a semiparametric method that generates forecast intervals of Y_t+h| X _t from point forecast models. First, the point forecast model is estimated, thereby taking advantage of its predictive power. Then, nonparametric estimation of the conditional distribution function (CDF) of the forecast error conditional on X _t builds the rest of the forecast distribution around the point forecast, from which symmetric and minimum‐length forecast intervals for Y_t+h| X _t can be constructed. Under mild regularity conditions, asymptotic analysis shows that (1) regardless of the quality of the point forecast model (i.e., it may be misspecified), forecast quantiles are consistent and asymptotically normal; (2) minimum length forecast intervals are consistent. Proposals for bandwidth selection and dimension reduction are made. Three sets of simulations show that for reasonable point forecast models the method has significant advantages over two existing approaches to interval forecasting: one that requires the point forecast model to be correctly specified, and one that is based on fully nonparametric CDF estimate of Y_t+h| X _t. An application to exchange rate forecasting is presented. Copyright © 2010 John Wiley & Sons, Ltd.     

Revisions in analysts' earnings forecasts: evidence of non‐linear adaptive expectations

Prior studies use a linear adaptive expectations model to describe how analysts revise their forecasts of future earnings in response to current forecast errors. However, research shows that extreme forecast errors are less likely than small forecast errors to persist in future years. If analysts recognize this property, their marginal forecast revisions should decrease with the forecast error's magnitude. Therefore, a linear model is likely to be unsatisfactory at describing analysts' forecast revisions. We find that a non‐linear model better describes the relation between analysts' forecast revisions and their forecast errors, and provides a richer theoretical framework for explaining analysts' forecasting behaviour. Our results are consistent with analysts' recognizing the permanent and temporary nature of forecast errors of differing magnitudes. Copyright © 2000 John Wiley & Sons, Ltd.     

The accuracy of IMF and OECD forecasts for G7 countries

This paper analyses the size and nature of the errors in GDP forecasts in the G7 countries from 1971 to 1995. These GDP short‐term forecasts are produced by the Organization for Economic Cooperation and Development and by the International Monetary Fund, and published twice a year in the Economic Outlook and in the World Economic Outlook, respectively. The evaluation of the accuracy of the forecasts is based on the properties of the difference between the realization and the forecast. A forecast is considered to be accurate if it is unbiased and efficient. A forecast is unbiased if its average deviation from the outcome is zero, and it is efficient if it reflects all the information that is available at the time the forecast is made. Finally, we also examine tests of directional accuracy and offer a non‐parametric method of assessment. Copyright © 2000 John Wiley & Sons, Ltd.     

Professional economic forecasts: Are they worth their costs?

Most economic forecast evaluations dating back 20 years show that professional forecasters add little to the forecasts generated by the simplest of models. Using various types of forecast error criteria, these evaluations usually conclude that the professional forecasts are little better than the no-change or ARIM A type forecast. It is our contention that this conclusion is mistaken because the conventional error criteria may not capture why forecasts are ma& or how they are used. Using forecast directional accuracy, the criterion which has been found to be highly correlated with profits in an interest rate setting, we find that professional GNP forecasts dominate the cheaper alternatives. Moreover, there appears to be no systematic relationship between this preferred criterion and the error measures used in previous studies.     

Sensitivity of univariate AR(1) time‐series forecasts near the unit root

We consider the linear time‐series model y_t=d_t+u_t(t=1,...,n), where d_t is the deterministic trend and u_t the stochastic term which follows an AR(1) process; u_t=θu_t−1+ϵ_t, with normal innovations ϵ_t. Various assumptions about the start‐up will be made. Our main interest lies in the behaviour of the l‐period‐ahead forecast y_n+1 near θ=1. Unlike in other studies of the AR(1) unit root process, we do not wish to ask the question whether θ=1 but are concerned with the behaviour of the forecast estimate near and at θ=1. For this purpose we define the sth (s=1,2) order sensitivity measure λ_l^(s) of the forecast y_n+1 near θ=1. This measures the sensitivity of the forecast at the unit root. In this study we consider two deterministic trends: d_t=β_t and d_t=β_t+β_tt. The forecast will be the Best Linear Unbiased forecast. We show that, when d_t=β_t, the number of observations has no effect on forecast sensitivity. When the deterministic trend is linear, the sensitivity is zero. We also develop a large‐sample procedure to measure the forecast sensitivity when we are uncertain whether to include the linear trend. Our analysis suggests that, depending on the initial conditions, it is better to include a linear trend for reduced sensitivity of the medium‐term forecast. Copyright © 2001 John Wiley & Sons, Ltd.     

Forecast Combination and Bayesian Model Averaging: A Prior Sensitivity Analysis

In this study we evaluate the forecast performance of model‐averaged forecasts based on the predictive likelihood carrying out a prior sensitivity analysis regarding Zellner's g prior. The main results are fourfold. First, the predictive likelihood does always better than the traditionally employed ‘marginal’ likelihood in settings where the true model is not part of the model space. Secondly, forecast accuracy as measured by the root mean square error (RMSE) is maximized for the median probability model. On the other hand, model averaging excels in predicting direction of changes. Lastly, g should be set according to Laud and Ibrahim (1995: Predictive model selection. Journal of the Royal Statistical Society B 57 : 247–262) with a hold‐out sample size of 25% to minimize the RMSE (median model) and 75% to optimize direction of change forecasts (model averaging). We finally apply the aforementioned recommendations to forecast the monthly industrial production output of six countries, beating for almost all countries the AR(1) benchmark model. Copyright © 2011 John Wiley & Sons, Ltd.     

Inflation forecasting for aggregates of the EU-7 and EU-14 with Bayesian VAR models

This article applies the Bayesian Vector Auto-Regressive (BVAR) model to key economic aggregates of the EU-7, consisting of the former narrow-band ERM members plus Austria, and the EU-14. This model appears to be useful as an additional forecasting tool besides structural macroeconomic models, as is shown both by absolute forecasting performance and by a comparison of ex-post BVAR forecasts with forecasts by the OECD. A comparison of the aggregate models to single-country models reveals that pooling has a strong impact on forecast errors. If forecast errors are interpreted as shocks, shocks appear to be—at least in part—asymmetric, or countries react differently to shocks. © 1998 John Wiley & Sons, Ltd.     

Mincer–Zarnowitz quantile and expectile regressions for forecast evaluations under aysmmetric loss functions

Forecasts are pervasive in all areas of applications in business and daily life. Hence evaluating the accuracy of a forecast is important for both the generators and consumers of forecasts. There are two aspects in forecast evaluation: (a) measuring the accuracy of past forecasts using some summary statistics, and (b) testing the optimality properties of the forecasts through some diagnostic tests. On measuring the accuracy of a past forecast, this paper illustrates that the summary statistics used should match the loss function that was used to generate the forecast. If there is strong evidence that an asymmetric loss function has been used in the generation of a forecast, then a summary statistic that corresponds to that asymmetric loss function should be used in assessing the accuracy of the forecast instead of the popular root mean square error or mean absolute error. On testing the optimality of the forecasts, it is demonstrated how the quantile regressions set in the prediction–realization framework of Mincer and Zarnowitz (in J. Mincer (Ed.), Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance (pp. 14–20), 1969) can be used to recover the unknown parameter that controls the potentially asymmetric loss function used in generating the past forecasts. Finally, the prediction–realization framework is applied to the Federal Reserve's economic growth forecast and forecast sharing in a PC manufacturing supply chain. It is found that the Federal Reserve values overprediction approximately 1.5 times more costly than underprediction. It is also found that the PC manufacturer weighs positive forecast errors (under forecasts) about four times as costly as negative forecast errors (over forecasts).     

Sources of error in forecasts and expectations: U.K. economic models, 1984–8

This paper presents a comparative analysis of the sources of error in forecasts for the UK economy published over a recent four-year period by four independent groups. This analysis rests on the archiving at the ESRC Macroeconomic Modelling Bureau of the original forecasts together with all their accompanying assumptions and adjustments. A method of decomposing observed forecast errors so as to distinguish the contributions of forecaster and model is set out; the impact of future expectations treated in a ‘model-consistent’ or ‘rational’ manner is specifically considered. The results show that the forecaster's adjustments make a substantial contribution to forecast performance, a good part of which comes from adjustments that bring the model on track at the start of the forecast period. The published ex-ante forecasts are usually superior to pure model-based ex-post forecasts, whose performance indicates some misspecification of the underlying models.     

Evaluating forecasts: a look at aggregate bias and accuracy measures

In this paper an investigation is made of the properties and use of two aggregate measures of forecast bias and accuracy. These are metrics used in business to calculate aggregate forecasting performance for a family (group) of products. We find that the aggregate measures are not particularly informative if some of the one‐step‐ahead forecasts are biased. This is likely to be the case in practice if frequently employed forecasting methods are used to generate a large number of individual forecasts. In the paper, examples are constructed to illustrate some potential problems in the use of the metrics. We propose a simple graphical display of forecast bias and accuracy to supplement the information yielded by the accuracy measures. This support includes relevant boxplots of measures of individual forecasting success. This tool is simple but helpful as the graphic display has the potential to indicate forecast deterioration that can be masked by one or both of the aggregate metrics. The procedures are illustrated with data representing sales of food items. Copyright © 2005 John Wiley & Sons, Ltd.     

Efficient Multistep Forecast Procedures for Multivariate Time Series

Upon the evidence that infinite‐order vector autoregression setting is more realistic in time series models, we propose new model selection procedures for producing efficient multistep forecasts. They consist of order selection criteria involving the sample analog of the asymptotic approximation of the h‐step‐ahead forecast mean squared error matrix, where h is the forecast horizon. These criteria are minimized over a truncation order n_T under the assumption that an infinite‐order vector autoregression can be approximated, under suitable conditions, with a sequence of truncated models, where n_T is increasing with sample size. Using finite‐order vector autoregressive models with various persistent levels and realistic sample sizes, Monte Carlo simulations show that, overall, our criteria outperform conventional competitors. Specifically, they tend to yield better small‐sample distribution of the lag‐order estimates around the true value, while estimating it with relatively satisfactory probabilities. They also produce more efficient multistep (and even stepwise) forecasts since they yield the lowest h‐step‐ahead forecast mean squared errors for the individual components of the holding pseudo‐data to forecast. Thus estimating the actual autoregressive order as well as the best forecasting model can be achieved with the same selection procedure. Such results stand in sharp contrast to the belief that parsimony is a virtue in itself, and state that the relative accuracy of strongly consistent criteria such as the Schwarz information criterion, as claimed in the literature, is overstated. Our criteria are new tools extending those previously existing in the literature and hence can suitably be used for various practical situations when necessary. Copyright © 2015 John Wiley & Sons, Ltd.     

Short‐Term Forecasts of French GDP: A Dynamic Factor Model with Targeted Predictors

In recent years, factor models have received increasing attention from both econometricians and practitioners in the forecasting of macroeconomic variables. In this context, Bai and Ng (Journal of Econometrics 2008; 146 : 304–317) find an improvement in selecting indicators according to the forecast variable prior to factor estimation (targeted predictors). In particular, they propose using the LARS‐EN algorithm to remove irrelevant predictors. In this paper, we adapt the Bai and Ng procedure to a setup in which data releases are delayed and staggered. In the pre‐selection step, we replace actual data with estimates obtained on the basis of past information, where the structure of the available information replicates the one a forecaster would face in real time. We estimate on the reduced dataset the dynamic factor model of Giannone et al. (Journal of Monetary Economics 2008; 55 : 665–676) and Doz et al. (Journal of Econometrics 2011; 164 : 188–205), which is particularly suitable for the very short‐term forecast of GDP. A pseudo real‐time evaluation on French data shows the potential of our approach. Copyright © 2013 John Wiley & Sons, Ltd.     

Adaptive forecasting of the EURIBOR swap term structure

In this paper we adopt a principal components analysis (PCA) to reduce the dimensionality of the term structure and employ autoregressive (AR) models to forecast principal components which, in turn, are used to forecast swap rates. Arguing in favour of structural variation, we propose data‐driven, adaptive model selection strategies based on the PCA/AR model. To evaluate ex ante forecasting performance for particular rates, distinct forecast features, such as mean squared errors, directional accuracy and directional forecast value, are considered. It turns out that, relative to benchmark models, the adaptive approach offers additional forecast accuracy in terms of directional accuracy and directional forecast value. Copyright © 2009 John Wiley & Sons, Ltd.     

Forecasting relative quality

This paper develops a model to forecast the likely quality rating of new automobiles. A scheme is devised and implemented for 1982 whereby the probability that a specific model will have one of five quality ratings is computed. The quality ratings are based on the trouble index computed by Consumer Reports based on a survey of its subscribers. A multinomial logit specification is used whereby the relative probability that a given level of quality is realized is a function of previous quality ratings, the location of the manufacturer of the automobile, the size of the automobile and the list price (or port-of-entry prices, in the case of imports). The forecast results when compared in a qualitative way to actual 1982 quality ratings prove to be acceptable.     

The usefulness of heuristic N(E)RLS algorithms for combining forecasts

There exists theoretical and empirical evidence on the efficiency and robustness of Non-negativity Restricted Least Squares combinations of forecasts. However, the computational complexity of the method hinders its widespread use in practice. We examine various optimizing and heuristic computational algorithms for estimating NRLS combination models and provide certain CPU-time reducing implementations. We empirically compare the combination weights identified by the alternative algorithms and their computational demands based on a total of more than 66,000 models estimated to combine the forecasts of 37 firm-specific accounting earnings series. The ex ante prediction accuracies of combined forecasts from the optimizing versus heuristic algorithms are compared. The effects of fit sample size, model specification, multicollinearity, correlations of forecast errors, and series and forecast variances on the relative accuracy of the optimizing versus heuristic algorithms are analysed. The results reveal that, in general, the computationally simple heuristic algorithms perform as well as the optimizing algorithms. No generalizable conclusions could be reached, however, about which algorithm should be used based on series and forecast characteristics. © 1997 John Wiley & Sons, Ltd.     

Evaluating early warning and coincident indicators of business cycles using smooth trends

We present a composite coincident indicator designed to capture the state of the Spanish economy. Our approach, based on smooth trends, guarantees that the resulting indicators are reasonably smooth and issue stable signals, reducing the uncertainty. The coincident indicator has been checked by comparing it with the one recently proposed by the Spanish Economic Association index. Both indexes show similar behavior and ours captures very well the beginning and end of the official recessions and expansion periods. Our coincident indicator also tracks very well alternative mass media indicators typically used in the political science literature. We also update our composite leading indicator (Bujosa et al., Journal of Forecasting, 2013, 32(6), 481–499). It systematically predicts the peaks and troughs of the new Spanish Economic Association index and provides significant aid in forecasting annual gross domestic product growth rates. Using only real data available at the beginning of each forecast period, our indicator one-step-ahead forecast shows improvements over other individual alternatives and different forecast combinations.     

On the Predictive Content of Autoregression Residuals: A Semiparametric,Copula‐Based Approach to Time Series Prediction

This paper proposes an adjustment of linear autoregressive conditional mean forecasts that exploits the predictive content of uncorrelated model residuals. The adjustment is motivated by non‐Gaussian characteristics of model residuals, and implemented in a semiparametric fashion by means of conditional moments of simulated bivariate distributions. A pseudo ex ante forecasting comparison is conducted for a set of 494 macroeconomic time series recently collected by Dees et al. (Journal of Applied Econometrics 2007; 22: 1–38). In total, 10,374 time series realizations are contrasted against competing short‐, medium‐ and longer‐term purely autoregressive and adjusted predictors. With regard to all forecast horizons, the adjusted predictions consistently outperform conditionally Gaussian forecasts according to cross‐sectional mean group evaluation of absolute forecast errors and directional accuracy. Copyright © 2012 John Wiley & Sons, Ltd.     

Modifying quantitative forecasts of livestock production using expert judgments: An application to the australian lamb industry

The judgmental modification of quantitative forecasts has become increasingly adopted in the production of agricultural commodity outlook information. Such modifications allow current period information to be incorporated into the forecast value, and ensure that the forecast is realistic in the context of current industry trends. This paper investigates the potential value of this approach in production forecasting in the Australian lamb industry. Several individual and composite econometric models were used to forecast a lamb-slaughtering series with a selected forecast being given to a panel of lamb industry specialists for consideration and modification. The results demonstrate that this approach offers considerable accuracy advantages in the short-term forecasting of livestock market variables, such as slaughtering, whose values can be strongly influenced by current industry conditions.     

Multi‐step forecasting for long‐memory processes

In this paper we present results of a simulation study to assess and compare the accuracy of forecasting techniques for long‐memory processes in small sample sizes. We analyse differences between adaptive ARMA(1,1) L‐step forecasts, where the parameters are estimated by minimizing the sum of squares of L‐step forecast errors, and forecasts obtained by using long‐memory models. We compare widths of the forecast intervals for both methods, and discuss some computational issues associated with the ARMA(1,1) method. Our results illustrate the importance and usefulness of long‐memory models for multi‐step forecasting. Copyright © 1999 John Wiley & Sons, Ltd.