Effect of regressor forecast error on the variance of regression forecasts

It is well understood that the standard formulation for the variance of a regression‐model forecast produces interval estimates that are too narrow, principally because it ignores regressor forecast error. While the theoretical problem has been addressed, there has not been an adequate explanation of the effect of regressor forecast error, and the empirical literature has supplied a disparate variety of bits and pieces of evidence. Most business‐forecasting software programs continue to supply only the standard formulation. This paper extends existing analysis to derive and evaluate large‐sample approximations for the forecast error variance in a single‐equation regression model. We show how these approximations substantially clarify the expected effects of regressor forecast error. We then present a case study, which (a) demonstrates how rolling out‐of‐sample evaluations can be applied to obtain empirical estimates of the forecast error variance, (b) shows that these estimates are consistent with our large‐sample approximations and (c) illustrates, for ‘typical’ data, how seriously the standard formulation can understate the forecast error variance. Copyright © 2000 John Wiley & Sons, Ltd.     

Computing the variance of the forecast error for the holt-winters seasonal models

This paper presents expressions for the variance of the forecast error for arbitrary lead times for both the additive and multiplicative Holt-Winters seasonal forecasting models. It is shown that even when the smoothing constants are chosen to have values between zero and one, when the period is greater than four, the variance may not be finite for some values of the smoothing constants. In addition, the regions where the variance becomes infinite are almost the same for both models. These results are of importance for practitioners, who may choose values for the smoothing constants arbitrarily, or by searching on the unit cube for values which minimize the sum of the squared errors when fitting the model to a data set. It is also shown that the variance of the forecast error for the multiplicative model is nonstationary and periodic.     

Algorithms for explaining forecast revisions

Forecasts are routinely revised, and these revisions are often the subject of informal analysis and discussion. This paper argues (1) that forecast revisions are analyzed because they help forecasters and forecast users to evaluate forecasts and forecasting procedures and (2) that these analyses can be sharpened by using the forecasting model to systematically express its forecast revision as the sum of components identified with specific subsets of new information, such as data revisions and forecast errors. An algorithm for this purpose is explained and illustrated.     

Multi-step forecast error variances for periodically integrated time series

A periodically integrated (PI) time series process assumes that the stochastic trend can be removed using a seasonally varying differencing filter. In this paper the multi-step forecast error variances are derived for a quarterly PI time series when low-order periodic autoregressions adequately describe the data. The forecast error variances display seasonal variation, indicating that observations in some seasons can be forecast more precise than those in others. Two examples illustrate the empirical relevance of calculating forecast error variances. A by-product of the analysis is an expression for the seasonally varying impact of the stochastic trend.     

Optimal sampling frequency for volatility forecast models for the Indian stock markets

This paper evaluates the performance of conditional variance models using high‐frequency data of the National Stock Index (S&P CNX NIFTY) and attempts to determine the optimal sampling frequency for the best daily volatility forecast. A linear combination of the realized volatilities calculated at two different frequencies is used as benchmark to evaluate the volatility forecasting ability of the conditional variance models (GARCH (1, 1)) at different sampling frequencies. From the analysis, it is found that sampling at 30 minutes gives the best forecast for daily volatility. The forecasting ability of these models is deteriorated, however, by the non‐normal property of mean adjusted returns, which is an assumption in conditional variance models. Nevertheless, the optimum frequency remained the same even in the case of different models (EGARCH and PARCH) and different error distribution (generalized error distribution, GED) where the error is reduced to a certain extent by incorporating the asymmetric effect on volatility. Our analysis also suggests that GARCH models with GED innovations or EGRACH and PARCH models would give better estimates of volatility with lower forecast error estimates. Copyright © 2008 John Wiley & Sons, Ltd.     

Semiparametric forecast intervals

Consider forecasting the economic variable Y_t+h with predictors X _t, where h is the forecast horizon. This paper introduces a semiparametric method that generates forecast intervals of Y_t+h| X _t from point forecast models. First, the point forecast model is estimated, thereby taking advantage of its predictive power. Then, nonparametric estimation of the conditional distribution function (CDF) of the forecast error conditional on X _t builds the rest of the forecast distribution around the point forecast, from which symmetric and minimum‐length forecast intervals for Y_t+h| X _t can be constructed. Under mild regularity conditions, asymptotic analysis shows that (1) regardless of the quality of the point forecast model (i.e., it may be misspecified), forecast quantiles are consistent and asymptotically normal; (2) minimum length forecast intervals are consistent. Proposals for bandwidth selection and dimension reduction are made. Three sets of simulations show that for reasonable point forecast models the method has significant advantages over two existing approaches to interval forecasting: one that requires the point forecast model to be correctly specified, and one that is based on fully nonparametric CDF estimate of Y_t+h| X _t. An application to exchange rate forecasting is presented. Copyright © 2010 John Wiley & Sons, Ltd.     

Integrating time-series and end-use methods to forecast electricity sales

Two types of forecasting methods have been receiving increasing attention by electric utility forecasters. The first type, called end-use forecasting, is recognized as an approach which is well suited for forecasting during periods characterized by technological change. The method is straightforward. The stock levels of energy-consuming equipment are forecast, as well as the energy consumption characteristics of the equipment. The final forecast is the product of the stock and usage characteristics. This approach is well suited to forecasting long time periods when technological change, equipment depletion and replacement, and other structural changes are evident. For time periods of shorter duration, these factors are static and variations are more likely to result from shocks to the environment. The shocks influence the usage of the equipment. A second forecasting approach using time-series analysis has been demonstrated to be superior for these applications. This paper discusses the integration of the two methods into a unified system. The result is a time-series model whose parameter effects become dynamic in character. An example of the models being used at the Georgia Power Company is presented. It is demonstrated that a time-series model which incorporates end-use stock and usage information is superior—even in short-term forecasting situations—to a similar time-series model which excludes the information.     

Forecasting with growth curves: the effect of error structure

"The main theme of this paper is an investigation into the importance of error structure as a determinant of the forecasting accuracy of the logistic model. The relationship between the variance of the disturbance term and forecasting accuracy is examined empirically. A general local logistic model is developed as a vehicle to be used in this investigation. Some brief comments are made on the assumptions about error structure, implicit or explicit, in the literature." The results suggest that "the variance of the disturbance term, when using the logistic to forecast human populations, is proportional to at least the square of population size."     

Short‐term forecasting of GDP using large datasets: a pseudo real‐time forecast evaluation exercise

This paper performs a large‐scale forecast evaluation exercise to assess the performance of different models for the short‐term forecasting of GDP, resorting to large datasets from ten European countries. Several versions of factor models are considered and cross‐country evidence is provided. The forecasting exercise is performed in a simulated real‐time context, which takes account of publication lags in the individual series. In general, we find that factor models perform best and models that exploit monthly information outperform models that use purely quarterly data. However, the improvement over the simpler, quarterly models remains contained. Copyright © 2009 John Wiley & Sons, Ltd.     

Model uncertainty and forecast accuracy

In time-series analysis, a model is rarely pre-specified but rather is typically formulated in an iterative, interactive way using the given time-series data. Unfortunately the properties of the fitted model, and the forecasts from it, are generally calculated as if the model were known in the first place. This is theoretically incorrect, as least squares theory, for example, does not apply when the same data are used to formulates and fit a model. Ignoring prior model selection leads to biases, not only in estimates of model parameters but also in the subsequent construction of prediction intervals. The latter are typically too narrow, partly because they do not allow for model uncertainty. Empirical results also suggest that more complicated models tend to give a better fit but poorer ex-ante forecasts. The reasons behind these phenomena are reviewed. When comparing different forecasting models, the BIC is preferred to the AIC for identifying a model on the basis of within-sample fit, but out-of-sample forecasting accuracy provides the real test. Alternative approaches to forecasting, which avoid conditioning on a single model, include Bayesian model averaging and using a forecasting method which is not model-based but which is designed to be adaptable and robust.     

Method and situational factors in sales forecast accuracy

In this study the interaction of forecasting method (econometric versus exponential smoothing) and two situational factors are evaluated for their effects upon accuracy. Data from two independent sets of ex ante quarterly forecasts for 19 classes of mail were used to test hypotheses. Counter to expectations, the findings revealed that forecasting method did not interact with the forecast time horizon (short versus long term). However, as hypothesized, forecasting method interacted significantly with product/market definition (First Class versus other mail), an indicator of buyer sensitivity to marketing/environmental changes. Results are discussed in the context of future research on forecast accuracy.     

Forecasting Latent Volatility through a Markov Chain Approximation Filter

We propose a new methodology for filtering and forecasting the latent variance in a two‐factor diffusion process with jumps from a continuous‐time perspective. For this purpose we use a continuous‐time Markov chain approximation with a finite state space. Essentially, we extend Markov chain filters to processes of higher dimensions. We assess forecastability of the models under consideration by measuring forecast error of model expected realized variance, trading in variance swap contracts, producing value‐at‐risk estimates as well as examining sign forecastability. We provide empirical evidence using two sources, the S&P 500 index values and its corresponding cumulative risk‐neutral expected variance (namely the VIX index). Joint estimation reveals the market prices of equity and variance risk implicit by the two probability measures. A further simulation study shows that the proposed methodology can filter the variance of virtually any type of diffusion process (coupled with a jump process) with a non‐analytical density function. Copyright © 2015 John Wiley & Sons, Ltd.     

Predictive ability and economic gains from volatility forecast combinations

The availability of numerous modeling approaches for volatility forecasting leads to model uncertainty for both researchers and practitioners. A large number of studies provide evidence in favor of combination methods for forecasting a variety of financial variables, but most of them are implemented on returns forecasting and evaluate their performance based solely on statistical evaluation criteria. In this paper, we combine various volatility forecasts based on different combination schemes and evaluate their performance in forecasting the volatility of the S&P 500 index. We use an exhaustive variety of combination methods to forecast volatility, ranging from simple techniques to time-varying techniques based on the past performance of the single models and regression techniques. We then evaluate the forecasting performance of single and combination volatility forecasts based on both statistical and economic loss functions. The empirical analysis in this paper yields an important conclusion. Although combination forecasts based on more complex methods perform better than the simple combinations and single models, there is no dominant combination technique that outperforms the rest in both statistical and economic terms.     

Finite sample forecast results for vector autoregressive moving average models

Using the 'standard' approach to forecasting in the vector autoregressive moving average model, we establish basic general results on exact finite sample forecasts and their mean squared error matrices. Comparison between the exact and conditional methods of initiating the finite sample forecast calculations is presented, and a few illustrative cases are given.     

An integrated bayesian vector auto regression and error correction model for forecasting electricity consumption and prices

The analysis and forecasting of electricity consumption and prices has received considerable attention over the past forty years. In the 1950s and 1960s most of these forecasts and analyses were generated by simultaneous equation econometric models. Beginning in the 1970s, there was a shift in the modeling of economic variables from the structural equations approach with strong identifying restrictions towards a joint time-series model with very few restrictions. One such model is the vector auto regression (VAR) model. It was soon discovered that the unrestricted VAR models do not forecast well. The Bayesian vector auto regression (BVAR) approach as well the error correction model (ECM) and models based on the theory of co integration have been offered as alternatives to the simple VAR model. This paper argues that the BVAF., ECM, and co integration models are simply VAR models with various restrictions placed on the coefficients. Based on this notion of a restricted VAR model, a four-step procedure for specifying VAR forecasting models is presented and then applied to monthly data on US electricity consumption and prices.     

Currency forecasting based on an error components‐seemingly unrelated nonlinear regression model

This paper proposes to forecast foreign exchange rates by means of an error components‐seemingly unrelated nonlinear regression (EC‐SUNR) model and, simultaneously, explore the interrelationships among currencies from newly industrializing economies with those of highly industrialized countries. Based on the empirical results, we find that the EC‐SUNR model improves on the performance of forecasting foreign exchange rates in comparison with an intrinsically nonlinear dynamic speed of adjustment model that has been shown to outperform several other important models in the forecasting literature. We also find evidence showing that the foreign exchange markets of the newly industrializing countries are influenced by those of the highly industrialized countries and vice versa, and that such interrelationships affect the accuracy of currency forecasting. Copyright © 2005 John Wiley & Sons, Ltd.     

Optimal forecast error as an unbiased estimator of abnormal return: A proposition

In the event studies, the accuracy of the abnormal returns assessment is highly dependent on the accuracy of the preceding expected return model. If the expected return model is inadequate, there is a possibility that a part of returns is labeled as abnormal returns even though they are not. Currently, we have a variety of options to set up an expected return model. To obtain unbiased abnormal returns, one should pay attention to the performance of the expected return model. In this research, we propose that the optimal forecast lemma can be consulted beforehand so that minimizing the optimal forecast error in the expected return model will yield unbiased abnormal returns. We introduce and prove a proposition that the optimal forecast error is an unbiased estimator for abnormal return. The proposition induces assessing the performance of abnormal return estimation to preemptively evaluate the out-sample forecast accuracy of the model employed. In an illustrative dataset, we examine various models. The approach requires preliminary computational effort; however, it is useful for accurately obtaining the abnormal return predictions.     

The importance of non-linearities in large forecasting models with stochastic error processes

This paper considers the consequences of the stochastic error process in large non-linear forecasting models. As such models are non-linear, the deterministic forecast is neither the mean nor the mode of the density function of the endogenous variables. Under a specific assumption as to the class of the non-linearity it is shown that the deterministic forecast is actually the vector of marginal medians of the density function. Stochastic simulation techniques are then used to test whether one large forecasting model actually lies within this class.     

Judgemental revision of sales forecasts: Effectiveness of forecast selection

When managers make revisions to sales forecasts initially generated by a rational quantitative model it is important that the particular forecasts selected for adjustment are those which would benefit most from the adjustment process (i.e. realize high errors). This study reports an empirical investigation on this issue, spanning six quarterly forecasting periods and incorporating forecasting data on over 850 products. The results show that the errors of the forecasts chosen for revision are, in general, higher than those which were not chosen. In addition, it is shown that managesrs tend to revise forecasts which are initially low, hence possibily introducing some degree of bias into the overall forecasts.     

Are all crowds equally wise? a comparison of political election forecasts by experts and the public

Four groups made forecasts of the outcome of the Swedish Parliamentary election in the fall of 2006. They consisted of members of the public, political scientists, journalists writing about domestic politics in Swedish daily newspapers, and journalists who were editing sections of readers' letters in daily newspapers. They estimated, using a 12‐step category scale, which percentage of the votes that they believed seven parties would get in the election. Data were then obtained on the outcome of the election, and on the two opinions polls closest in time to it. When median forecasts were compared across groups, it was found that the group from the public was most successful in forecasting the outcome of the election. This was in spite of the fact that the median error made by individual members of that group was about 50% larger than the median error made by members of other groups. The two polls were less efficient than the group from the public and overestimated the span between the incumbent government and the opposition by a factor of 2. The members of the public and journalists showed some wishful thinking in their forecasts. There were large and consistent individual differences in forecasting ability. Men performed better than women, as did those who expressed more interest and knowledge in politics. Copyright © 2008 John Wiley & Sons, Ltd.