A unified view of statistical forecasting procedures

A large number of statistical forecasting procedures for univariate time series have been proposed in the literature. These range from simple methods, such as the exponentially weighted moving average, to more complex procedures such as Box–Jenkins ARIMA modelling and Harrison–Stevens Bayesian forecasting. This paper sets out to show the relationship between these various procedures by adopting a framework in which a time series model is viewed in terms of trend, seasonal and irregular components. The framework is then extended to cover models with explanatory variables. From the technical point of view the Kalman filter plays an important role in allowing an integrated treatment of these topics.     

The accuracy of extrapolation methods; an automatic box–jenkins package sift

Hill and Woodworth (1980) proposed an algorithm suitable for identifying Box–Jenkins models automatically without reliance on the investigator. This paper first reviews the method. It is then used on the 111 series analysed by Anderson in the Makridakis forecasting competition. The results show that the automatic method of Hill and Woodworth is comparable in terms of accuracy to the full Box–Jenkins identification procedure.     

The chatfield-prothero case study: Another look

The Chatfield-Prothero case study in time series, ‘Sales of a company X’, is analysed from a perspective different to that of the authors. More accurate forecasting performance for these data is obtained by adopting the following two tactics: (1) shifting from a problem in transformation of the original series to one of seasonality adjustment; (2) assuming a mixed seasonality type model in contrast to employing a multiplicative assumption.     

An evaluation of bayesian forecasting

‘Bayesian forecasting’ is a time series method of forecasting which (in the United Kingdom) has become synonymous with the state space formulation of Harrison and Stevens (1976). The approach is distinct from other time series methods in that it envisages changes in model structure. A disjoint class of models is chosen to encompass the changes. Each data point is retrospectively evaluated (using Bayes theorem) to judge which of the models held. Forecasts are then derived conditional on an assumed model holding true. The final forecasts are weighted sums of these conditional forecasts. Few empirical evaluations have been carried out. This paper reports a large scale comparison of time series forecasting methods including the Bayesian. The approach is two fold: a simulation study to examine parameter sensitivity and an empirical study which contrasts Bayesian with other time series methods.     

Exponential smoothing: The state of the art

This paper is a critical review of exponential smoothing since the original work by Brown and Holt in the 1950s. Exponential smoothing is based on a pragmatic approach to forecasting which is shared in this review. The aim is to develop state-of-the-art guidelines for application of the exponential smoothing methodology. The first part of the paper discusses the class of relatively simple models which rely on the Holt-Winters procedure for seasonal adjustment of the data. Next, we review general exponential smoothing (GES), which uses Fourier functions of time to model seasonality. The research is reviewed according to the following questions. What are the useful properties of these models? What parameters should be used? How should the models be initialized? After the review of model-building, we turn to problems in the maintenance of forecasting systems based on exponential smoothing. Topics in the maintenance area include the use of quality control models to detect bias in the forecast errors, adaptive parameters to improve the response to structural changes in the time series, and two-stage forecasting, whereby we use a model of the errors or some other model of the data to improve our initial forecasts. Some of the major conclusions: the parameter ranges and starting values typically used in practice are arbitrary and may detract from accuracy. The empirical evidence favours Holt's model for trends over that of Brown. A linear trend should be damped at long horizons. The empirical evidence favours the Holt-Winters approach to seasonal data over GES. It is difficult to justify GES in standard form–the equivalent ARIMA model is simpler and more efficient. The cumulative sum of the errors appears to be the most practical forecast monitoring device. There is no evidence that adaptive parameters improve forecast accuracy. In fact, the reverse may be true.     

General exponential smoothing and the equivalent arma process

Although the basic principles of exponential smoothing and discounted least squares are easily understood, the full power of the technique is only rarely exploited. The reason for this failure lies in the complexity of the standard procedures. Often they require fairly complex mathematical models and use a variety of cumbersome algebraic manipulations. An alternative formulation for exponential smoothing is presented. It simplifies these procedures and allows an easier use of the full range of models. This new formulation is obtained by considering the relationship between general exponential smoothing (GES) and the well-known ARMA process of Box and Jenkins. The three commonest seasonal models have only recently been considered for GES systems. They are discussed in some detail here. The computational requirements of the GES and equivalent ARMA procedures are reviewed and some recommendations for their application are made. The initialization of GES forecasting systems and the important problem of model selection is also discussed. A brief illustrative example is given.     

The accuracy of extrapolation (time series) methods: Results of a forecasting competition

In the last few decades many methods have become available for forecasting. As always, when alternatives exist, choices need to be made so that an appropriate forecasting method can be selected and used for the specific situation being considered. This paper reports the results of a forecasting competition that provides information to facilitate such choice. Seven experts in each of the 24 methods forecasted up to 1001 series for six up to eighteen time horizons. The results of the competition are presented in this paper whose purpose is to provide empirical evidence about differences found to exist among the various extrapolative (time series) methods used in the competition.     

A forecasting procedure for nonlinear autoregressive time series models

Forecasting for nonlinear time series is an important topic in time series analysis. Existing numerical algorithms for multi‐step‐ahead forecasting ignore accuracy checking, alternative Monte Carlo methods are also computationally very demanding and their accuracy is difficult to control too. In this paper a numerical forecasting procedure for nonlinear autoregressive time series models is proposed. The forecasting procedure can be used to obtain approximate m‐step‐ahead predictive probability density functions, predictive distribution functions, predictive mean and variance, etc. for a range of nonlinear autoregressive time series models. Examples in the paper show that the forecasting procedure works very well both in terms of the accuracy of the results and in the ability to deal with different nonlinear autoregressive time series models. Copyright © 2005 John Wiley & Sons, Ltd.     

Forecasting the economic recession in the U.K. 1979-1982: A comparison of model-based ex ante Forecasts

This paper compares the forecasts of recession and recovery made by five non-government U.K. teams modelling the economy (Cambridge Econometrics, the London Business School, the National Institute of Economic and Social Research, the Cambridge Economic Policy Group and the Liverpool Research Group). The paper concentrates on annual ex ante projections as published over the period 1978-1982, i.e. forecasts made, before the event, of the onset, length, depth and character of the economic recession in the U.K. which began in 1979. The comparison is in terms of year by year changes in production, unemployment, prices and other variables. It concludes that no group was systematically better or worse than other groups (confirming U.S. experience) and that the groups tended to perform better in their chosen areas of specialization, e.g. medium-term groups did better at forecasting the medium-term outcome.     

Discount weighted estimation

The parsimonious method of exponentially weighted regression (EWR) is attractive but limited in application because it depends upon just one discount factor. This paper generalizes the EWR approach to a method called discount weighted estimation (DWE) which allowed distinct model components to have different associated discount factors. The method includes EWR as a special case. The general non-limiting recurrence relationships will be useful in practice, especially when practitioners wish to specify prior information, to intervene with subjective judgement and to derive estimates and forecasts sequentially based upon limited data. Two theorems extend the important EWR limiting results of Dobbie and McKenzie to DWE. The latter permits the derivation of a large class of known processs for which DWE is optimal. The method is illustrated by two applications, one of which uses the famous international airline passenger data. This allows a comparision with the ICI MULDO system which uses a particular two discount factor forecasting method. A companion paper extends the discount methods to Bayesian forecasting, Kalman filtering and state space modelling.     

Forecasting time series which are inherently discontinuous

Commonly used forecasting methods often produce meaningless forecasts when time series display abrupt changes in level. Measuring and accounting for the effect of discontinuities can have a significant impact on forecasting accuracy. In addition, if discontinuities are considered non-random and their cause is known, then adjustments can be made to more reliably represent the trend, seasonal and random component. This paper concerns a computational method used in forecasting inherently discontinuous time series. The method provides screening to determine the locations and types of discontinuities. The paper includes analyses of actual time series which are typical of certain types of inherently discontinuous processes.     

The use of growth curves in forecasting market development—a review and appraisal

The growth curves suitable for forecasting market development are identified and described. The underlying theoretical basis, if any, for their use is examined, and published examples of their applications are given. Doubt is cast on the value of long-term forecasts derived from growth curves applied to markets for consumables. The problems of choice between competing curves are demonstrated by means of some examples. The requirements that a growth curve should meet in order to be an appropriate forecasting tool are identified and illustrated. Many of the published examples of growth curve use are shown to be vulnerable to criticism under one or more of these criteria.     

Using the bootstrap to evaluate forecasting equations

The bootstrap, like the jack-knife, is a technique for estimating standard errors. The idea is to use Monte Carlo simulation, based on a non-parametric estimate of the underlying error distribution. The bootstrap will be applied to an econometric equation describing the demand for energy by industry, to determine multi-period forecasting error and choose among competing specifications. The delta method for estimating forecast errors turns out to be too optimistic by a factor of 2.     

ARARMA models for time series analysis and forecasting

Methods of time series forecasting are proposed which can be applied automatically. However, they are not rote formulae, since they are based on a flexible philosophy which can provide several models for consideration. In addition it provides diverse diagnostics for qualitatively and quantitatively estimating how well one can forecast a series. The models considered are called ARARMA models (or ARAR models) because the model fitted to a long memory time series (t) is based on sophisticated time series analysis of AR (or ARMA) schemes (short memory models) fitted to residuals Y(t) obtained by parsimonious‘best lag’non-stationary autoregression. Both long range and short range forecasts are provided by an ARARMA model Section 1 explains the philosophy of our approach to time series model identification. Sections 2 and 3 attempt to relate our approach to some standard approaches to forecasting; exponential smoothing methods are developed from the point of view of prediction theory (section 2) and extended (section 3). ARARMA models are introduced (section 4). Methods of ARARMA model fitting are outlined (sections 5,6). Since‘the proof of the pudding is in the eating’, the methods proposed are illustrated (section 7) using the classic example of international airline passengers.     

The teachers/practitioners corner comparative analysis of load forecasting techniques at a southern utility

The prime directive of any regulated electric utility is to provide adequate and reliable electricity supplies to the consuming public at reasonable cost. This requires the continual addition of new generating plants which is based on a long term forecast of energy and peak demand. This study documents the forecasting process used at a southern utility and compares the accuracy of their models to that produced using Holt's exponential smoothing and generalized adoptive filtering.     

The role of time series analysis in the evaluation of econometric models

This paper compares the properties of a structural model—the London Business School model of the U.K. economy—with a time series model. Information provided by this type of comparison is a useful diagnostic tool for detecting types of model misspecification. This is a more meaningful way of proceeding rather than attempting to establish the superiority of one type of model over another. In lieu of a better structural model, the effects of inappropriate dynamic specification can be reduced by combining the forecasts of both the structural and time series models. For many variables considered here these provide more accurate forecasts than each of the model types alone.     

Short-term forecasting of industrial production by means of quick indicators

This paper reports results on building transfer function models with linear combinations of quick indicators as inputs for very short-term prediction of the monthly time series of the volume of industrial production in Finland. The number of input variables in the transfer function models is reduced in two alternative ways: by replacing the original indicators by their two first principal components and by omitting certain indicators. The prediction accuracy of the transfer function models is checked outside the sample and found superior to that of corresponding ARIMA models. Neither of the two ways of reducing the number of input variables leads to consistently more accurate forecasts than the other. It is also found that the prediction accuracy of the transfer function models compares rather favourably with the preliminary values of the volume of industrial production published by the Central Statistical Office during the periods of rapid growth.     

A new parsimonious recurrent forecasting model in singular spectrum analysis

Singular spectrum analysis (SSA) is a powerful nonparametric method in the area of time series analysis that has shown its capability in different applications areas. SSA depends on two main choices: the window length L and the number of eigentriples used for grouping r. One of the most important issues when analyzing time series is the forecast of new observations. When using SSA for time series forecasting there are several alternative algorithms, the most widely used being the recurrent forecasting model, which assumes that a given observation can be written as a linear combination of the L?1 previous observations. However, when the window length L is large, the forecasting model is unlikely to be parsimonious. In this paper we propose a new parsimonious recurrent forecasting model that uses an optimal m(<L?1) coefficients in the linear combination of the recurrent SSA. Our results support the idea of using this new parsimonious recurrent forecasting model instead of the standard recurrent SSA forecasting model.     

The teachers/practitioners corner the effects of indexing ARMA series using the consumer price index

The authors demonstrate that indexing a time series with an ARMA representation using the Consumer Price Index does not materially alter the ARMA form of the model. They further demonstrate that the forecasting error of the indexed series and of the product of the forecasts of the index and the time series are, for practical purpose, the same. Simulation results are reported for five model classes.     

Forecasting contemporaneous aggregates and the combination of forecasts: The case of the U.K. monetary aggregates

A number of papers in recent years have investigated the problems of forecasting contemporaneously aggregated time series and of combining alternative forecasts of a time series. This paper considers the integration of both approaches within the example of assessing the forecasting performance of models for two of the U.K. monetary aggregates, £M3 and MO. It is found that forecasts from a time series model for aggregate £M3 are superior to aggregated forecasts from individual models fitted to either the components or counterparts of £M3 and that an even better forecast is obtained by forming a linear combination of the three alternatives. For MO, however, aggregated forecasts from its components prove superior to either the forecast from the aggregate itself or from a linear combination of the two.