Finite‐sample properties of tests for equal forecast accuracy

This study examines the small‐sample properties of some commonly used tests of equal forecast accuracy. The paper considers the size and power of different tests and the performance of different heteroscedasticity and autocorrelation‐consistent (HAC) variance estimators. Monte Carlo experiments show that the tests all suffer some size distortions in small samples, with the distortions varying across tests. The experiments also show that, adjusted for size distortions, the tests have broadly similar power, although some small differences exist. Finally, the experiments indicate that the size and power performances of HAC estimators vary with the features of the data. Copyright © 1999 John Wiley & Sons, Ltd.     

Optimal conditional ARIMA forecasts

An optimal univariate forecast, based on historical and additional information about the future, is obtained in this paper. Its statistical properties, as well as some inferential procedures derived from it, are indicated. Two main situations are considered explicitly: (1) when the additional information imposes a constraint to be fulfilled exactly by the forecasts and (2) when the information is only a conjecture about the future values of the series or a forecast from an alternative model. Theoretical and empirical illustrations are provided, and a unification of the existing methods is also attempted.     

Minimum variance prediction of bilinear time series: Direct and adaptive versions

Bilinear models of time series are considered. Minimum variance predictor for bilinear time series, homogeneous in the input and output, is proposed. Results of minimum variance prediction of bilinear time series are included. They are compared to the results of linear prediction of bilinear time series. A minimum variance prediction algorithm for bilinear time series of the general form is developed and an adaptive version of minimum variance algorithm is derived.     

Forecasting with preliminary data

This paper examines several methods to forecast revised US trade balance figures by incorporating preliminary data. Two benchmark forecasts are considered: one ignoring the preliminary data and the other applying a combination approach; with the second outperforming the first. Competing models include a bivariate AR error-correction model and a bivariate AR error-correction model with GARCH effects. The forecasts from the latter model outperforms the combination benchmark for the one-step forecast case only. A restricted AR error-correction model with GARCH effects is discovered to provide the best forecasts. © 1997 John Wiley & Sons, Ltd.     

Forecasting the recent behavior of US business fixed investment spending: an analysis of competing models

We evaluate forecasting models of US business fixed investment spending growth over the recent 1995:1–2004:2 out‐of‐sample period. The forecasting models are based on the conventional Accelerator, Neoclassical, Average Q, and Cash‐Flow models of investment spending, as well as real stock prices and excess stock return predictors. The real stock price model typically generates the most accurate forecasts, and forecast‐encompassing tests indicate that this model contains most of the information useful for forecasting investment spending growth relative to the other models at longer horizons. In a robustness check, we also evaluate the forecasting performance of the models over two alternative out‐of‐sample periods: 1975:1–1984:4 and 1985:1–1994:4. A number of different models produce the most accurate forecasts over these alternative out‐of‐sample periods, indicating that while the real stock price model appears particularly useful for forecasting the recent behavior of investment spending growth, it may not continue to perform well in future periods. Copyright © 2007 John Wiley & Sons, Ltd.     

The impact of measurement errors on ARMA prediction

Measurement errors can have dramatic impact on the outcome of empirical analysis. In this article we quantify the effects that they can have on predictions generated from ARMA processes. Lower and upper bounds are derived for differences in minimum mean squared prediction errors (MMSE) for forecasts generated from data with and without errors. The impact that measurement errors have on MMSE and other relative measures of forecast accuracy are presented for a variety of model structures and parameterizations. Based on these results the need to set up the models in state space form to extract the signal component appears to depend upon whether processes are nearly non‐invertible or non‐stationary or whether the noise‐to‐signal ratio is very high. Copyright © 1999 John Wiley & Sons, Ltd.     

Forecast comparisons of four models of U.S. interest rates

In this paper we compare the out of sample forecasts from four alternative interest rate models based on expanding information sets. The random walk model is the most restrictive. The univariate time series model allows for a richer dynamic pattern and more conditioning information on own rates. The multivariate time series model permits a flexible dynamic pattern with own- and cross-series information. Finally, the forecasts from the MPS econometric model depend on the full model structure and information set. In theory, more information is preferred to less. In practice, complicated misspecified models can perform much worse than simple (also probably misspecified) models. For forecasts evaluated over the volatile 1970s the multivariate time series model forecasts are considerably better than those from simpler models which use less conditioning information, as well as forecasts from the MPS model which uses substantially more conditioning information but also imposes ‘structural’ economic restrictions.     

Time-series Properties and Forecasts of Crude Steel Consumption in the UK

This paper makes use of simple graphical techniques, a seasonal unit root test and a structural time-series model to obtain information on the time series properties of UK crude steel consumption. It shows that steel consumption has, after the removal of some quite substantial outliers, a fairly constant seasonal pattern, and a well-defined but stochastic business cycle. The long-run movement in steel consumption also appears to be stochastic in nature. These characteristics were used to identify a structural time-series model and the ex-post forecasts obtained from it performed reasonably well. Finally, this paper presents some ex-ante quarterly forecasts for crude steel consumption to the year 1999. © 1997 by John Wiley & Sons, Ltd.     

Linear regression forecasting in the presence of ar(1) disturbances

This paper is concerned with time-series forecasting based on the linear regression model in the presence of AR(1) disturbances. The standard approach is to estimate the AR(1) parameter, ρ, and then construct forecasts assuming the estimated value is the true value. We introduce a new approach which can be viewed as a weighted average of predictions assuming different values of ρ. The weights are proportional to the marginal likelihood of ρ. A Monte Carlo experiment was conducted to compare the new method with five more conventional predictors. Its results suggest that the new approach has a distinct edge over existing procedures.     

The teachers/practitioners corner the effects of indexing ARMA series using the consumer price index

The authors demonstrate that indexing a time series with an ARMA representation using the Consumer Price Index does not materially alter the ARMA form of the model. They further demonstrate that the forecasting error of the indexed series and of the product of the forecasts of the index and the time series are, for practical purpose, the same. Simulation results are reported for five model classes.     

Forecasting contemporaneous aggregates and the combination of forecasts: The case of the U.K. monetary aggregates

A number of papers in recent years have investigated the problems of forecasting contemporaneously aggregated time series and of combining alternative forecasts of a time series. This paper considers the integration of both approaches within the example of assessing the forecasting performance of models for two of the U.K. monetary aggregates, £M3 and MO. It is found that forecasts from a time series model for aggregate £M3 are superior to aggregated forecasts from individual models fitted to either the components or counterparts of £M3 and that an even better forecast is obtained by forming a linear combination of the three alternatives. For MO, however, aggregated forecasts from its components prove superior to either the forecast from the aggregate itself or from a linear combination of the two.     

Deletion diagnostics for transformations of time series

Deletion diagnostics are derived for the effect of individual observations on the estimated transformation of a time series. The paper uses the modified power transformation of Box and Cox to provide a parametric family of transformations. Inference about the transformation parameter is made through regression on a constructed variable. The effect of deletion of observations on residuals and on the estimate of the regression parameter are obtained. Index plots of the diagnostic quantities are shown to be highly informative. Structural time series modelling is used, so that the results readily extend to inference about regression on other explanatory variables.     

Disaggregation methods to expedite product line forecasting

This paper addresses the issue of forecasting individual items within a product line; where each line includes several independent but closely related products. The purpose of the research was to reduce the overall forecasting burden by developing and assessing schemes of disaggregating forecasts of a total product line to the related individual items. Measures were developed to determine appropriate disaggregated methodologies and to compare the forecast accuracy of individual product forecasts versus disaggregated totals. Several of the procedures used were based upon extensions of the combination of forecast research and applied to disaggregations of total forecasts of product lines. The objective was to identify situations when it was advantageous to produce disaggregated forecasts, and if advantageous, which method of disaggregation to utilize. This involved identification of the general conceptual characteristics within a set of product line data that might cause a disaggregation method to produce relatively accurate forecasts. These conceptual characteristics provided guidelines for forecasters on how to select a disaggregation method and under what conditions a particular method is applicable.     

The accuracy of extrapolation (time series) methods: Results of a forecasting competition

In the last few decades many methods have become available for forecasting. As always, when alternatives exist, choices need to be made so that an appropriate forecasting method can be selected and used for the specific situation being considered. This paper reports the results of a forecasting competition that provides information to facilitate such choice. Seven experts in each of the 24 methods forecasted up to 1001 series for six up to eighteen time horizons. The results of the competition are presented in this paper whose purpose is to provide empirical evidence about differences found to exist among the various extrapolative (time series) methods used in the competition.     

The combination of macroeconomic forecasts

The paper examines combined forecasts based on two components: forecasts produced by Chase Econometrics and those produced using the Box-Jenkins ARIMA technique. Six series of quarterly ex ante and simulated ex ante forecasts are used over 37 time periods and ten horizons. The forecasts are combined using seven different methods. The best combined forecasts, judged by average relative root-mean-square error, are superior to the Chase forecasts for three variables and inferior for two, though averaged over all six variables the Chase forecasts are slightly better. A two-step procedure produces forecasts for the last half of the sample which, on average, are slightly better than the Chase forecasts.     

Shrinkage‐Based Tests of Predictability

In this paper we derive a test of predictability by exploring the possibility that forecasts from a given model, adjusted by a shrinkage factor, will display lower mean squared prediction errors than forecasts from a simple random walk. This generalizes most previous tests which compare forecast errors of a benchmark model with errors of a proposed alternative model, not allowing for shrinkage. We show that our test is a particular extension of a recently developed test of the martingale difference hypothesis. Using simulations we explore the behavior of our test in small and moderate samples. Numerical results indicate that the test has good size and power properties. Finally, we illustrate the use of our test in an empirical application within the exchange rate literature. Copyright © 2012 John Wiley & Sons, Ltd.     

Application of intervention analysis to a road fatality series in ontario

Effect of an intervention on a road fatality time series is studied using (i) the usual intervention analysis of Box and Tiao (1975), and (ii) CUSUM charts for the one-step-ahead forecast errors. It is shown that the seat belt and speed limit legislations of the Ontario Government had some impact in bringing down the road toll level.     

The role of time series analysis in the evaluation of econometric models

This paper compares the properties of a structural model—the London Business School model of the U.K. economy—with a time series model. Information provided by this type of comparison is a useful diagnostic tool for detecting types of model misspecification. This is a more meaningful way of proceeding rather than attempting to establish the superiority of one type of model over another. In lieu of a better structural model, the effects of inappropriate dynamic specification can be reduced by combining the forecasts of both the structural and time series models. For many variables considered here these provide more accurate forecasts than each of the model types alone.     

Forecasting nonlinear time series with feed‐forward neural networks: a case study of Canadian lynx data

The forecasting capabilities of feed‐forward neural network (FFNN) models are compared to those of other competing time series models by carrying out forecasting experiments. As demonstrated by the detailed forecasting results for the Canadian lynx data set, FFNN models perform very well, especially when the series contains nonlinear and non‐Gaussian characteristics. To compare the forecasting accuracy of a FFNN model with an alternative model, Pitman's test is employed to ascertain if one model forecasts significantly better than another when generating one‐step‐ahead forecasts. Moreover, the residual‐fit spread plot is utilized in a novel fashion in this paper to compare visually out‐of‐sample forecasts of two alternative forecasting models. Finally, forecasting findings on the lynx data are used to explain under what conditions one would expect FFNN models to furnish reliable and accurate forecasts. Copyright © 2005 John Wiley & Sons, Ltd.