ARIMA model building and the time series analysis approach to forecasting

This paper reviews the approach to forecasting based on the construction of ARIMA time series models. Recent developments in this area are surveyed, and the approach is related to other forecasting methodologies.     

Time series forecasting models involving power transformations

In this paper we discuss procedures for overcoming some of the problems involved in fitting autoregressive integrated moving average forecasting models to time series data, when the possibility of incorporating an instantaneous power transformation of the data into the analysis is contemplated. The procedures are illustrated using series of quarterly observations on corporate earnings per share.     

Estimation procedures for structural time series models

A univariate structural time series model based on the traditional decomposition into trend, seasonal and irregular components is defined. A number of methods of computing maximum likelihood estimators are then considered. These include direct maximization of various time domain likelihood function. The asymptotic properties of the estimators are given and a comparison between the various methods in terms of computational efficiency and accuracy is made. The methods are then extended to models with explanatory variables.     

Forecasting time series with increasing seasonal variation

Four options for modeling and forecasting time series data containing increasing seasonal variation are discussed, including data transformations, double seasonal difference models and two kinds of transfer function-type ARIMA models employing seasonal dummy variables. An explanation is given for the typical ARIMA model identification analysis failing to identify double seasonal difference models for this kind of data. A logical process of selecting one option for a particular case is outlined, focusing on issues of linear versus non-linear increasing seasonal variation, and the level of stochastic versus deterministic behavior in a time series. Example models for the various options are presented for six time series, with point forecast and interval forecast comparisons. Interval forecasts from data-transformation models are found to generally be too wide and sometimes illogical in the dependence of their width on the point forecast level. Suspicion that maximum likelihood estimation of ARIMA models leads to excessive indications of unit roots in seasonal moving-average operators is reported.     

The accuracy of extrapolation (time series) methods: Results of a forecasting competition

In the last few decades many methods have become available for forecasting. As always, when alternatives exist, choices need to be made so that an appropriate forecasting method can be selected and used for the specific situation being considered. This paper reports the results of a forecasting competition that provides information to facilitate such choice. Seven experts in each of the 24 methods forecasted up to 1001 series for six up to eighteen time horizons. The results of the competition are presented in this paper whose purpose is to provide empirical evidence about differences found to exist among the various extrapolative (time series) methods used in the competition.     

On the forecasting of high-frequency financial time series based on ARIMA model improved by deep learning

Through empirical research, it is found that the traditional autoregressive integrated moving average (ARIMA) model has a large deviation for the forecasting of high-frequency financial time series. With the improvement in storage capacity and computing power of high-frequency financial time series, this paper combines the traditional ARIMA model with the deep learning model to forecast high-frequency financial time series. It not only preserves the theoretical basis of the traditional model and characterizes the linear relationship, but also can characterize the nonlinear relationship of the error term according to the deep learning model. The empirical study of Monte Carlo numerical simulation and CSI 300 index in China show that, compared with ARIMA, support vector machine (SVM), long short-term memory (LSTM) and ARIMA-SVM models, the improved ARIMA model based on LSTM not only improves the forecasting accuracy of the single ARIMA model in both fitting and forecasting, but also reduces the computational complexity of only a single deep learning model. The improved ARIMA model based on deep learning not only enriches the models for the forecasting of time series, but also provides effective tools for high-frequency strategy design to reduce the investment risks of stock index.     

A super-resolution algorithm for spectral estimation and time series extrapolation

Recent developments in the signal processing field of electrical engineering have resulted in several frequency domain methods of extrapolating a time series. Insight gained in testing one such method, the Papoulis algorithm, has been used to suggest modifications which greatly improve its performance under most operating conditions where real data are concerned. The modified Papoulis method thus developed has been applied to electricity load forecasting over the short and medium term, as well as to world economic and energy data, to assess the cyclic structure present in each series about a trend.     

Recursive estimation and forecasting of non-stationary time series

The paper presents a unified, fully recursive approach to the modelling and forecasting of non-stationary time-series. The basic time-series model, which is based on the well-known ‘component’ or ‘structuraL’ form, is formulated in state-space terms. A novel spectral decomposition procedure, based on the exploitation of recursive smoothing algorithms, is then utilized to simplify the procedures of model identification and estimation. Finally, the fully recursive formulation allows for conventional or self-adaptive implementation of state-space forecasting and seasonal adjustment. Although the paper is restricted to the consideration of univariate time series, the basic approach can be extended to handle explanatory variables or full multivariable (vector) series.     

Exponential smoothing: Estimation by maximum likelihood

In this paper several forecasting methods based on exponential smoothing with an underlying seasonal autoregressive-moving average (SARIMA) model are considered. The relations between the smoothing constants and the coefficients of the autoregressive and moving average polynomials are used. On that basis, a maximum likelihood procedure for parameter estimation is described. The approach rules out the need for initial smoothed values. Prediction intervals are also obtained as a by-product of the approach and a fast algorithm for implementing the method is outlined.     

The role of time series analysis in the evaluation of econometric models

This paper compares the properties of a structural model—the London Business School model of the U.K. economy—with a time series model. Information provided by this type of comparison is a useful diagnostic tool for detecting types of model misspecification. This is a more meaningful way of proceeding rather than attempting to establish the superiority of one type of model over another. In lieu of a better structural model, the effects of inappropriate dynamic specification can be reduced by combining the forecasts of both the structural and time series models. For many variables considered here these provide more accurate forecasts than each of the model types alone.     

A forecasting procedure for nonlinear autoregressive time series models

Forecasting for nonlinear time series is an important topic in time series analysis. Existing numerical algorithms for multi‐step‐ahead forecasting ignore accuracy checking, alternative Monte Carlo methods are also computationally very demanding and their accuracy is difficult to control too. In this paper a numerical forecasting procedure for nonlinear autoregressive time series models is proposed. The forecasting procedure can be used to obtain approximate m‐step‐ahead predictive probability density functions, predictive distribution functions, predictive mean and variance, etc. for a range of nonlinear autoregressive time series models. Examples in the paper show that the forecasting procedure works very well both in terms of the accuracy of the results and in the ability to deal with different nonlinear autoregressive time series models. Copyright © 2005 John Wiley & Sons, Ltd.     

On trend extraction models: Interpretation,empirical evidence and forecasting performance

This paper deals with the economic interpretation of the unobserved components model in the light of the apparent problem posed by previous work in that several practiced methodologies seem to lead to very different models of certain economic variables. A detailed empirical analysis is carried out to show how the failure in obtaining quasi-orthogonal components can seriously bias the interpretation of some decomposition procedures. Finally, the forecasting performance (in both the short and long run) of these decomposition models is analyzed in comparison with other alternatives.     

Assessing time series models for forecasting international migration: Lessons from the United Kingdom

Migration is one of the most unpredictable demographic processes. The aim of this article is to provide a blueprint for assessing various possible forecasting approaches in order to help safeguard producers and users of official migration statistics against misguided forecasts. To achieve that, we first evaluate the various existing approaches to modelling and forecasting of international migration flows. Subsequently, we present an empirical comparison of ex post performance of various forecasting methods, applied to international migration to and from the United Kingdom. The overarching goal is to assess the uncertainty of forecasts produced by using different forecasting methods, both in terms of their errors (biases) and calibration of uncertainty. The empirical assessment, comparing the results of various forecasting models against past migration estimates, confirms the intuition about weak predictability of migration, but also highlights varying levels of forecast errors for different migration streams. There is no single forecasting approach that would be well suited for different flows. We therefore recommend adopting a tailored approach to forecasts, and applying a risk management framework to their results, taking into account the levels of uncertainty of the individual flows, as well as the differences in their potential societal impact.     

Minimum variance prediction of bilinear time series: Direct and adaptive versions

Bilinear models of time series are considered. Minimum variance predictor for bilinear time series, homogeneous in the input and output, is proposed. Results of minimum variance prediction of bilinear time series are included. They are compared to the results of linear prediction of bilinear time series. A minimum variance prediction algorithm for bilinear time series of the general form is developed and an adaptive version of minimum variance algorithm is derived.     

The versatility of spectrum analysis for forecasting financial time series

The versatility of the one‐dimensional discrete wavelet analysis combined with wavelet and Burg extensions for forecasting financial times series with distinctive properties is illustrated with market data. Any time series of financial assets may be decomposed into simpler signals called approximations and details in the framework of the one‐dimensional discrete wavelet analysis. The simplified signals are recomposed after extension. The final output is the forecasted time series which is compared to observed data. Results show the pertinence of adding spectrum analysis to the battery of tools used by econometricians and quantitative analysts for the forecast of economic or financial time series.     

Evidence for the selection of forecasting methods

Reid (1972) was among the first to argue that the relative accuracy of forecasting methods changes according to the properties of the time series. Comparative analyses of forecasting performance such as the M‐Competition tend to support this argument. The issue addressed here is the usefulness of statistics summarizing the data available in a time series in predicting the relative accuracy of different forecasting methods. Nine forecasting methods are described and the literature suggesting summary statistics for choice of forecasting method is summarized. Based on this literature and further argument a set of these statistics is proposed for the analysis. These statistics are used as explanatory variables in predicting the relative performance of the nine methods using a set of simulated time series with known properties. These results are evaluated on observed data sets, the M‐Competition data and Fildes Telecommunications data. The general conclusion is that the summary statistics can be used to select a good forecasting method (or set of methods) but not necessarily the best. Copyright © 2000 John Wiley & Sons, Ltd.     

Order series method for forecasting non‐Gaussian time series

A new forecasting non‐Gaussian time series method based on order series transformation properties has been proposed. The proposed method improves Yu's method without using Hermite polynomial expansion to process nonlinear instantaneous transformations and provides acceptable forecasting accuracy. Copyright © 2007 John Wiley & Sons, Ltd.     

On multistep prediction error methods for time series models

Multistep prediction error methods for linear time series models are considered from both a theoretical and a practical standpoint. The emphasis is on autoregressive moving-average (ARMA) models for which a multistep prediction error estimation method (PEM) is developed. The results of a Monte Carlo simulation study aimed at establishing the possible merits of the multistep PEM are presented.     

Highest-density forecast regions for nonlinear and non-normal time series models

Forecast regions are a common way to summarize forecast accuracy. They usually consist of an interval symmetric about the forecast mean. However, symmetric intervals may not be appropriate forecast regions when the forecast density is not symmetric and unimodal. With many modern time series models, such as those which are non-linear or have non-normal errors, the forecast densities are often asymmetric or multimodal. The problem of obtaining forecast regions in such cases is considered and it is proposed that highest-density forecast regions be used. A graphical method for presenting the results is discussed.     

Requirements for effective use of graphical methods in interactive forecasting

The construction of forecasts using interactive data analysis systems is greatly aided by the availability of graphical procedures. Data exploration, model identification and estimation, and interpretation of final forecasts are made considerably easier by the visual relay of information. This article discusses some recent developments in time series graphics designed to assist in the forecasting process. A discussion of requirerients for effective use of graphics in interactive forecasting is included as illustrated through an application of the Box-Jenkins methodology. Illustrations are included from the STATGRAPHICS system, a prototype implementation in APL.