Predictive likelihood for coherent forecasting of count time series

A new forecasting method based on the concept of the profile predictive likelihood function is proposed for discrete‐valued processes. In particular, generalized autoregressive moving average (GARMA) models for Poisson distributed data are explored in detail. Highest density regions are used to construct forecasting regions. The proposed forecast estimates and regions are coherent. Large‐sample results are derived for the forecasting distribution. Numerical studies using simulations and two real data sets are used to establish the performance of the proposed forecasting method. Robustness of the proposed method to possible misspecifications in the model is also studied.     

A forecasting procedure for nonlinear autoregressive time series models

Forecasting for nonlinear time series is an important topic in time series analysis. Existing numerical algorithms for multi‐step‐ahead forecasting ignore accuracy checking, alternative Monte Carlo methods are also computationally very demanding and their accuracy is difficult to control too. In this paper a numerical forecasting procedure for nonlinear autoregressive time series models is proposed. The forecasting procedure can be used to obtain approximate m‐step‐ahead predictive probability density functions, predictive distribution functions, predictive mean and variance, etc. for a range of nonlinear autoregressive time series models. Examples in the paper show that the forecasting procedure works very well both in terms of the accuracy of the results and in the ability to deal with different nonlinear autoregressive time series models. Copyright © 2005 John Wiley & Sons, Ltd.     

Selection and estimation of component models for seasonal time series

We present a method for investigating the evolution of trend and seasonality in an observed time series. A general model is fitted to a residual spectrum, using components to represent the seasonality. We show graphically how well the fitted spectrum captures the evidence for evolving seasonality associated with the different seasonal frequencies. We apply the method to model two time series and illustrate the resulting forecasts and seasonal adjustment for one series. Copyright © 2000 John Wiley & Sons, Ltd.     

ARIMA model building and the time series analysis approach to forecasting

This paper reviews the approach to forecasting based on the construction of ARIMA time series models. Recent developments in this area are surveyed, and the approach is related to other forecasting methodologies.     

Modeling and forecasting time series with a general non-normal distribution

We propose a model for time series with a general marginal distribution given by the Johnson family of distributions. We investigate for which Johnson distributions forecasting using the model is likely to be most effective compared to using a linear model. Monte Carlo simulation is used to assess the reliability of methods for determining which of the three Johnson forms is most appropriate for a given series. Finally, we give model fitting and forecasting results using the modeling procedure on a selection of simulated and real time series.     

Estimation procedures for structural time series models

A univariate structural time series model based on the traditional decomposition into trend, seasonal and irregular components is defined. A number of methods of computing maximum likelihood estimators are then considered. These include direct maximization of various time domain likelihood function. The asymptotic properties of the estimators are given and a comparison between the various methods in terms of computational efficiency and accuracy is made. The methods are then extended to models with explanatory variables.     

Nonparametric density forecast based on time‐ and state‐domain

We propose a new nonparametric density forecast based on time‐ and state‐domain smoothing. We analyze some of its asymptotic properties and provide an empirical illustration. Copyright © 2010 John Wiley & Sons, Ltd.     

Selection of the relevant information set for predictive relationships analysis between time series

In time series analysis, a vector Y is often called causal for another vector X if the former helps to improve the k‐step‐ahead forecast of the latter. If this holds for k=1, vector Y is commonly called Granger‐causal for X . It has been shown in several studies that the finding of causality between two (vectors of) variables is not robust to changes of the information set. In this paper, using the concept of Hilbert spaces, we derive a condition under which the predictive relationships between two vectors are invariant to the selection of a bivariate or trivariate framework. In more detail, we provide a condition under which the finding of causality (improved predictability at forecast horizon 1) respectively non‐causality of Y for X is unaffected if the information set is either enlarged or reduced by the information in a third vector Z . This result has a practical usefulness since it provides a guidance to validate the choice of the bivariate system { X , Y } in place of { X , Y , Z }. In fact, to test the ‘goodness’ of { X , Y } we should test whether Z Granger cause X not requiring the joint analysis of all variables in { X , Y , Z }. Copyright © 2002 John Wiley & Sons, Ltd.     

Real‐time inflation forecast combination for time‐varying coefficient models

We use real‐time macroeconomic variables and combination forecasts with both time‐varying weights and equal weights to forecast inflation in the USA. The combination forecasts compare three sets of commonly used time‐varying coefficient autoregressive models: Gaussian distributed errors, errors with stochastic volatility, and errors with moving average stochastic volatility. Both point forecasts and density forecasts suggest that models combined by equal weights do not produce worse forecasts than those with time‐varying weights. We also find that variable selection, the allowance of time‐varying lag length choice, and the stochastic volatility specification significantly improve forecast performance over standard benchmarks. Finally, when compared with the Survey of Professional Forecasters, the results of the best combination model are found to be highly competitive during the 2007/08 financial crisis.     

Forecasting with latent structure time series models: an application to nominal interest rates

In this paper we develop a latent structure extension of a commonly used structural time series model and use the model as a basis for forecasting. Each unobserved regime has its own unique slope and variances to describe the process generating the data, and at any given time period the model predicts a priori which regime best characterizes the data. This is accomplished by using a multinomial logit model in which the primary explanatory variable is a measure of how consistent each regime has been with recent observations. The model is especially well suited to forecasting series which are subject to frequent and/or major shocks. An application to nominal interest rates shows that the behaviour of the three‐month US Treasury bill rate is adequately explained by three regimes. The forecasting accuracy is superior to that produced by a traditional single‐regime model and a standard ARIMA model with a conditionally heteroscedastic error. Copyright © 1999 John Wiley & Sons, Ltd.     

Building neural network models for time series: a statistical approach

This paper is concerned with modelling time series by single hidden layer feedforward neural network models. A coherent modelling strategy based on statistical inference is presented. Variable selection is carried out using simple existing techniques. The problem of selecting the number of hidden units is solved by sequentially applying Lagrange multiplier type tests, with the aim of avoiding the estimation of unidentified models. Misspecification tests are derived for evaluating an estimated neural network model. All the tests are entirely based on auxiliary regressions and are easily implemented. A small‐sample simulation experiment is carried out to show how the proposed modelling strategy works and how the misspecification tests behave in small samples. Two applications to real time series, one univariate and the other multivariate, are considered as well. Sets of one‐step‐ahead forecasts are constructed and forecast accuracy is compared with that of other nonlinear models applied to the same series. Copyright © 2006 John Wiley & Sons, Ltd.     

Deletion diagnostics for transformations of time series

Deletion diagnostics are derived for the effect of individual observations on the estimated transformation of a time series. The paper uses the modified power transformation of Box and Cox to provide a parametric family of transformations. Inference about the transformation parameter is made through regression on a constructed variable. The effect of deletion of observations on residuals and on the estimate of the regression parameter are obtained. Index plots of the diagnostic quantities are shown to be highly informative. Structural time series modelling is used, so that the results readily extend to inference about regression on other explanatory variables.     

Misspecified prediction for time series

Let {X_t} be a stationary process with spectral density g(λ).It is often that the true structure g(λ) is not completely specified. This paper discusses the problem of misspecified prediction when a conjectured spectral density f_θ(λ), θ∈Θ, is fitted to g(λ). Then, constructing the best linear predictor based on f_θ(λ), we can evaluate the prediction error M(θ). Since θ is unknown we estimate it by a quasi‐MLE . The second‐order asymptotic approximation of is given. This result is extended to the case when X_t contains some trend, i.e. a time series regression model. These results are very general. Furthermore we evaluate the second‐order asymptotic approximation of for a time series regression model having a long‐memory residual process with the true spectral density g(λ). Since the general formulae of the approximated prediction error are complicated, we provide some numerical examples. Then we illuminate unexpected effects from the misspecification of spectra. Copyright © 2001 John Wiley & Sons, Ltd.     

On a robust test for SETAR‐type nonlinearity in time series analysis

There has been growing interest in exploiting potential forecast gains from the nonlinear structure of self‐exciting threshold autoregressive (SETAR) models. Statistical tests have been proposed in the literature to help analysts check for the presence of SETAR‐type nonlinearities in observed time series. However, previous studies show that classical nonlinearity tests are not robust to additive outliers. In practice, time series outliers are not uncommonly encountered. It is important to develop a more robust test for SETAR‐type nonlinearity in time series analysis and forecasting. In this paper we propose a new robust nonlinearity test and the asymptotic null distribution of the test statistic is derived. A Monte Carlo experiment is carried out to compare the power of the proposed test with other existing tests under the influence of time series outliers. The effects of additive outliers on nonlinearity tests with misspecification of the autoregressive order are also studied. The results indicate that the proposed method is preferable to the classical tests when the observations are contaminated with outliers. Finally, we provide illustrative examples by applying the statistical tests to three real datasets. Copyright © 2009 John Wiley & Sons, Ltd.     

Order series method for forecasting non‐Gaussian time series

A new forecasting non‐Gaussian time series method based on order series transformation properties has been proposed. The proposed method improves Yu's method without using Hermite polynomial expansion to process nonlinear instantaneous transformations and provides acceptable forecasting accuracy. Copyright © 2007 John Wiley & Sons, Ltd.     

Updating the forecast function of ARIMA models and the link with DLMs

This paper shows that the whole forecast function of ARIMA time series models, and not just the eventual forecast function, may be updated each time an observation is received. The paper also shows that the coefficients in the updating equations for the forecast function may be expressed in exactly the same form as the Kalman filter updating equations for canonical time series DLMs. Moreover, the adaptive factors in the updating equations are shown to be a simple function of the ARIMA model parameters. Copyright © 1999 John Wiley & Sons, Ltd.     

A comparison of approximate Bayesian forecasting methods for non‐Gaussian time series

We present the results on the comparison of efficiency of approximate Bayesian methods for the analysis and forecasting of non‐Gaussian dynamic processes. A numerical algorithm based on MCMC methods has been developed to carry out the Bayesian analysis of non‐linear time series. Although the MCMC‐based approach is not fast, it allows us to study the efficiency, in predicting future observations, of approximate propagation procedures that, being algebraic, have the practical advantage of being very quick. Copyright © 2000 John Wiley & Sons, Ltd.     

The role of time series analysis in the evaluation of econometric models

This paper compares the properties of a structural model—the London Business School model of the U.K. economy—with a time series model. Information provided by this type of comparison is a useful diagnostic tool for detecting types of model misspecification. This is a more meaningful way of proceeding rather than attempting to establish the superiority of one type of model over another. In lieu of a better structural model, the effects of inappropriate dynamic specification can be reduced by combining the forecasts of both the structural and time series models. For many variables considered here these provide more accurate forecasts than each of the model types alone.     

ARARMA models for time series analysis and forecasting

Methods of time series forecasting are proposed which can be applied automatically. However, they are not rote formulae, since they are based on a flexible philosophy which can provide several models for consideration. In addition it provides diverse diagnostics for qualitatively and quantitatively estimating how well one can forecast a series. The models considered are called ARARMA models (or ARAR models) because the model fitted to a long memory time series (t) is based on sophisticated time series analysis of AR (or ARMA) schemes (short memory models) fitted to residuals Y(t) obtained by parsimonious‘best lag’non-stationary autoregression. Both long range and short range forecasts are provided by an ARARMA model Section 1 explains the philosophy of our approach to time series model identification. Sections 2 and 3 attempt to relate our approach to some standard approaches to forecasting; exponential smoothing methods are developed from the point of view of prediction theory (section 2) and extended (section 3). ARARMA models are introduced (section 4). Methods of ARARMA model fitting are outlined (sections 5,6). Since‘the proof of the pudding is in the eating’, the methods proposed are illustrated (section 7) using the classic example of international airline passengers.     

Modelling time series with season‐dependent autocorrelation structure

Time series with season‐dependent autocorrelation structure are commonly modelled using periodic autoregressive moving average (PARMA) processes. In most applications, the moving average terms are excluded for ease of estimation. We propose a new class of periodic unobserved component models (PUCM). Parameter estimates for PUCM are readily interpreted; the estimated coefficients correspond to variances of the measurement noise and of the error terms in unobserved components. We show that PUCM have correlation structure equivalent to that of a periodic integrated moving average (PIMA) process. Results from practical applications indicate that our models provide a natural framework for series with periodic autocorrelation structure both in terms of interpretability and forecasting accuracy. Copyright © 2008 John Wiley & Sons, Ltd.