Exponential smoothing of seasonal data: a comparison

A parsimonious method of exponential smoothing is introduced for time series generated from a combination of local trends and local seasonal effects. It is compared with the additive version of the Holt–Winters method of forecasting on a standard collection of real time series. Copyright © 2001 John Wiley & Sons, Ltd.     

Robust exponential smoothing

The paper is devoted to robust modifications of exponential smoothing for time series with outliers or long-tailed distributions. Classical exponential smoothing applied to such time series is sensitive to the presence of outliers or long-tailed distributions and may give inadequate smoothing and forecasting results. First, simple and double exponential smoothing in the L₁ norm (i.e. based on the least absolute deviations) are discussed in detail. Then, general exponential smoothing is made robust, replacing the least squares approach by M-estimation in such a way that the recursive character of the final formulas is preserved. The paper gives simple algorithmic procedures which preserve advantageous features of classical exponential smoothing and, in addition, which are less sensitive to outliers. Robust versions are compared numerically with classical ones.     

Long‐term sales forecasting using holt–winters and neural network methods

The problem of medium to long‐term sales forecasting raises a number of requirements that must be suitably addressed in the design of the employed forecasting methods. These include long forecasting horizons (up to 52 periods ahead), a high number of quantities to be forecasted, which limits the possibility of human intervention, frequent introduction of new articles (for which no past sales are available for parameter calibration) and withdrawal of running articles. The problem has been tackled by use of a damped‐trend Holt–Winters method as well as feedforward multilayer neural networks (FMNNs) applied to sales data from two German companies. Copyright © 2005 John Wiley & Sons, Ltd.     

Exponential smoothing: The state of the art

This paper is a critical review of exponential smoothing since the original work by Brown and Holt in the 1950s. Exponential smoothing is based on a pragmatic approach to forecasting which is shared in this review. The aim is to develop state-of-the-art guidelines for application of the exponential smoothing methodology. The first part of the paper discusses the class of relatively simple models which rely on the Holt-Winters procedure for seasonal adjustment of the data. Next, we review general exponential smoothing (GES), which uses Fourier functions of time to model seasonality. The research is reviewed according to the following questions. What are the useful properties of these models? What parameters should be used? How should the models be initialized? After the review of model-building, we turn to problems in the maintenance of forecasting systems based on exponential smoothing. Topics in the maintenance area include the use of quality control models to detect bias in the forecast errors, adaptive parameters to improve the response to structural changes in the time series, and two-stage forecasting, whereby we use a model of the errors or some other model of the data to improve our initial forecasts. Some of the major conclusions: the parameter ranges and starting values typically used in practice are arbitrary and may detract from accuracy. The empirical evidence favours Holt's model for trends over that of Brown. A linear trend should be damped at long horizons. The empirical evidence favours the Holt-Winters approach to seasonal data over GES. It is difficult to justify GES in standard form–the equivalent ARIMA model is simpler and more efficient. The cumulative sum of the errors appears to be the most practical forecast monitoring device. There is no evidence that adaptive parameters improve forecast accuracy. In fact, the reverse may be true.     

Forecasting non-seasonal time series with missing observations

Most forecasting methods are based on equally spaced data. In the case of missing observations the methods have to be modified. We have considered three smoothing methods: namely, simple exponential smoothing; double exponential smoothing; and Holt's method. We present a new, unified approach to handle missing data within the smoothing methods. This approach is compared with previously suggested modifications. The comparison is done on 12 real, non-seasonal time series, and shows that the smoothing methods, properly modified, usually perform well if the time series have a moderate number of missing observations.     

On a robust test for SETAR‐type nonlinearity in time series analysis

There has been growing interest in exploiting potential forecast gains from the nonlinear structure of self‐exciting threshold autoregressive (SETAR) models. Statistical tests have been proposed in the literature to help analysts check for the presence of SETAR‐type nonlinearities in observed time series. However, previous studies show that classical nonlinearity tests are not robust to additive outliers. In practice, time series outliers are not uncommonly encountered. It is important to develop a more robust test for SETAR‐type nonlinearity in time series analysis and forecasting. In this paper we propose a new robust nonlinearity test and the asymptotic null distribution of the test statistic is derived. A Monte Carlo experiment is carried out to compare the power of the proposed test with other existing tests under the influence of time series outliers. The effects of additive outliers on nonlinearity tests with misspecification of the autoregressive order are also studied. The results indicate that the proposed method is preferable to the classical tests when the observations are contaminated with outliers. Finally, we provide illustrative examples by applying the statistical tests to three real datasets. Copyright © 2009 John Wiley & Sons, Ltd.     

Forecasting Simultaneously High‐Dimensional Time Series: A Robust Model‐Based Clustering Approach

This paper considers the problem of forecasting high‐dimensional time series. It employs a robust clustering approach to perform classification of the component series. Each series within a cluster is assumed to follow the same model and the data are then pooled for estimation. The classification is model‐based and robust to outlier contamination. The robustness is achieved by using the intrinsic mode functions of the Hilbert–Huang transform at lower frequencies. These functions are found to be robust to outlier contamination. The paper also compares out‐of‐sample forecast performance of the proposed method with several methods available in the literature. The other forecasting methods considered include vector autoregressive models with ∕ without LASSO, group LASSO, principal component regression, and partial least squares. The proposed method is found to perform well in out‐of‐sample forecasting of the monthly unemployment rates of 50 US states. Copyright © 2013 John Wiley & Sons, Ltd.     

A non‐Gaussian generalization of the Airline model for robust seasonal adjustment

In their seminal book Time Series Analysis: Forecasting and Control, Box and Jenkins (1976) introduce the Airline model, which is still routinely used for the modelling of economic seasonal time series. The Airline model is for a differenced time series (in levels and seasons) and constitutes a linear moving average of lagged Gaussian disturbances which depends on two coefficients and a fixed variance. In this paper a novel approach to seasonal adjustment is developed that is based on the Airline model and that accounts for outliers and breaks in time series. For this purpose we consider the canonical representation of the Airline model. It takes the model as a sum of trend, seasonal and irregular (unobserved) components which are uniquely identified as a result of the canonical decomposition. The resulting unobserved components time series model is extended by components that allow for outliers and breaks. When all components depend on Gaussian disturbances, the model can be cast in state space form and the Kalman filter can compute the exact log‐likelihood function. Related filtering and smoothing algorithms can be used to compute minimum mean squared error estimates of the unobserved components. However, the outlier and break components typically rely on heavy‐tailed densities such as the t or the mixture of normals. For this class of non‐Gaussian models, Monte Carlo simulation techniques will be used for estimation, signal extraction and seasonal adjustment. This robust approach to seasonal adjustment allows outliers to be accounted for, while keeping the underlying structures that are currently used to aid reporting of economic time series data. Copyright © 2006 John Wiley & Sons, Ltd.     

An intelligent model selection and forecasting system

In this paper we present an intelligent decision‐support system based on neural network technology for model selection and forecasting. While most of the literature on the application of neural networks in forecasting addresses the use of neural network technology as an alternative forecasting tool, limited research has focused on its use for selection of forecasting methods based on time‐series characteristics. In this research, a neural network‐based decision support system is presented as a method for forecast model selection. The neural network approach provides a framework for directly incorporating time‐series characteristics into the model‐selection phase. Using a neural network, a forecasting group is initially selected for a given data set, based on a set of time‐series characteristics. Then, using an additional neural network, a specific forecasting method is selected from a pool of three candidate methods. The results of training and testing of the networks are presented along with conclusions. Copyright © 1999 John Wiley & Sons, Ltd.     

On robust estimation of threshold autoregressions

We investigate the effects of additive outliers on the least squares (LS) estimation of threshold autoregressive models. The class of generalized-M (GM) estimates for linear time series is modified and applied to non-linear threshold processes. A Monte Carlo experiment is carried out to study the robust properties of these estimates. Their relative forecasting performances are also examined. The results indicate that the GM method is preferable to the LS estimation when the observations are contaminated by additive outliers. A real example is also given to illustrate the proposed method.     

Time series forecasting using robust regression

The method of ordinary least squares (OLS) and generalizations of it have been the mainstay of most forecasting methodologies for many years. It is well-known, however, that outliers or unusual values can have a large influence on least-squares estimators. Users of automatic forecasting packages, in particular, need to be aware of the influence that outlying data values can have on statistical analyses and forecasting results. Robust methods are available to modify least-squares procedures so that outliers have much less influence on the final estimates; yet these formal methods have not found their way into general forecasting procedures. This paper provides a case study in which classical least-square-estimation procedures are complemented with a robust alternative to enhance statistical fit criteria and improve forecasting performance. The study suggests that much can be gained in understanding the nature of outliers and their influence on forecasting performance by performing a robust regression in addition to OLS.     

A Robust Test for Threshold‐Type Nonlinearity in Multivariate Time Series Analysis

There is growing interest in exploring potential forecast gains from the nonlinear structure of multivariate threshold autoregressive (MTAR) models. A least squares‐based statistical test has been proposed in the literature. However, previous studies on univariate time series analysis show that classical nonlinearity tests are often not robust to additive outliers. The outlier problem is expected to pose similar difficulties for multivariate nonlinearity tests. In this paper, we propose a new and robust MTAR‐type nonlinearity test, and derive the asymptotic null distribution of the test statistic. A Monte Carlo experiment is carried out to compare the power of the proposed test with that of the least squares‐based test under the influence of additive time series outliers. The results indicate that the proposed method is preferable to the classical test when observations are contaminated by outliers. Finally, we provide illustrative examples by applying the statistical tests to two real datasets. Copyright © 2015 John Wiley & Sons, Ltd.     

Smooth transition exponential smoothing

Adaptive exponential smoothing methods allow a smoothing parameter to change over time, in order to adapt to changes in the characteristics of the time series. However, these methods have tended to produce unstable forecasts and have performed poorly in empirical studies. This paper presents a new adaptive method, which enables a smoothing parameter to be modelled as a logistic function of a user‐specified variable. The approach is analogous to that used to model the time‐varying parameter in smooth transition models. Using simulated data, we show that the new approach has the potential to outperform existing adaptive methods and constant parameter methods when the estimation and evaluation samples both contain a level shift or both contain an outlier. An empirical study, using the monthly time series from the M3‐Competition, gave encouraging results for the new approach. Copyright © 2004 John Wiley & Sons, Ltd.     

Exponentially Smoothing the Skewed Laplace Distribution for Value‐at‐Risk Forecasting

Value‐at‐risk (VaR) is a standard measure of market risk in financial markets. This paper proposes a novel, adaptive and efficient method to forecast both volatility and VaR. Extending existing exponential smoothing as well as GARCH formulations, the method is motivated from an asymmetric Laplace distribution, where skewness and heavy tails in return distributions, and their potentially time‐varying nature, are taken into account. The proposed volatility equation also involves novel time‐varying dynamics. Back‐testing results illustrate that the proposed method offers a viable, and more accurate, though conservative, improvement in forecasting VaR compared to a range of popular alternatives. Copyright © 2013 John Wiley & Sons, Ltd.     

Real‐time or current vintage: does the type of data matter for forecasting and model selection?

In this paper we investigate the impact of data revisions on forecasting and model selection procedures. A linear ARMA model and nonlinear SETAR model are considered in this study. Two Canadian macroeconomic time series have been analyzed: the real‐time monetary aggregate M3 (1977–2000) and residential mortgage credit (1975–1998). The forecasting method we use is multi‐step‐ahead non‐adaptive forecasting. Copyright © 2008 John Wiley & Sons, Ltd.     

The wavelet scaling approach to forecasting: Verification on a large set of Noisy data

In the paper, we undertake a detailed empirical verification of wavelet scaling as a forecasting method through its application to a large set of noisy data. The method consists of two steps. In the first, the data are smoothed with the help of wavelet estimators of stochastic signals based on the idea of scaling, and, in the second, an AR(I)MA model is built on the estimated signal. This procedure is compared with some alternative approaches encompassing exponential smoothing, moving average, AR(I)MA and regularized AR models. Special attention is given to the ways of treating boundary regions in the wavelet signal estimation and to the use of biased, weakly biased and unbiased estimators of the wavelet variance. According to a collection of popular forecast accuracy measures, when applied to noisy time series with a high level of noise, wavelet scaling is able to outperform the other forecasting procedures, although this conclusion applies mainly to longer time series and not uniformly across all the examined accuracy measures.     

Ensemble Forecasting for Complex Time Series Using Sparse Representation and Neural Networks

Based on the concept of ‘decomposition and ensemble’, a novel ensemble forecasting approach is proposed for complex time series by coupling sparse representation (SR) and feedforward neural network (FNN), i.e. the SR‐based FNN approach. Three main steps are involved: data decomposition via SR, individual forecasting via FNN and ensemble forecasting via a simple addition method. In particular, to capture various coexisting hidden factors, the effective decomposition tool of SR with its unique virtues of flexibility and generalization is introduced to formulate an overcomplete dictionary covering diverse bases, e.g. exponential basis for main trend, Fourier basis for cyclical (and seasonal) features and wavelet basis for transient actions, different from other techniques with a single basis. Using crude oil price (a typical complex time series) as sample data, the empirical study statistically confirms the superiority of the SR‐based FNN method over some other popular forecasting models and similar ensemble models (with other decomposition tools). Copyright © 2016 John Wiley & Sons, Ltd.     

Robustness of alternative non‐linearity tests for SETAR models

In recent years there has been a growing interest in exploiting potential forecast gains from the non‐linear structure of self‐exciting threshold autoregressive (SETAR) models. Statistical tests have been proposed in the literature to help analysts check for the presence of SETAR‐type non‐linearities in an observed time series. It is important to study the power and robustness properties of these tests since erroneous test results might lead to misspecified prediction problems. In this paper we investigate the robustness properties of several commonly used non‐linearity tests. Both the robustness with respect to outlying observations and the robustness with respect to model specification are considered. The power comparison of these testing procedures is carried out using Monte Carlo simulation. The results indicate that all of the existing tests are not robust to outliers and model misspecification. Finally, an empirical application applies the statistical tests to stock market returns of the four little dragons (Hong Kong, South Korea, Singapore and Taiwan) in East Asia. The non‐linearity tests fail to provide consistent conclusions most of the time. The results in this article stress the need for a more robust test for SETAR‐type non‐linearity in time series analysis and forecasting. Copyright © 2004 John Wiley & Sons, Ltd.     

Time series forecasting using functional partial least square regression with stochastic volatility,GARCH, and exponential smoothing

We propose a method for improving the predictive ability of standard forecasting models used in financial economics. Our approach is based on the functional partial least squares (FPLS) model, which is capable of avoiding multicollinearity in regression by efficiently extracting information from the high‐dimensional market data. By using its well‐known ability, we can incorporate auxiliary variables that improve the predictive accuracy. We provide an empirical application of our proposed methodology in terms of its ability to predict the conditional average log return and the volatility of crude oil prices via exponential smoothing, Bayesian stochastic volatility, and GARCH (generalized autoregressive conditional heteroskedasticity) models, respectively. In particular, what we call functional data analysis (FDA) traces in this article are obtained via the FPLS regression from both the crude oil returns and auxiliary variables of the exchange rates of major currencies. For forecast performance evaluation, we compare out‐of‐sample forecasting accuracy of the standard models with FDA traces to the accuracy of the same forecasting models with the observed crude oil returns, principal component regression (PCR), and least absolute shrinkage and selection operator (LASSO) models. We find evidence that the standard models with FDA traces significantly outperform our competing models. Finally, they are also compared with the test for superior predictive ability and the reality check for data snooping. Our empirical results show that our new methodology significantly improves predictive ability of standard models in forecasting the latent average log return and the volatility of financial time series.     

A new Bayesian formulation for Holt's exponential smoothing

In this paper we propose a Bayesian forecasting approach for Holt's additive exponential smoothing method. Starting from the state space formulation, a formula for the forecast is derived and reduced to a two‐dimensional integration that can be computed numerically in a straightforward way. In contrast to much of the work for exponential smoothing, this method produces the forecast density and, in addition, it considers the initial level and initial trend as part of the parameters to be evaluated. Another contribution of this paper is that we have derived a way to reduce the computation of the maximum likelihood parameter estimation procedure to that of evaluating a two‐dimensional grid, rather than applying a five‐variable optimization procedure. Simulation experiments confirm that both proposed methods give favorable performance compared to other approaches. Copyright © 2008 John Wiley & Sons, Ltd.