Forecasting technique familiarity,satisfaction, usage,and application

A ten-year retrospective study of Mentzer and Cox (1984) was undertaken to answer the question 'Have sales forecasting practices changed over the past ten years?' A mail survey of 207 forecasting executives was employed to investigate this important question. Findings revealed both discrepancies and similarities between today's sales forecasting practices and those of ten years ago. One particular finding indicated greater reliance on and satisfaction with quantitative forecasting techniques today versus ten years ago. Another indicated that forecasting accuracy has not improved over the past ten years, even though the familiarity and usage of various sophisticated sales forecasting techniques have increased. Future research and managerial implications are discussed based on these and other findings.     

Can cointegration‐based forecasting outperform univariate models? An application to Asian exchange rates

Conventional wisdom holds that restrictions on low‐frequency dynamics among cointegrated variables should provide more accurate short‐ to medium‐term forecasts than univariate techniques that contain no such information; even though, on standard accuracy measures, the information may not improve long‐term forecasting. But inconclusive empirical evidence is complicated by confusion about an appropriate accuracy criterion and the role of integration and cointegration in forecasting accuracy. We evaluate the short‐ and medium‐term forecasting accuracy of univariate Box–Jenkins type ARIMA techniques that imply only integration against multivariate cointegration models that contain both integration and cointegration for a system of five cointegrated Asian exchange rate time series. We use a rolling‐window technique to make multiple out of sample forecasts from one to forty steps ahead. Relative forecasting accuracy for individual exchange rates appears to be sensitive to the behaviour of the exchange rate series and the forecast horizon length. Over short horizons, ARIMA model forecasts are more accurate for series with moving‐average terms of order >1. ECMs perform better over medium‐term time horizons for series with no moving average terms. The results suggest a need to distinguish between ‘sequential’ and ‘synchronous’ forecasting ability in such comparisons. Copyright © 2002 John Wiley & Sons, Ltd.     

Familiarity,application, and performance of sales forecasting techniques

This article presents the results of a survey to determine the degree of familiarity and usage, accuracy obtained, and evaluation of different forecasting techniques. It was found that regression analysis, subjective techniques, exponential smoothing, and moving average were well known and used for specific situations. Accuracy was relatively high for aggregate short range forecasts, but decreased for longer range and product level forecasts.     

Evaluation of correlation forecasting models for risk management

Reliable correlation forecasts are of paramount importance in modern risk management systems. A plethora of correlation forecasting models have been proposed in the open literature, yet their impact on the accuracy of value‐at‐risk calculations has not been explicitly investigated. In this paper, traditional and modern correlation forecasting techniques are compared using standard statistical and risk management loss functions. Three portfolios consisting of stocks, bonds and currencies are considered. We find that GARCH models can better account for the correlation's dynamic structure in the stock and bond portfolios. On the other hand, simpler specifications such as the historical mean model or simple moving average models are better suited for the currency portfolio. Copyright © 2007 John Wiley & Sons, Ltd.     

A forecasting procedure for nonlinear autoregressive time series models

Forecasting for nonlinear time series is an important topic in time series analysis. Existing numerical algorithms for multi‐step‐ahead forecasting ignore accuracy checking, alternative Monte Carlo methods are also computationally very demanding and their accuracy is difficult to control too. In this paper a numerical forecasting procedure for nonlinear autoregressive time series models is proposed. The forecasting procedure can be used to obtain approximate m‐step‐ahead predictive probability density functions, predictive distribution functions, predictive mean and variance, etc. for a range of nonlinear autoregressive time series models. Examples in the paper show that the forecasting procedure works very well both in terms of the accuracy of the results and in the ability to deal with different nonlinear autoregressive time series models. Copyright © 2005 John Wiley & Sons, Ltd.     

An intelligent model selection and forecasting system

In this paper we present an intelligent decision‐support system based on neural network technology for model selection and forecasting. While most of the literature on the application of neural networks in forecasting addresses the use of neural network technology as an alternative forecasting tool, limited research has focused on its use for selection of forecasting methods based on time‐series characteristics. In this research, a neural network‐based decision support system is presented as a method for forecast model selection. The neural network approach provides a framework for directly incorporating time‐series characteristics into the model‐selection phase. Using a neural network, a forecasting group is initially selected for a given data set, based on a set of time‐series characteristics. Then, using an additional neural network, a specific forecasting method is selected from a pool of three candidate methods. The results of training and testing of the networks are presented along with conclusions. Copyright © 1999 John Wiley & Sons, Ltd.     

A wavelet approach for factor‐augmented forecasting

It has been acknowledged that wavelets can constitute a useful tool for forecasting in economics. Through a wavelet multi‐resolution analysis, a time series can be decomposed into different timescale components and a model can be fitted to each component to improve the forecast accuracy of the series as a whole. Up to now, the literature on forecasting with wavelets has mainly focused on univariate modelling. On the other hand, in a context of growing data availability, a line of research has emerged on forecasting with large datasets. In particular, the use of factor‐augmented models have become quite widespread in the literature and among practitioners. The aim of this paper is to bridge the two strands of the literature. A wavelet approach for factor‐augmented forecasting is proposed and put to test for forecasting GDP growth for the major euro area countries. The results show that the forecasting performance is enhanced when wavelets and factor‐augmented models are used together. Copyright © 2010 John Wiley & Sons, Ltd.     

Comparison of forecasting performances: Does normalization and variance stabilization method beat GARCH(1,1)‐type models? Empirical evidence from the stock markets

In this paper, we present a comparison between the forecasting performances of the normalization and variance stabilization method (NoVaS) and the GARCH(1,1), EGARCH(1,1) and GJR‐GARCH(1,1) models. Hence the aim of this study is to compare the out‐of‐sample forecasting performances of the models used throughout the study and to show that the NoVaS method is better than GARCH(1,1)‐type models in the context of out‐of sample forecasting performance. We study the out‐of‐sample forecasting performances of GARCH(1,1)‐type models and NoVaS method based on generalized error distribution, unlike normal and Student's t‐distribution. Also, what makes the study different is the use of the return series, calculated logarithmically and arithmetically in terms of forecasting performance. For comparing the out‐of‐sample forecasting performances, we focused on different datasets, such as S&P 500, logarithmic and arithmetic B?ST 100 return series. The key result of our analysis is that the NoVaS method performs better out‐of‐sample forecasting performance than GARCH(1,1)‐type models. The result can offer useful guidance in model building for out‐of‐sample forecasting purposes, aimed at improving forecasting accuracy.     

Traditional versus novel forecasting techniques: how much do we gain?

This article applies two novel techniques to forecast the value of US manufacturing shipments over the period 1956–2000: wavelets and support vector machines (SVM). Wavelets have become increasingly popular in the fields of economics and finance in recent years, whereas SVM has emerged as a more user‐friendly alternative to artificial neural networks. These two methodologies are compared with two well‐known time series techniques: multiplicative seasonal autoregressive integrated moving average (ARIMA) and unobserved components (UC). Based on forecasting accuracy and encompassing tests, and forecasting combination, we conclude that UC and ARIMA generally outperform wavelets and SVM. However, in some cases the latter provide valuable forecasting information that it is not contained in the former. Copyright © 2008 John Wiley & Sons, Ltd.     

Assessing the forecasting accuracy of alternative nominal exchange rate models: the case of long memory

This paper presents an autoregressive fractionally integrated moving‐average (ARFIMA) model of nominal exchange rates and compares its forecasting capability with the monetary structural models and the random walk model. Monthly observations are used for Canada, France, Germany, Italy, Japan and the United Kingdom for the period of April 1973 through December 1998. The estimation method is Sowell's (1992) exact maximum likelihood estimation. The forecasting accuracy of the long‐memory model is formally compared to the random walk and the monetary models, using the recently developed Harvey, Leybourne and Newbold (1997) test statistics. The results show that the long‐memory model is more efficient than the random walk model in steps‐ahead forecasts beyond 1 month for most currencies and more efficient than the monetary models in multi‐step‐ahead forecasts. This new finding strongly suggests that the long‐memory model of nominal exchange rates be studied as a viable alternative to the conventional models. Copyright © 2006 John Wiley & Sons, Ltd.     

Multi‐step forecasting for long‐memory processes

In this paper we present results of a simulation study to assess and compare the accuracy of forecasting techniques for long‐memory processes in small sample sizes. We analyse differences between adaptive ARMA(1,1) L‐step forecasts, where the parameters are estimated by minimizing the sum of squares of L‐step forecast errors, and forecasts obtained by using long‐memory models. We compare widths of the forecast intervals for both methods, and discuss some computational issues associated with the ARMA(1,1) method. Our results illustrate the importance and usefulness of long‐memory models for multi‐step forecasting. Copyright © 1999 John Wiley & Sons, Ltd.     

On forecasting counts

Forecasting for a time series of low counts, such as forecasting the number of patents to be awarded to an industry, is an important research topic in socio‐economic sectors. Recently (2004), Freeland and McCabe introduced a Gaussian type stationary correlation model‐based forecasting which appears to work well for the stationary time series of low counts. In practice, however, it may happen that the time series of counts will be non‐stationary and also the series may contain over‐dispersed counts. To develop the forecasting functions for this type of non‐stationary over‐dispersed data, the paper provides an extension of the stationary correlation models for Poisson counts to the non‐stationary correlation models for negative binomial counts. The forecasting methodology appears to work well, for example, for a US time series of polio counts, whereas the existing Bayesian methods of forecasting appear to encounter serious convergence problems. Further, a simulation study is conducted to examine the performance of the proposed forecasting functions, which appear to work well irrespective of whether the time series contains small or large counts. Copyright © 2008 John Wiley & Sons, Ltd.     

Multi‐step forecasting in the presence of breaks

This paper analyzes the relative performance of multi‐step AR forecasting methods in the presence of breaks and data revisions. Our Monte Carlo simulations indicate that the type and timing of the break affect the relative accuracy of the methods. The iterated autoregressive method typically produces more accurate point and density forecasts than the alternative multi‐step AR methods in unstable environments, especially if the parameters are subject to small breaks. This result holds regardless of whether data revisions add news or reduce noise. Empirical analysis of real‐time US output and inflation series shows that the alternative multi‐step methods only episodically improve upon the iterated method.     

Robust forecasting with exponential and Holt–Winters smoothing

Robust versions of the exponential and Holt–Winters smoothing method for forecasting are presented. They are suitable for forecasting univariate time series in the presence of outliers. The robust exponential and Holt–Winters smoothing methods are presented as recursive updating schemes that apply the standard technique to pre‐cleaned data. Both the update equation and the selection of the smoothing parameters are robustified. A simulation study compares the robust and classical forecasts. The presented method is found to have good forecast performance for time series with and without outliers, as well as for fat‐tailed time series and under model misspecification. The method is illustrated using real data incorporating trend and seasonal effects. Copyright © 2009 John Wiley & Sons, Ltd.     

Robust model rankings of forecasting performance

This paper investigates robust model rankings in out‐of‐sample, short‐horizon forecasting. We provide strong evidence that rolling window averaging consistently produces robust model rankings while improving the forecasting performance of both individual models and model averaging. The rolling window averaging outperforms the (ex post) “optimal” window forecasts in more than 50% of the times across all rolling windows.     

Adaptive forecasting of the EURIBOR swap term structure

In this paper we adopt a principal components analysis (PCA) to reduce the dimensionality of the term structure and employ autoregressive (AR) models to forecast principal components which, in turn, are used to forecast swap rates. Arguing in favour of structural variation, we propose data‐driven, adaptive model selection strategies based on the PCA/AR model. To evaluate ex ante forecasting performance for particular rates, distinct forecast features, such as mean squared errors, directional accuracy and directional forecast value, are considered. It turns out that, relative to benchmark models, the adaptive approach offers additional forecast accuracy in terms of directional accuracy and directional forecast value. Copyright © 2009 John Wiley & Sons, Ltd.     

Short‐term salmon price forecasting

This study establishes a benchmark for short‐term salmon price forecasting. The weekly spot price of Norwegian farmed Atlantic salmon is predicted 1–5 weeks ahead using data from 2007 to 2014. Sixteen alternative forecasting methods are considered, ranging from classical time series models to customized machine learning techniques to salmon futures prices. The best predictions are delivered by k‐nearest neighbors method for 1 week ahead; vector error correction model estimated using elastic net regularization for 2 and 3 weeks ahead; and futures prices for 4 and 5 weeks ahead. While the nominal gains in forecast accuracy over a naïve benchmark are small, the economic value of the forecasts is considerable. Using a simple trading strategy for timing the sales based on price forecasts could increase the net profit of a salmon farmer by around 7%.     

Time series forecasting using functional partial least square regression with stochastic volatility,GARCH, and exponential smoothing

We propose a method for improving the predictive ability of standard forecasting models used in financial economics. Our approach is based on the functional partial least squares (FPLS) model, which is capable of avoiding multicollinearity in regression by efficiently extracting information from the high‐dimensional market data. By using its well‐known ability, we can incorporate auxiliary variables that improve the predictive accuracy. We provide an empirical application of our proposed methodology in terms of its ability to predict the conditional average log return and the volatility of crude oil prices via exponential smoothing, Bayesian stochastic volatility, and GARCH (generalized autoregressive conditional heteroskedasticity) models, respectively. In particular, what we call functional data analysis (FDA) traces in this article are obtained via the FPLS regression from both the crude oil returns and auxiliary variables of the exchange rates of major currencies. For forecast performance evaluation, we compare out‐of‐sample forecasting accuracy of the standard models with FDA traces to the accuracy of the same forecasting models with the observed crude oil returns, principal component regression (PCR), and least absolute shrinkage and selection operator (LASSO) models. We find evidence that the standard models with FDA traces significantly outperform our competing models. Finally, they are also compared with the test for superior predictive ability and the reality check for data snooping. Our empirical results show that our new methodology significantly improves predictive ability of standard models in forecasting the latent average log return and the volatility of financial time series.     

Sports forecasting: a comparison of the forecast accuracy of prediction markets,betting odds and tipsters

This article compares the forecast accuracy of different methods, namely prediction markets, tipsters and betting odds, and assesses the ability of prediction markets and tipsters to generate profits systematically in a betting market. We present the results of an empirical study that uses data from 678–837 games of three seasons of the German premier soccer league. Prediction markets and betting odds perform equally well in terms of forecasting accuracy, but both methods strongly outperform tipsters. A weighting‐based combination of the forecasts of these methods leads to a slightly higher forecast accuracy, whereas a rule‐based combination improves forecast accuracy substantially. However, none of the forecasts leads to systematic monetary gains in betting markets because of the high fees (25%) charged by the state‐owned bookmaker in Germany. Lower fees (e.g., approximately 12% or 0%) would provide systematic profits if punters exploited the information from prediction markets and bet only on a selected number of games. Copyright © 2008 John Wiley & Sons, Ltd.     

The use of non-time series information in sales forecasting: A case study

The contribution of product and industry knowledge to the accuracy of sales forecasting was investigated by examining the company forecasts of a leading manufacturer and marketer of consumable products. The company forecasts of 18 products produced by a meeting of marketing, sales, and production personnel were compared with those generated by the same company personnel when denied specific product knowledge and with the forecasts of selected judgemental and statistical time series methods. Results indicated that product knowledge contributed significantly to forecast accuracy and that the forecast accuracy of company personnel who possessed industry forecasting knowledge (but not product knowledge) was not significantly different from the time series based methods. Furthermore, the company forecasts were more accurate than averages of the judgemental and statistical time series forecasts. These results point to the importance of specific product information to forecast accuracy and accordingly call into question the continuing strong emphasis on improving extrapolation techniques without consideration of the inclusion of non-time series knowledge.