Why do regime‐switching models forecast so badly?

Most non‐linear techniques give good in‐sample fits to exchange rate data but are usually outperformed by random walks or random walks with drift when used for out‐of‐sample forecasting. In the case of regime‐switching models it is possible to understand why forecasts based on the true model can have higher mean squared error than those of a random walk or random walk with drift. In this paper we provide some analytical results for the case of a simple switching model, the segmented trend model. It requires only a small misclassification, when forecasting which regime the world will be in, to lose any advantage from knowing the correct model specification. To illustrate this we discuss some results for the DM/dollar exchange rate. We conjecture that the forecasting result is more general and describes limitations to the use of switching models for forecasting. This result has two implications. First, it questions the leading role of the random walk hypothesis for the spot exchange rate. Second, it suggests that the mean square error is not an appropriate way to evaluate forecast performance for non‐linear models. Copyright © 1999 John Wiley & Sons, Ltd.     

Prediction intervals for exponential smoothing using two new classes of state space models

Three general classes of state space models are presented, using the single source of error formulation. The first class is the standard linear model with homoscedastic errors, the second retains the linear structure but incorporates a dynamic form of heteroscedasticity, and the third allows for non‐linear structure in the observation equation as well as heteroscedasticity. These three classes provide stochastic models for a wide variety of exponential smoothing methods. We use these classes to provide exact analytic (matrix) expressions for forecast error variances that can be used to construct prediction intervals one or multiple steps ahead. These formulas are reduced to non‐matrix expressions for 15 state space models that underlie the most common exponential smoothing methods. We discuss relationships between our expressions and previous suggestions for finding forecast error variances and prediction intervals for exponential smoothing methods. Simpler approximations are developed for the more complex schemes and their validity examined. The paper concludes with a numerical example using a non‐linear model. Copyright © 2005 John Wiley & Sons, Ltd.     

Model specification and forecasting foreign exchange rates with vector autoregressions

This study examines the forecasting accuracy of alternative vector autoregressive models each in a seven‐variable system that comprises in turn of daily, weekly and monthly foreign exchange (FX) spot rates. The vector autoregressions (VARs) are in non‐stationary, stationary and error‐correction forms and are estimated using OLS. The imposition of Bayesian priors in the OLS estimations also allowed us to obtain another set of results. We find that there is some tendency for the Bayesian estimation method to generate superior forecast measures relatively to the OLS method. This result holds whether or not the data sets contain outliers. Also, the best forecasts under the non‐stationary specification outperformed those of the stationary and error‐correction specifications, particularly at long forecast horizons, while the best forecasts under the stationary and error‐correction specifications are generally similar. The findings for the OLS forecasts are consistent with recent simulation results. The predictive ability of the VARs is very weak. Copyright © 2001 John Wiley & Sons, Ltd.     

Non‐linear,non‐parametric,non‐fundamental exchange rate forecasting

This paper employs a non‐parametric method to forecast high‐frequency Canadian/US dollar exchange rate. The introduction of a microstructure variable, order flow, substantially improves the predictive power of both linear and non‐linear models. The non‐linear models outperform random walk and linear models based on a number of recursive out‐of‐sample forecasts. Two main criteria that are applied to evaluate model performance are root mean squared error (RMSE) and the ability to predict the direction of exchange rate moves. The artificial neural network (ANN) model is consistently better in RMSE to random walk and linear models for the various out‐of‐sample set sizes. Moreover, ANN performs better than other models in terms of percentage of correctly predicted exchange rate changes. The empirical results suggest that optimal ANN architecture is superior to random walk and any linear competing model for high‐frequency exchange rate forecasting. Copyright © 2006 John Wiley & Sons, Ltd.     

The performance of non‐linear exchange rate models: a forecasting comparison

In recent years there has been a considerable development in modelling non‐linearities and asymmetries in economic and financial variables. The aim of the current paper is to compare the forecasting performance of different models for the returns of three of the most traded exchange rates in terms of the US dollar, namely the French franc (FF/$), the German mark (DM/$) and the Japanese yen (Y/$). The relative performance of non‐linear models of the SETAR, STAR and GARCH types is contrasted with their linear counterparts. The results show that if attention is restricted to mean square forecast errors, the performance of the models, when distinguishable, tends to favour the linear models. The forecast performance of the models is evaluated also conditional on the regime at the forecast origin and on density forecasts. This analysis produces more evidence of forecasting gains from non‐linear models. Copyright © 2002 John Wiley & Sons, Ltd.     

Covariance estimation for multivariate conditionally Gaussian dynamic linear models

In multivariate time series, estimation of the covariance matrix of observation innovations plays an important role in forecasting as it enables computation of standardized forecast error vectors as well as the computation of confidence bounds of forecasts. We develop an online, non‐iterative Bayesian algorithm for estimation and forecasting. It is empirically found that, for a range of simulated time series, the proposed covariance estimator has good performance converging to the true values of the unknown observation covariance matrix. Over a simulated time series, the new method approximates the correct estimates, produced by a non‐sequential Monte Carlo simulation procedure, which is used here as the gold standard. The special, but important, vector autoregressive (VAR) and time‐varying VAR models are illustrated by considering London metal exchange data consisting of spot prices of aluminium, copper, lead and zinc. Copyright © 2007 John Wiley & Sons, Ltd.     

Analyzing Macroeconomic Forecastability

This paper estimates, using stochastic simulation and a multi‐country macroeconometric model, the fraction of the forecast error variance of output changes and the fraction of the forecast error variance of inflation that are due to unpredictable asset price changes. The results suggest that between about 25% and 37% of the forecast error variance of output growth over eight quarters is due to asset price changes and between about 33% and 60% of the forecast error variance of inflation over eight quarters is due to asset price changes. These estimates provide limits to the accuracy that can be expected from macroeconomic forecasting. Copyright © 2011 John Wiley & Sons, Ltd.     

Bayesian Forecasting for Financial Risk Management,Pre and Post the Global Financial Crisis

Value‐at‐risk (VaR) forecasting via a computational Bayesian framework is considered. A range of parametric models is compared, including standard, threshold nonlinear and Markov switching generalized autoregressive conditional heteroskedasticity (GARCH) specifications, plus standard and nonlinear stochastic volatility models, most considering four error probability distributions: Gaussian, Student‐t, skewed‐t and generalized error distribution. Adaptive Markov chain Monte Carlo methods are employed in estimation and forecasting. A portfolio of four Asia–Pacific stock markets is considered. Two forecasting periods are evaluated in light of the recent global financial crisis. Results reveal that: (i) GARCH models outperformed stochastic volatility models in almost all cases; (ii) asymmetric volatility models were clearly favoured pre crisis, while at the 1% level during and post crisis, for a 1‐day horizon, models with skewed‐t errors ranked best, while integrated GARCH models were favoured at the 5% level; (iii) all models forecast VaR less accurately and anti‐conservatively post crisis. Copyright © 2011 John Wiley & Sons, Ltd.     

Forecasting with missing data: application to coastal wave heights

This paper presents a comparative analysis of linear and mixed models for short‐term forecasting of a real data series with a high percentage of missing data. Data are the series of significant wave heights registered at regular periods of three hours by a buoy placed in the Bay of Biscay. The series is interpolated with a linear predictor which minimizes the forecast mean square error. The linear models are seasonal ARIMA models and the mixed models have a linear component and a non‐linear seasonal component. The non‐linear component is estimated by a non‐parametric regression of data versus time. Short‐term forecasts, no more than two days ahead, are of interest because they can be used by the port authorities to notify the fleet. Several models are fitted and compared by their forecasting behaviour. Copyright © 1999 John Wiley & Sons, Ltd.     

Currency forecasting based on an error components‐seemingly unrelated nonlinear regression model

This paper proposes to forecast foreign exchange rates by means of an error components‐seemingly unrelated nonlinear regression (EC‐SUNR) model and, simultaneously, explore the interrelationships among currencies from newly industrializing economies with those of highly industrialized countries. Based on the empirical results, we find that the EC‐SUNR model improves on the performance of forecasting foreign exchange rates in comparison with an intrinsically nonlinear dynamic speed of adjustment model that has been shown to outperform several other important models in the forecasting literature. We also find evidence showing that the foreign exchange markets of the newly industrializing countries are influenced by those of the highly industrialized countries and vice versa, and that such interrelationships affect the accuracy of currency forecasting. Copyright © 2005 John Wiley & Sons, Ltd.     

Optimal sampling frequency for volatility forecast models for the Indian stock markets

This paper evaluates the performance of conditional variance models using high‐frequency data of the National Stock Index (S&P CNX NIFTY) and attempts to determine the optimal sampling frequency for the best daily volatility forecast. A linear combination of the realized volatilities calculated at two different frequencies is used as benchmark to evaluate the volatility forecasting ability of the conditional variance models (GARCH (1, 1)) at different sampling frequencies. From the analysis, it is found that sampling at 30 minutes gives the best forecast for daily volatility. The forecasting ability of these models is deteriorated, however, by the non‐normal property of mean adjusted returns, which is an assumption in conditional variance models. Nevertheless, the optimum frequency remained the same even in the case of different models (EGARCH and PARCH) and different error distribution (generalized error distribution, GED) where the error is reduced to a certain extent by incorporating the asymmetric effect on volatility. Our analysis also suggests that GARCH models with GED innovations or EGRACH and PARCH models would give better estimates of volatility with lower forecast error estimates. Copyright © 2008 John Wiley & Sons, Ltd.     

Semiparametric forecast intervals

Consider forecasting the economic variable Y_t+h with predictors X _t, where h is the forecast horizon. This paper introduces a semiparametric method that generates forecast intervals of Y_t+h| X _t from point forecast models. First, the point forecast model is estimated, thereby taking advantage of its predictive power. Then, nonparametric estimation of the conditional distribution function (CDF) of the forecast error conditional on X _t builds the rest of the forecast distribution around the point forecast, from which symmetric and minimum‐length forecast intervals for Y_t+h| X _t can be constructed. Under mild regularity conditions, asymptotic analysis shows that (1) regardless of the quality of the point forecast model (i.e., it may be misspecified), forecast quantiles are consistent and asymptotically normal; (2) minimum length forecast intervals are consistent. Proposals for bandwidth selection and dimension reduction are made. Three sets of simulations show that for reasonable point forecast models the method has significant advantages over two existing approaches to interval forecasting: one that requires the point forecast model to be correctly specified, and one that is based on fully nonparametric CDF estimate of Y_t+h| X _t. An application to exchange rate forecasting is presented. Copyright © 2010 John Wiley & Sons, Ltd.     

Bootstrap prediction bands for forecast paths from vector autoregressive models

The problem of forecasting from vector autoregressive models has attracted considerable attention in the literature. The most popular non‐Bayesian approaches use either asymptotic approximations or bootstrapping to evaluate the uncertainty associated with the forecast. The practice in the empirical literature has been to assess the uncertainty of multi‐step forecasts by connecting the intervals constructed for individual forecast periods. This paper proposes a bootstrap method of constructing prediction bands for forecast paths. The bands are constructed from forecast paths obtained in bootstrap replications using an optimization procedure to find the envelope of the most concentrated paths. From extensive Monte Carlo study, it is found that the proposed method provides more accurate assessment of predictive uncertainty from the vector autoregressive model than its competitors. Copyright © 2010 John Wiley & Sons, Ltd.     

Local to unity,long‐horizon forecasting thresholds for model selection in the AR(1)

This article introduces a novel framework for analysing long‐horizon forecasting of the near non‐stationary AR(1) model. Using the local to unity specification of the autoregressive parameter, I derive the asymptotic distributions of long‐horizon forecast errors both for the unrestricted AR(1), estimated using an ordinary least squares (OLS) regression, and for the random walk (RW). I then identify functions, relating local to unity ‘drift’ to forecast horizon, such that OLS and RW forecasts share the same expected square error. OLS forecasts are preferred on one side of these ‘forecasting thresholds’, while RW forecasts are preferred on the other. In addition to explaining the relative performance of forecasts from these two models, these thresholds prove useful in developing model selection criteria that help a forecaster reduce error. Copyright © 2004 John Wiley & Sons, Ltd.     

Revisions in analysts' earnings forecasts: evidence of non‐linear adaptive expectations

Prior studies use a linear adaptive expectations model to describe how analysts revise their forecasts of future earnings in response to current forecast errors. However, research shows that extreme forecast errors are less likely than small forecast errors to persist in future years. If analysts recognize this property, their marginal forecast revisions should decrease with the forecast error's magnitude. Therefore, a linear model is likely to be unsatisfactory at describing analysts' forecast revisions. We find that a non‐linear model better describes the relation between analysts' forecast revisions and their forecast errors, and provides a richer theoretical framework for explaining analysts' forecasting behaviour. Our results are consistent with analysts' recognizing the permanent and temporary nature of forecast errors of differing magnitudes. Copyright © 2000 John Wiley & Sons, Ltd.     

Forecasting for the LCD monitor market

The TFT‐LCD (thin‐film transistor–liquid crystal display) industry is one of the key global industries with products that have high clock speed. In this research, the LCD monitor market is considered for an empirical study on hierarchical forecasting (HF). The proposed HF methodology consists of five steps. First, the three hierarchical levels of the LCD monitor market are identified. Second, several exogenously driven factors that significantly affect the demand for LCD monitors are identified at each level of product hierarchy. Third, the three forecasting techniques—regression analysis, transfer function, and simultaneous equations model—are combined to forecast future demand at each hierarchical level. Fourth, various forecasting approaches and disaggregating proportion methods are adopted to obtain consistent demand forecasts at each hierarchical level. Finally, the forecast errors with different forecasting approaches are assessed in order to determine the best forecasting level and the best forecasting approach. The findings show that the best forecast results can be obtained by using the middle‐out forecasting approach. These results could guide LCD manufacturers and brand owners on ways to forecast future market demands. Copyright 2008 John Wiley & Sons, Ltd.     

Predicting crypto‐currencies using sparse non‐Gaussian state space models

In this paper we forecast daily returns of crypto‐currencies using a wide variety of different econometric models. To capture salient features commonly observed in financial time series like rapid changes in the conditional variance, non‐normality of the measurement errors and sharply increasing trends, we develop a time‐varying parameter VAR with t‐distributed measurement errors and stochastic volatility. To control for overparametrization, we rely on the Bayesian literature on shrinkage priors, which enables us to shrink coefficients associated with irrelevant predictors and/or perform model specification in a flexible manner. Using around one year of daily data, we perform a real‐time forecasting exercise and investigate whether any of the proposed models is able to outperform the naive random walk benchmark. To assess the economic relevance of the forecasting gains produced by the proposed models we, moreover, run a simple trading exercise.     

Forecasting the price of crude oil via convenience yield predictions

The paper develops an oil price forecasting technique which is based on the present value model of rational commodity pricing. The approach suggests shifting the forecasting problem to the marginal convenience yield, which can be derived from the cost‐of‐carry relationship. In a recursive out‐of‐sample analysis, forecast accuracy at horizons within one year is checked by the root mean squared error as well as the mean error and the frequency of a correct direction‐of‐change prediction. For all criteria employed, the proposed forecasting tool outperforms the approach of using futures prices as direct predictors of future spot prices. Vis‐à‐vis the random‐walk model, it does not significantly improve forecast accuracy but provides valuable statements on the direction of change. Copyright © 2007 John Wiley & Sons, Ltd.     

When are Direct Multi‐step and Iterative Forecasts Identical?

Although both direct multi‐step‐ahead forecasting and iterated one‐step‐ahead forecasting are two popular methods for predicting future values of a time series, it is not clear that the direct method is superior in practice, even though from a theoretical perspective it has lower mean squared error (MSE). A given model can be fitted according to either a multi‐step or a one‐step forecast error criterion, and we show here that discrepancies in performance between direct and iterative forecasting arise chiefly from the method of fitting, and is dictated by the nuances of the model's misspecification. We derive new formulas for quantifying iterative forecast MSE, and present a new approach for assessing asymptotic forecast MSE. Finally, the direct and iterative methods are compared on a retail series, which illustrates the strengths and weaknesses of each approach. Copyright © 2015 John Wiley & Sons, Ltd.     

Effect of regressor forecast error on the variance of regression forecasts

It is well understood that the standard formulation for the variance of a regression‐model forecast produces interval estimates that are too narrow, principally because it ignores regressor forecast error. While the theoretical problem has been addressed, there has not been an adequate explanation of the effect of regressor forecast error, and the empirical literature has supplied a disparate variety of bits and pieces of evidence. Most business‐forecasting software programs continue to supply only the standard formulation. This paper extends existing analysis to derive and evaluate large‐sample approximations for the forecast error variance in a single‐equation regression model. We show how these approximations substantially clarify the expected effects of regressor forecast error. We then present a case study, which (a) demonstrates how rolling out‐of‐sample evaluations can be applied to obtain empirical estimates of the forecast error variance, (b) shows that these estimates are consistent with our large‐sample approximations and (c) illustrates, for ‘typical’ data, how seriously the standard formulation can understate the forecast error variance. Copyright © 2000 John Wiley & Sons, Ltd.