Non‐linear forecasts of stock returns

Following recent non‐linear extensions of the present‐value model, this paper examines the out‐of‐sample forecast performance of two parametric and two non‐parametric nonlinear models of stock returns. The parametric models include the standard regime switching and the Markov regime switching, whereas the non‐parametric are the nearest‐neighbour and the artificial neural network models. We focused on the US stock market using annual observations spanning the period 1872–1999. Evaluation of forecasts was based on two criteria, namely forecast accuracy and forecast encompassing. In terms of accuracy, the Markov and the artificial neural network models produce at least as accurate forecasts as the other models. In terms of encompassing, the Markov model outperforms all the others. Overall, both criteria suggest that the Markov regime switching model is the most preferable non‐linear empirical extension of the present‐value model for out‐of‐sample stock return forecasting. Copyright © 2003 John Wiley & Sons, Ltd.     

Testing Interval Forecasts: A GMM‐Based Approach

This paper proposes a new evaluation framework for interval forecasts. Our model‐free test can be used to evaluate interval forecasts and high‐density regions, potentially discontinuous and/or asymmetric. Using a simple J‐statistic, based on the moments defined by the orthonormal polynomials associated with the binomial distribution, this new approach presents many advantages. First, its implementation is extremely easy. Second, it allows for a separate test for unconditional coverage, independence and conditional coverage hypotheses. Third, Monte Carlo simulations show that for realistic sample sizes our GMM test has good small‐sample properties. These results are corroborated by an empirical application on SP500 and Nikkei stock market indexes. It confirms that using this GMM test leads to major consequences for the ex post evaluation of interval forecasts produced by linear versus nonlinear models. Copyright © 2011 John Wiley & Sons, Ltd.     

Realized Volatility Forecast of Stock Index Under Structural Breaks

We investigate the realized volatility forecast of stock indices under the structural breaks. We utilize a pure multiple mean break model to identify the possibility of structural breaks in the daily realized volatility series by employing the intraday high‐frequency data of the Shanghai Stock Exchange Composite Index and the five sectoral stock indices in Chinese stock markets for the period 4 January 2000 to 30 December 2011. We then conduct both in‐sample tests and out‐of‐sample forecasts to examine the effects of structural breaks on the performance of ARFIMAX‐FIGARCH models for the realized volatility forecast by utilizing a variety of estimation window sizes designed to accommodate potential structural breaks. The results of the in‐sample tests show that there are multiple breaks in all realized volatility series. The results of the out‐of‐sample point forecasts indicate that the combination forecasts with time‐varying weights across individual forecast models estimated with different estimation windows perform well. In particular, nonlinear combination forecasts with the weights chosen based on a non‐parametric kernel regression and linear combination forecasts with the weights chosen based on the non‐negative restricted least squares and Schwarz information criterion appear to be the most accurate methods in point forecasting for realized volatility under structural breaks. We also conduct an interval forecast of the realized volatility for the combination approaches, and find that the interval forecast for nonlinear combination approaches with the weights chosen according to a non‐parametric kernel regression performs best among the competing models. Copyright © 2014 John Wiley & Sons, Ltd.     

Forecasting nonlinear time series with feed‐forward neural networks: a case study of Canadian lynx data

The forecasting capabilities of feed‐forward neural network (FFNN) models are compared to those of other competing time series models by carrying out forecasting experiments. As demonstrated by the detailed forecasting results for the Canadian lynx data set, FFNN models perform very well, especially when the series contains nonlinear and non‐Gaussian characteristics. To compare the forecasting accuracy of a FFNN model with an alternative model, Pitman's test is employed to ascertain if one model forecasts significantly better than another when generating one‐step‐ahead forecasts. Moreover, the residual‐fit spread plot is utilized in a novel fashion in this paper to compare visually out‐of‐sample forecasts of two alternative forecasting models. Finally, forecasting findings on the lynx data are used to explain under what conditions one would expect FFNN models to furnish reliable and accurate forecasts. Copyright © 2005 John Wiley & Sons, Ltd.     

Predicting returns and volatility with macroeconomic variables: evidence from tests of encompassing

Tests of forecast encompassing are used to evaluate one‐step‐ahead forecasts of S&P Composite index returns and volatility. It is found that forecasts over the 1990s made from models that include macroeconomic variables tend to be encompassed by those made from a benchmark model which does not include macroeconomic variables. However, macroeconomic variables are found to add significant information to forecasts of returns and volatility over the 1970s. Often in empirical research on forecasting stock index returns and volatility, in‐sample information criteria are used to rank potential forecasting models. Here, none of the forecasting models for the 1970s that include macroeconomic variables are, on the basis of information criteria, preferred to the relevant benchmark specification. Thus, had investors used information criteria to choose between the models used for forecasting over the 1970s considered in this paper, the predictability that tests of encompassing reveal would not have been exploited. Copyright © 2005 John Wiley & Sons, Ltd.     

The Accuracy of Non‐traditional versus Traditional Methods of Forecasting Lumpy Demand

Forecasting for inventory items with lumpy demand is difficult because of infrequent nonzero demands with high variability. This article developed two methods to forecast lumpy demand: an optimally weighted moving average method and an intelligent pattern‐seeking method. We compare them with a number of well‐referenced methods typically applied over the last 30 years in forecasting intermittent or lumpy demand. The comparison is conducted over about 200,000 forecasts (using 1‐day‐ahead and 5‐day‐ahead review periods) for 24 series of actual product demands across four different error measures. One of the most important findings of our study is that the two non‐traditional methods perform better overall than the traditional methods. We summarize results and discuss managerial implications. Copyright © 2011 John Wiley & Sons, Ltd.     

Predictable Return Distributions

Using quantile regression this paper explores the predictability of the stock and bond return distributions as a function of economic state variables. The use of quantile regression allows us to examine specific parts of the return distribution such as the tails and the center, and for a sufficiently fine grid of quantiles we can trace out the entire distribution. A univariate quantile regression model is used to examine the marginal stock and bond return distributions, while a multivariate model is used to capture their joint distribution. An empirical analysis on US data shows that economic state variables predict the stock and bond return distributions in quite different ways in terms of, for example, location shifts, volatility and skewness. Comparing the different economic state variables in terms of their out‐of‐sample forecasting performance, the empirical analysis also shows that the relative accuracy of the state variables varies across the return distribution. Density forecasts based on an assumed normal distribution with forecasted mean and variance is compared to forecasts based on quantile estimates and, in general, the latter yields the best performance. Copyright © 2015 John Wiley & Sons, Ltd.     

Mincer–Zarnowitz quantile and expectile regressions for forecast evaluations under aysmmetric loss functions

Forecasts are pervasive in all areas of applications in business and daily life. Hence evaluating the accuracy of a forecast is important for both the generators and consumers of forecasts. There are two aspects in forecast evaluation: (a) measuring the accuracy of past forecasts using some summary statistics, and (b) testing the optimality properties of the forecasts through some diagnostic tests. On measuring the accuracy of a past forecast, this paper illustrates that the summary statistics used should match the loss function that was used to generate the forecast. If there is strong evidence that an asymmetric loss function has been used in the generation of a forecast, then a summary statistic that corresponds to that asymmetric loss function should be used in assessing the accuracy of the forecast instead of the popular root mean square error or mean absolute error. On testing the optimality of the forecasts, it is demonstrated how the quantile regressions set in the prediction–realization framework of Mincer and Zarnowitz (in J. Mincer (Ed.), Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance (pp. 14–20), 1969) can be used to recover the unknown parameter that controls the potentially asymmetric loss function used in generating the past forecasts. Finally, the prediction–realization framework is applied to the Federal Reserve's economic growth forecast and forecast sharing in a PC manufacturing supply chain. It is found that the Federal Reserve values overprediction approximately 1.5 times more costly than underprediction. It is also found that the PC manufacturer weighs positive forecast errors (under forecasts) about four times as costly as negative forecast errors (over forecasts).     

Economic factors and the stock market: a new perspective

It has been widely accepted that many financial and economic variables are non‐linear, and neural networks can model flexible linear or non‐linear relationships among variables. The present paper deals with an important issue: Can the many studies in the finance literature evidencing predictability of stock returns by means of linear regression be improved by a neural network? We show that the predictive accuracy can be improved by a neural network, and the results largely hold out‐of‐sample. Both the neural network and linear forecasts show significant market timing ability. While the switching portfolio based on the linear forecasts outperforms the buy‐and‐hold market portfolio under all three transaction cost scenarios, the switching portfolio based on the neural network forecasts beats the market only if there is no transaction cost. Copyright © 1999 John Wiley & Sons, Ltd.     

Reducing uncertainty in short-term projections: Linkage of monthly and quarterly models

This paper shows how monthly data and forecasts can be used in a systematic way to improve the predictive accuracy of a quarterly macroeconometric model. The problem is formulated as a model pooling procedure (equivalent to non-recursive Kalman filtering) where a baseline quarterly model forecast is modified through ‘add-factors’ or ‘constant adjustments’. The procedure ‘automatically’ constructs these adjustments in a covariance-minimizing fashion to reflect the revised expectation of the quarterly model's forecast errors, conditional on the monthly information set. Results obtained using Federal Reserve Board models indicate the potential for significant reduction in forecast error variance through application of these procedures.     

Sources of error in forecasts and expectations: U.K. economic models, 1984–8

This paper presents a comparative analysis of the sources of error in forecasts for the UK economy published over a recent four-year period by four independent groups. This analysis rests on the archiving at the ESRC Macroeconomic Modelling Bureau of the original forecasts together with all their accompanying assumptions and adjustments. A method of decomposing observed forecast errors so as to distinguish the contributions of forecaster and model is set out; the impact of future expectations treated in a ‘model-consistent’ or ‘rational’ manner is specifically considered. The results show that the forecaster's adjustments make a substantial contribution to forecast performance, a good part of which comes from adjustments that bring the model on track at the start of the forecast period. The published ex-ante forecasts are usually superior to pure model-based ex-post forecasts, whose performance indicates some misspecification of the underlying models.     

Combination of forecasts in electricity demand prediction

Accurate demand prediction is of great importance in the electricity supply industry. Electricity cannot be stored, and generating plant must be scheduled well in advance to meet future demand. Up to now, where online information about external conditions is unavailable, time series methods on the historical demand series have been used for short-term demand prediction. These have drawbacks, both in their sensitivity to changing weather conditions and in their poor modelling of the daily/weekly business cycles. To overcome these problems a framework has been constructed whereby forecasts from different prediction methods and different forecasting origins can be selected and combined, solely on the basis of recent forecasting performance, with no a priori assumptions of demand behaviour. This added flexibility in univariate forecasting provides a significant improvement in prediction accuracy.     

The Role of High‐Frequency Intra‐daily Data,Daily Range and Implied Volatility in Multi‐period Value‐at‐Risk Forecasting

This paper assesses the informational content of alternative realized volatility estimators, daily range and implied volatility in multi‐period out‐of‐sample Value‐at‐Risk (VaR) predictions. We use the recently proposed Realized GARCH model combined with the skewed Student's t distribution for the innovations process and a Monte Carlo simulation approach in order to produce the multi‐period VaR estimates. Our empirical findings, based on the S&P 500 stock index, indicate that almost all realized and implied volatility measures can produce statistically and regulatory precise VaR forecasts across forecasting horizons, with the implied volatility being especially accurate in monthly VaR forecasts. The daily range produces inferior forecasting results in terms of regulatory accuracy and Basel II compliance. However, robust realized volatility measures, which are immune against microstructure noise bias or price jumps, generate superior VaR estimates in terms of capital efficiency, as they minimize the opportunity cost of capital and the Basel II regulatory capital. Copyright © 2013 John Wiley & Sons, Ltd.     

Is forecasting with large models informative? Assessing the role of judgement in macroeconomic forecasts

We evaluate residual projection strategies in the context of a large‐scale macro model of the euro area and smaller benchmark time‐series models. The exercises attempt to measure the accuracy of model‐based forecasts simulated both out‐of‐sample and in‐sample. Both exercises incorporate alternative residual‐projection methods, to assess the importance of unaccounted‐for breaks in forecast accuracy and off‐model judgement. Conclusions reached are that simple mechanical residual adjustments have a significant impact on forecasting accuracy irrespective of the model in use, likely due to the presence of breaks in trends in the data. The testing procedure and conclusions are applicable to a wide class of models and of general interest. Copyright © 2010 John Wiley & Sons, Ltd.     

Forecast combining with neural networks

This paper investigates the use of Artificial Neural Networks (ANNs) to combine time series forecasts of stock market volatility from the USA, Canada, Japan and the UK. We demonstrate that combining with nonlinear ANNs generally produces forecasts which, on the basis of out-of-sample forecast encompassing tests and mean squared error comparisons, routinely dominate forecasts from traditional linear combining procedures. Superiority of the ANN arises because of its flexibility to account for potentially complex nonlinear relationships not easily captured by traditional linear models.     

Forecasting Monetary Policy Decisions in Australia: A Forecast Combinations Approach

This paper applies a triple‐choice ordered probit model, corrected for nonstationarity to forecast monetary decisions of the Reserve Bank of Australia. The forecast models incorporate a mix of monthly and quarterly macroeconomic time series. Forecast combination is used as an alternative to one multivariate model to improve accuracy of out‐of‐sample forecasts. This accuracy is evaluated with scoring functions, which are also used to construct adaptive weights for combining probability forecasts. This paper finds that combined forecasts outperform multivariable models. These results are robust to different sample sizes and estimation windows. Copyright © 2011 John Wiley & Sons, Ltd.     

Do experts' adjustments on model‐based SKU‐level forecasts improve forecast quality?

Model‐based SKU‐level forecasts are often adjusted by experts. In this paper we propose a statistical methodology to test whether these expert forecasts improve on model forecasts. Application of the methodology to a very large database concerning experts in 35 countries who adjust SKU‐level forecasts for pharmaceutical products in seven distinct categories leads to the general conclusion that expert forecasts are equally good at best, but are more often worse than model‐based forecasts. We explore whether this is due to experts putting too much weight on their contribution, and this indeed turns out to be the case. Copyright © 2009 John Wiley & Sons, Ltd.     

Expectations,use and judgmental adjustment of external financial and economic forecasts: an empirical investigation

A survey of 124 users of externally produced financial and economic forecasts in Turkey investigated their expectations and perceptions of forecast quality and their reasons for judgmentally adjusting forecasts. Expectations and quality perceptions mainly related to the timeliness of forecasts, the provision of a clear justifiable rationale and accuracy. Cost was less important. Forecasts were frequently adjusted when they lacked a justifiable explanation, when the user felt they could integrate their knowledge into the forecast, or where the user perceived a need to take responsibility for the forecast. Forecasts were less frequently adjusted when they came from a well‐known source and were based on sound explanations and assumptions. The presence of feedback on accuracy reduced the influence of these factors. The seniority and experience of users had little effect on their attitudes or propensity to make adjustments. Copyright © 2008 John Wiley & Sons, Ltd.     

Combining expert‐adjusted forecasts

It is well known that a combination of model‐based forecasts can improve upon each of the individual constituent forecasts. Most forecasts available in practice are, however, not purely based on econometric models but entail adjustments, where experts with domain‐specific knowledge modify the original model forecasts. There is much evidence that expert‐adjusted forecasts do not necessarily improve the pure model‐based forecasts. In this paper we show, however, that combined expert‐adjusted model forecasts can improve on combined model forecasts, in the case when the individual expert‐adjusted forecasts are not better than their associated model‐based forecasts. We discuss various implications of this finding.     

Forecasting the Treasury's balance at the Fed

As part of the Fed's daily operating procedure, the Federal Reserve Bank of New York, the Board of Governors and the Treasury make a forecast of that day's Treasury balance at the Fed. These forecasts are an integral part of the Fed's daily operating procedure. Errors in these forecasts can generate variation in reserve supply and, consequently, the federal funds rate. This paper evaluates the accuracy of these forecasts. The evidence suggests that each agency's forecast contributes to the optimal, i.e., minimum variance, forecast and that the Trading Desk of the Federal Reserve Bank of New York incorporates information from all three of the agency forecasts in conducting daily open market operations. Moreover, these forecasts encompass the forecast of an economic model. Copyright © 2004 John Wiley & Sons, Ltd.