Estimation and Prediction Tests of Cash Flow Forecast Accuracy

Recently, analysts' cash flow forecasts have become widely available through financial information services. Cash flow information enables practitioners to better understand the real operating performance and financial stability of a company, particularly when earnings information is noisy and of low quality. However, research suggests that analysts' cash flow forecasts are less accurate and more dispersed than earnings forecasts. We thus investigate factors influencing cash flow forecast accuracy and build a practical model to distinguish more accurate from less accurate cash flow forecasters, using past cash flow forecast accuracy and analyst characteristics. We find significant power in our cash flow forecast accuracy prediction models. We also find that analysts develop cash flow‐specific forecasting expertise and knowhow, which are distinct from those that analysts acquire from forecasting earnings. In particular, cash flow‐specific information is more useful in identifying accurate cash flow forecasters than earnings‐specific information.Copyright © 2011 John Wiley & Sons, Ltd.     

Sentiment indices and their forecasting ability

The success of any timing strategy depends on the accuracy of market forecasts. In this paper, we test five indices to forecast the 1‐month‐ahead performance of the S&P 500 Index. These indices reflect investor sentiment, current business conditions, economic policy uncertainty, and market dislocation information. Each model is used in a logistic regression analysis to predict the 1‐month‐ahead market direction, and the forecasts are used to adjust the portfolio's beta. Beta optimization refers to a strategy designed to create a portfolio beta of 1.0 when the market is expected to go up, and a beta of ?1.0 when a bear market is expected. Successful application of this strategy generates returns that are consistent with a call option or an option straddle position; that is, positive returns are generated in both up and down markets. Analysis reveals that the models' forecasts have discriminatory power in identifying substantial market movements, particularly during the bursting of the tech bubble and the financial crisis. Four of the five forecast models tested outperform the benchmark index.     

Multi‐model Forecasts of the West Texas Intermediate Crude Oil Spot Price

We measure the performance of multi‐model inference (MMI) forecasts compared to predictions made from a single model for crude oil prices. We forecast the West Texas Intermediate (WTI) crude oil spot prices using total OECD petroleum inventory levels, surplus production capacity, the Chicago Board Options Exchange Volatility Index and an implementation of a subset autoregression with exogenous variables (SARX). Coefficient and standard error estimates obtained from SARX determined by conditioning on a single ‘best model’ ignore model uncertainty and result in underestimated standard errors and overestimated coefficients. We find that the MMI forecast outperforms a single‐model forecast for both in‐ and out‐of‐sample datasets over a variety of statistical performance measures, and further find that weighting models according to the Bayesian information criterion generally yields superior results both in and out of sample when compared to the Akaike information criterion. Copyright © 2016 John Wiley & Sons, Ltd.     

Revisions in analysts' earnings forecasts: evidence of non‐linear adaptive expectations

Prior studies use a linear adaptive expectations model to describe how analysts revise their forecasts of future earnings in response to current forecast errors. However, research shows that extreme forecast errors are less likely than small forecast errors to persist in future years. If analysts recognize this property, their marginal forecast revisions should decrease with the forecast error's magnitude. Therefore, a linear model is likely to be unsatisfactory at describing analysts' forecast revisions. We find that a non‐linear model better describes the relation between analysts' forecast revisions and their forecast errors, and provides a richer theoretical framework for explaining analysts' forecasting behaviour. Our results are consistent with analysts' recognizing the permanent and temporary nature of forecast errors of differing magnitudes. Copyright © 2000 John Wiley & Sons, Ltd.     

Forecasting Stock Returns: Do Commodity Prices Help?

This paper examines the relationship between stock prices and commodity prices and whether this can be used to forecast stock returns. As both prices are linked to expected future economic performance they should exhibit a long‐run relationship. Moreover, changes in sentiment towards commodity investing may affect the nature of the response to disequilibrium. Results support cointegration between stock and commodity prices, while Bai–Perron tests identify breaks in the forecast regression. Forecasts are computed using a standard fixed (static) in‐sample/out‐of‐sample approach and by both recursive and rolling regressions, which incorporate the effects of changing forecast parameter values. A range of model specifications and forecast metrics are used. The historical mean model outperforms the forecast models in both the static and recursive approaches. However, in the rolling forecasts, those models that incorporate information from the long‐run stock price/commodity price relationship outperform both the historical mean and other forecast models. Of note, the historical mean still performs relatively well compared to standard forecast models that include the dividend yield and short‐term interest rates but not the stock/commodity price ratio. Copyright © 2014 John Wiley & Sons, Ltd.     

Forecasting the Treasury's balance at the Fed

As part of the Fed's daily operating procedure, the Federal Reserve Bank of New York, the Board of Governors and the Treasury make a forecast of that day's Treasury balance at the Fed. These forecasts are an integral part of the Fed's daily operating procedure. Errors in these forecasts can generate variation in reserve supply and, consequently, the federal funds rate. This paper evaluates the accuracy of these forecasts. The evidence suggests that each agency's forecast contributes to the optimal, i.e., minimum variance, forecast and that the Trading Desk of the Federal Reserve Bank of New York incorporates information from all three of the agency forecasts in conducting daily open market operations. Moreover, these forecasts encompass the forecast of an economic model. Copyright © 2004 John Wiley & Sons, Ltd.     

A test of the joint efficiency of macroeconomic forecasts using multivariate random forests

We contribute to recent research on the joint evaluation of the properties of macroeconomic forecasts in a multivariate setting. The specific property of forecasts that we are interested in is their joint efficiency. We study the joint efficiency of forecasts by means of multivariate random forests, which we use to model the links between forecast errors and predictor variables in a forecaster's information set. We then use permutation tests to study whether the Mahalanobis distance between the predicted forecast errors for the growth and inflation forecasts of four leading German economic research institutes and actual forecast errors is significantly smaller than under the null hypothesis of forecast efficiency. We reject joint efficiency in several cases, but also document heterogeneity across research institutes with regard to the joint efficiency of their forecasts.     

Term Structure Forecasting of Government Bond Yields with Latent and Macroeconomic Factors: Do Macroeconomic Factors Imply Better Out‐of‐Sample Forecasts?

This study empirically examines the role of macroeconomic and stock market variables in the dynamic Nelson–Siegel framework with the purpose of fitting and forecasting the term structure of interest rate on the Japanese government bond market. The Nelson–Siegel type models in state‐space framework considerably outperform the benchmark simple time series forecast models such as an AR(1) and a random walk. The yields‐macro model incorporating macroeconomic factors leads to a better in‐sample fit of the term structure than the yields‐only model. The out‐of‐sample predictability of the former for short‐horizon forecasts is superior to the latter for all maturities examined in this study, and for longer horizons the former is still compatible to the latter. Inclusion of macroeconomic factors can dramatically reduce the autocorrelation of forecast errors, which has been a common phenomenon of statistical analysis in previous term structure models. Copyright © 2013 John Wiley & Sons, Ltd.     

A fractal forecasting model for financial time series

Financial market time series exhibit high degrees of non‐linear variability, and frequently have fractal properties. When the fractal dimension of a time series is non‐integer, this is associated with two features: (1) inhomogeneity—extreme fluctuations at irregular intervals, and (2) scaling symmetries—proportionality relationships between fluctuations over different separation distances. In multivariate systems such as financial markets, fractality is stochastic rather than deterministic, and generally originates as a result of multiplicative interactions. Volatility diffusion models with multiple stochastic factors can generate fractal structures. In some cases, such as exchange rates, the underlying structural equation also gives rise to fractality. Fractal principles can be used to develop forecasting algorithms. The forecasting method that yields the best results here is the state transition‐fitted residual scale ratio (ST‐FRSR) model. A state transition model is used to predict the conditional probability of extreme events. Ratios of rates of change at proximate separation distances are used to parameterize the scaling symmetries. Forecasting experiments are run using intraday exchange rate futures contracts measured at 15‐minute intervals. The overall forecast error is reduced on average by up to 7% and in one instance by nearly a quarter. However, the forecast error during the outlying events is reduced by 39% to 57%. The ST‐FRSR reduces the predictive error primarily by capturing extreme fluctuations more accurately. Copyright © 2004 John Wiley & Sons, Ltd.     

What can we learn from the return predictability over the business cycle?

In this paper, we forecast stock returns using time‐varying parameter (TVP) models with parameters driven by economic conditions. An in‐sample specification test shows significant variation in the parameters. Out‐of‐sample results suggest that the TVP models outperform their constant coefficient counterparts. We also find significant return predictability from both statistical and economic perspectives with the application of TVP models. The out‐of‐sample R² of an equal‐weighted combination of TVP models is as high as 2.672%, and the gains in the certainty equivalent return are 214.7 basis points. Further analysis indicates that the improvement in predictability comes from the use of information on economic conditions rather than simply from allowing the coefficients to vary with time.     

Evaluating the predictive accuracy of volatility models

Standard statistical loss functions, such as mean‐squared error, are commonly used for evaluating financial volatility forecasts. In this paper, an alternative evaluation framework, based on probability scoring rules that can be more closely tailored to a forecast user's decision problem, is proposed. According to the decision at hand, the user specifies the economic events to be forecast, the scoring rule with which to evaluate these probability forecasts, and the subsets of the forecasts of particular interest. The volatility forecasts from a model are then transformed into probability forecasts of the relevant events and evaluated using the selected scoring rule and calibration tests. An empirical example using exchange rate data illustrates the framework and confirms that the choice of loss function directly affects the forecast evaluation results. Copyright © 2001 John Wiley & Sons, Ltd.     

Forecasting house prices in OECD economies

In this paper, we forecast real house price growth of 16 OECD countries using information from domestic macroeconomic indicators and global measures of the housing market. Consistent with the findings for the US housing market, we find that the forecasts from an autoregressive model dominate the forecasts from the random walk model for most of the countries in our sample. More importantly, we find that the forecasts from a bivariate model that includes economically important domestic macroeconomic variables and two global indicators of the housing market significantly improve upon the univariate autoregressive model forecasts. Among all the variables, the mean square forecast error from the model with the country's domestic interest rates has the best performance for most of the countries. The country's income, industrial production, and stock markets are also found to have valuable information about the future movements in real house price growth. There is also some evidence supporting the influence of the global housing price growth in out‐of‐sample forecasting of real house price growth in these OECD countries.     

Forecasting US GNP growth: The role of uncertainty

A large number of models have been developed in the literature to analyze and forecast changes in output dynamics. The objective of this paper was to compare the predictive ability of univariate and bivariate models, in terms of forecasting US gross national product (GNP) growth at different forecasting horizons, with the bivariate models containing information on a measure of economic uncertainty. Based on point and density forecast accuracy measures, as well as on equal predictive ability (EPA) and superior predictive ability (SPA) tests, we evaluate the relative forecasting performance of different model specifications over the quarterly period of 1919:Q2 until 2014:Q4. We find that the economic policy uncertainty (EPU) index should improve the accuracy of US GNP growth forecasts in bivariate models. We also find that the EPU exhibits similar forecasting ability to the term spread and outperforms other uncertainty measures such as the volatility index and geopolitical risk in predicting US recessions. While the Markov switching time‐varying parameter vector autoregressive model yields the lowest values for the root mean squared error in most cases, we observe relatively low values for the log predictive density score, when using the Bayesian vector regression model with stochastic volatility. More importantly, our results highlight the importance of uncertainty in forecasting US GNP growth rates.     

Unemployment variation over the business cycles: a comparison of forecasting models

Asymmetry has been well documented in the business cycle literature. The asymmetric business cycle suggests that major macroeconomic series, such as a country's unemployment rate, are non‐linear and, therefore, the use of linear models to explain their behaviour and forecast their future values may not be appropriate. Many researchers have focused on providing evidence for the non‐linearity in the unemployment series. Only recently have there been some developments in applying non‐linear models to estimate and forecast unemployment rates. A major concern of non‐linear modelling is the model specification problem; it is very hard to test all possible non‐linear specifications, and to select the most appropriate specification for a particular model. Artificial neural network (ANN) models provide a solution to the difficulty of forecasting unemployment over the asymmetric business cycle. ANN models are non‐linear, do not rely upon the classical regression assumptions, are capable of learning the structure of all kinds of patterns in a data set with a specified degree of accuracy, and can then use this structure to forecast future values of the data. In this paper, we apply two ANN models, a back‐propagation model and a generalized regression neural network model to estimate and forecast post‐war aggregate unemployment rates in the USA, Canada, UK, France and Japan. We compare the out‐of‐sample forecast results obtained by the ANN models with those obtained by several linear and non‐linear times series models currently used in the literature. It is shown that the artificial neural network models are able to forecast the unemployment series as well as, and in some cases better than, the other univariate econometrics time series models in our test. Copyright © 2004 John Wiley & Sons, Ltd.     

Long‐memory forecasting of US monetary indices

Several studies have tested for long‐range dependence in macroeconomic and financial time series but very few have assessed the usefulness of long‐memory models as forecast‐generating mechanisms. This study tests for fractional differencing in the US monetary indices (simple sum and divisia) and compares the out‐of‐sample fractional forecasts to benchmark forecasts. The long‐memory parameter is estimated using Robinson's Gaussian semi‐parametric and multivariate log‐periodogram methods. The evidence amply suggests that the monetary series possess a fractional order between one and two. Fractional out‐of‐sample forecasts are consistently more accurate (with the exception of the M3 series) than benchmark autoregressive forecasts but the forecasting gains are not generally statistically significant. In terms of forecast encompassing, the fractional model encompasses the autoregressive model for the divisia series but neither model encompasses the other for the simple sum series. Copyright © 2006 John Wiley & Sons, Ltd.     

Comparing the DSGE model with the factor model: an out‐of‐sample forecasting experiment

In this paper, we put dynamic stochastic general equilibrium DSGE forecasts in competition with factor forecasts. We focus on these two models since they represent nicely the two opposing forecasting philosophies. The DSGE model on the one hand has a strong theoretical economic background; the factor model on the other hand is mainly data‐driven. We show that incorporating a large information set using factor analysis can indeed improve the short‐horizon predictive ability, as claimed by many researchers. The micro‐founded DSGE model can provide reasonable forecasts for US inflation, especially with growing forecast horizons. To a certain extent, our results are consistent with the prevailing view that simple time series models should be used in short‐horizon forecasting and structural models should be used in long‐horizon forecasting. Our paper compares both state‐of‐the‐art data‐driven and theory‐based modelling in a rigorous manner. Copyright © 2008 John Wiley & Sons, Ltd.     

Are Analysts' Loss Functions Asymmetric?

Despite displaying a statistically significant optimism bias, analysts' earnings forecasts are an important input to investors’ valuation models. Understanding the possible reasons for any bias is important if information is to be extracted from earnings forecasts and used optimally by investors. Extant research into the shape of analysts' loss functions explains optimism bias as resulting from analysts minimizing the mean absolute forecast error under symmetric, linear loss functions. When the distribution of earnings outcomes is skewed, optimalforecasts can appear biased. In contrast, research into analysts' economic incentives suggests that positive and negative earnings forecast errors made by analysts are not penalized or rewarded symmetrically, suggesting that asymmetric loss functions are an appropriate characterization. To reconcile these findings, we exploit results from economic theory relating to the Linex loss function to discriminate between the symmetric linear loss and the asymmetric loss explanations of analyst forecast bias. Under asymmetric loss functions optimal forecasts will appear biased even if earnings outcomes are symmetric. Our empirical results support the asymmetric loss function explanation. Further analysis also reveals that forecast bias varies systematically across firm characteristics that capture systematic variation in the earnings forecast error distribution. Copyright © 2011 John Wiley & Sons, Ltd.     

Predicting Recessions with Leading Indicators: Model Averaging and Selection over the Business Cycle

Four methods of model selection—equally weighted forecasts, Bayesian model‐averaged forecasts, and two models produced by the machine‐learning algorithm boosting—are applied to the problem of predicting business cycle turning points with a set of common macroeconomic variables. The methods address a fundamental problem faced by forecasters: the most useful model is simple but makes use of all relevant indicators. The results indicate that successful models of recession condition on different economic indicators at different forecast horizons. Predictors that describe real economic activity provide the clearest signal of recession at very short horizons. In contrast, signals from housing and financial markets produce the best forecasts at longer forecast horizons. A real‐time forecast experiment explores the predictability of the 2001 and 2007 recessions. Copyright © 2015 John Wiley & Sons, Ltd.     

Conditional predictability of daily exchange rates

At what forecast horizon is one time series more predictable than another? This paper applies the Diebold–Kilian conditional predictability measure to assess the out‐of‐sample performance of three alternative models of daily GBP/USD and DEM/USD exchange rate returns. Predictability is defined as a non‐linear statistic of a model's relative expected losses at short and long forecast horizons, allowing flexible choice of both the estimation procedure and loss function. The long horizon is set to 2 weeks and one month ahead and forecasts evaluated according to MSE loss. Bootstrap methodology is used to estimate the data's conditional predictability using GARCH models. This is then compared to predictability under a random walk and a model using the prediction bias in uncovered interest parity (UIP). We find that both exchange rates are less predictable using GARCH than using a random walk, but they are more predictable using UIP than a random walk. Predictability using GARCH is relatively higher for the 2‐weeks‐than for the 1‐month long forecast horizon. Comparing the results using a random walk to that using UIP reveals ‘pockets’ of predictability, that is, particular short horizons for which predictability using the random walk exceeds that using UIP, or vice versa. Overall, GBP/USD returns appear more predictable than DEM/USD returns at short horizons. Copyright © 2002 John Wiley & Sons, Ltd.     

Forecasting German GDP using alternative factor models based on large datasets

This paper discusses the forecasting performance of alternative factor models based on a large panel of quarterly time series for the German economy. One model extracts factors by static principal components analysis; the second model is based on dynamic principal components obtained using frequency domain methods; the third model is based on subspace algorithms for state‐space models. Out‐of‐sample forecasts show that the forecast errors of the factor models are on average smaller than the errors of a simple autoregressive benchmark model. Among the factor models, the dynamic principal component model and the subspace factor model outperform the static factor model in most cases in terms of mean‐squared forecast error. However, the forecast performance depends crucially on the choice of appropriate information criteria for the auxiliary parameters of the models. In the case of misspecification, rankings of forecast performance can change severely. Copyright © 2007 John Wiley & Sons, Ltd.