Prediction from the One‐Way Error Components Model with AR(1) Disturbances

In this paper we extend the works of Baillie and Baltagi (1999, in Analysis of Panels and Limited Dependent Variables Models, Hsiao C et al. (eds). Cambridge University Press: Cambridge, UK; 255–267) and generalize certain results from the Baltagi and Li (1992, Journal of Forecasting 11 : 561–567) paper accounting for AR(1) errors in the disturbance term. In particular, we derive six predictors for the one‐way error components model, as well as their associated asymptotic mean squared error of multi‐step prediction in the presence of AR(1) errors in the disturbance term. In addition, we also provide both theoretical and simulation evidence as to the relative efficiency of our alternative predictors. The adequacy of the prediction AMSE formula is also investigated by the use of Monte Carlo methods and indicates that the ordinary optimal predictor performs well for various accuracy criteria. Copyright © 2011 John Wiley & Sons, Ltd.     

Forecasting the recent behavior of US business fixed investment spending: an analysis of competing models

We evaluate forecasting models of US business fixed investment spending growth over the recent 1995:1–2004:2 out‐of‐sample period. The forecasting models are based on the conventional Accelerator, Neoclassical, Average Q, and Cash‐Flow models of investment spending, as well as real stock prices and excess stock return predictors. The real stock price model typically generates the most accurate forecasts, and forecast‐encompassing tests indicate that this model contains most of the information useful for forecasting investment spending growth relative to the other models at longer horizons. In a robustness check, we also evaluate the forecasting performance of the models over two alternative out‐of‐sample periods: 1975:1–1984:4 and 1985:1–1994:4. A number of different models produce the most accurate forecasts over these alternative out‐of‐sample periods, indicating that while the real stock price model appears particularly useful for forecasting the recent behavior of investment spending growth, it may not continue to perform well in future periods. Copyright © 2007 John Wiley & Sons, Ltd.     

Forecasting US employment growth using forecast combining methods

We examine different approaches to forecasting monthly US employment growth in the presence of many potentially relevant predictors. We first generate simulated out‐of‐sample forecasts of US employment growth at multiple horizons using individual autoregressive distributed lag (ARDL) models based on 30 potential predictors. We then consider different methods from the extant literature for combining the forecasts generated by the individual ARDL models. Using the mean square forecast error (MSFE) metric, we investigate the performance of the forecast combining methods over the last decade, as well as five periods centered on the last five US recessions. Overall, our results show that a number of combining methods outperform a benchmark autoregressive model. Combining methods based on principal components exhibit the best overall performance, while methods based on simple averaging, clusters, and discount MSFE also perform well. On a cautionary note, some combining methods, such as those based on ordinary least squares, often perform quite poorly. Copyright © 2008 John Wiley & Sons, Ltd.     

Finite‐sample properties of tests for equal forecast accuracy

This study examines the small‐sample properties of some commonly used tests of equal forecast accuracy. The paper considers the size and power of different tests and the performance of different heteroscedasticity and autocorrelation‐consistent (HAC) variance estimators. Monte Carlo experiments show that the tests all suffer some size distortions in small samples, with the distortions varying across tests. The experiments also show that, adjusted for size distortions, the tests have broadly similar power, although some small differences exist. Finally, the experiments indicate that the size and power performances of HAC estimators vary with the features of the data. Copyright © 1999 John Wiley & Sons, Ltd.     

Asymptotic prediction of mean squared error for long-memory processes with estimated parameters

In this paper we deal with the prediction theory of long-memory time series. The purpose is to derive a general theory of the convergence of moments of the nonlinear least squares estimator so as to evaluate the asymptotic prediction mean squared error (PMSE). The asymptotic PMSE of two predictors is evaluated. The first is defined by the estimator of the differencing parameter, while the second is defined by a fixed differencing parameter: in other words, a parametric predictor of the seasonal autoregressive integrated moving average model. The effects of misspecifying the differencing parameter is a long-memory model are clarified by the asymptotic results relating to the PMSE. The finite sample behaviour of the predictor and the model selection in terms of PMSE of the two predictors are examined using simulation, and the source of any differences in behaviour made clear in terms of asymptotic theory. Copyright © 2008 John Wiley & Sons, Ltd.     

Forecasting the price of crude oil via convenience yield predictions

The paper develops an oil price forecasting technique which is based on the present value model of rational commodity pricing. The approach suggests shifting the forecasting problem to the marginal convenience yield, which can be derived from the cost‐of‐carry relationship. In a recursive out‐of‐sample analysis, forecast accuracy at horizons within one year is checked by the root mean squared error as well as the mean error and the frequency of a correct direction‐of‐change prediction. For all criteria employed, the proposed forecasting tool outperforms the approach of using futures prices as direct predictors of future spot prices. Vis‐à‐vis the random‐walk model, it does not significantly improve forecast accuracy but provides valuable statements on the direction of change. Copyright © 2007 John Wiley & Sons, Ltd.     

The Predictive Performance Evaluation of Biased Regression Predictors With Correlated Errors

When the interdependence of disturbances is present in a regression model, the pattern of sample residuals contains information which is useful in the prediction of post‐sample drawings and when multicollinearity among regressors is also present, it is useful to use biased regression estimators. This information is exploited in the biased predictors derived here. Also, the predictive performance of various biased predictors with correlated errors is discussed and all pair‐wise comparisons are made among these predictors. The theoretical results are illustrated by a numerical example. Copyright © 2015 John Wiley & Sons, Ltd.     

The effect of target function on the predictive performance of the two‐stage ridge estimator

The main thrust of this study is to consider the problem of simultaneous prediction of actual and average values of the simultaneous equations model through the target function of Shalabh (Bulletin of International Statistical Institute, 1995, 56, 1375–1390). We focus on the predictive performance of the two‐stage ridge estimator with the motivation for eliminating the disorder arising from multicollinearity. An optimal biasing parameter of the two‐stage ridge estimator is derived by a minimization process of prediction mean square error. In addition, an optimal estimator for the weight of observed value in target function is attained theoretically. The results inferred from a numerical example and a Monte Carlo experiment provide a dramatic improvement in the predictive ability of the two‐stage ridge estimator.     

A Bayesian nonlinear support vector machine error correction model

The use of linear error correction models based on stationarity and cointegration analysis, typically estimated with least squares regression, is a common technique for financial time series prediction. In this paper, the same formulation is extended to a nonlinear error correction model using the idea of a kernel‐based implicit nonlinear mapping to a high‐dimensional feature space in which linear model formulations are specified. Practical expressions for the nonlinear regression are obtained in terms of the positive definite kernel function by solving a linear system. The nonlinear least squares support vector machine model is designed within the Bayesian evidence framework that allows us to find appropriate trade‐offs between model complexity and in‐sample model accuracy. From straightforward primal–dual reasoning, the Bayesian framework allows us to derive error bars on the prediction in a similar way as for linear models and to perform hyperparameter and input selection. Starting from the results of the linear modelling analysis, the Bayesian kernel‐based prediction is successfully applied to out‐of‐sample prediction of an aggregated equity price index for the European chemical sector. Copyright © 2006 John Wiley & Sons, Ltd.     

Finite sample forecast results for vector autoregressive moving average models

Using the 'standard' approach to forecasting in the vector autoregressive moving average model, we establish basic general results on exact finite sample forecasts and their mean squared error matrices. Comparison between the exact and conditional methods of initiating the finite sample forecast calculations is presented, and a few illustrative cases are given.     

Estimating and Predicting the General Random Effects Model

This paper extends the ‘remarkable property’ of Breusch (Journal of Econometrics 1987; 36 : 383–389) and Baltagi and Li (Journal of Econometrics 1992; 53 : 45–51) to the three‐way random components framework. Indeed, like its one‐way and two‐way counterparts, the three‐way random effects model maximum likelihood estimation can be obtained as an iterated generalized least squares procedure through an appropriate algorithm of monotonic sequences of some variance components ratios, θ_i (i = 2, 3, 4). More specifically, a search over θ_iwhile iterating on the regression coefficients estimates β and the other θ_jwill guard against the possibility of multiple local maxima of the likelihood function. In addition, the derivations of related prediction functions are obtained based on complete as well as incomplete panels. Finally, an application to international trade issues modeling is presented. Copyright © 2014 John Wiley & Sons, Ltd.     

Shrinkage‐Based Tests of Predictability

In this paper we derive a test of predictability by exploring the possibility that forecasts from a given model, adjusted by a shrinkage factor, will display lower mean squared prediction errors than forecasts from a simple random walk. This generalizes most previous tests which compare forecast errors of a benchmark model with errors of a proposed alternative model, not allowing for shrinkage. We show that our test is a particular extension of a recently developed test of the martingale difference hypothesis. Using simulations we explore the behavior of our test in small and moderate samples. Numerical results indicate that the test has good size and power properties. Finally, we illustrate the use of our test in an empirical application within the exchange rate literature. Copyright © 2012 John Wiley & Sons, Ltd.     

Prediction in an Unbalanced Nested Error Components Panel Data Model

This paper derives the best linear unbiased predictor for an unbalanced nested error components panel data model. This predictor is useful in many econometric applications that are usually based on unbalanced panel data and have a nested (hierarchical) structure. Examples include predicting student performance in a class in a school, or house prices in a neighborhood in a county or a state. Using Monte Carlo simulations, we show that this predictor is better in root mean square error performance than the usual fixed‐ or random‐effects predictors ignoring the nested structure of the data. This is applied to forecasting the productivity of public capital in the private sector using nested panel data of 48 contiguous American states. Copyright © 2013 John Wiley & Sons, Ltd.     

The approximation of long‐memory processes by an ARMA model

A mean square error criterion is proposed in this paper to provide a systematic approach to approximate a long‐memory time series by a short‐memory ARMA(1, 1) process. Analytic expressions are derived to assess the effect of such an approximation. These results are established not only for the pure fractional noise case, but also for a general autoregressive fractional moving average long‐memory time series. Performances of the ARMA(1,1) approximation as compared to using an ARFIMA model are illustrated by both computations and an application to the Nile river series. Results derived in this paper shed light on the forecasting issue of a long‐memory process. Copyright © 2001 John Wiley & Sons, Ltd.     

Updating ARMA predictions for temporal aggregates

This article develops and extends previous investigations on the temporal aggregation of ARMA predications. Given a basic ARMA model for disaggregated data, two sets of predictors may be constructed for future temporal aggregates: predictions based on models utilizing aggregated data or on models constructed from disaggregated data for which forecasts are updated as soon as the new information becomes available. We show that considerable gains in efficiency based on mean‐square‐error‐type criteria can be obtained for short‐term predications when using models based on updated disaggregated data. However, as the prediction horizon increases, the gain in using updated disaggregated data diminishes substantially. In addition to theoretical results associated with forecast efficiency of ARMA models, we also illustrate our findings with two well‐known time series. Copyright © 2004 John Wiley & Sons, Ltd.     

Variable selection and oversampling in the use of smooth support vector machines for predicting the default risk of companies

In the era of Basel II a powerful tool for bankruptcy prognosis is vital for banks. The tool must be precise but also easily adaptable to the bank's objectives regarding the relation of false acceptances (Type I error) and false rejections (Type II error). We explore the suitability of smooth support vector machines (SSVM), and investigate how important factors such as the selection of appropriate accounting ratios (predictors), length of training period and structure of the training sample influence the precision of prediction. Moreover, we show that oversampling can be employed to control the trade‐off between error types, and we compare SSVM with both logistic and discriminant analysis. Finally, we illustrate graphically how different models can be used jointly to support the decision‐making process of loan officers. Copyright © 2008 John Wiley & Sons, Ltd.     

The impact of measurement errors on ARMA prediction

Measurement errors can have dramatic impact on the outcome of empirical analysis. In this article we quantify the effects that they can have on predictions generated from ARMA processes. Lower and upper bounds are derived for differences in minimum mean squared prediction errors (MMSE) for forecasts generated from data with and without errors. The impact that measurement errors have on MMSE and other relative measures of forecast accuracy are presented for a variety of model structures and parameterizations. Based on these results the need to set up the models in state space form to extract the signal component appears to depend upon whether processes are nearly non‐invertible or non‐stationary or whether the noise‐to‐signal ratio is very high. Copyright © 1999 John Wiley & Sons, Ltd.     

Prediction intervals for exponential smoothing using two new classes of state space models

Three general classes of state space models are presented, using the single source of error formulation. The first class is the standard linear model with homoscedastic errors, the second retains the linear structure but incorporates a dynamic form of heteroscedasticity, and the third allows for non‐linear structure in the observation equation as well as heteroscedasticity. These three classes provide stochastic models for a wide variety of exponential smoothing methods. We use these classes to provide exact analytic (matrix) expressions for forecast error variances that can be used to construct prediction intervals one or multiple steps ahead. These formulas are reduced to non‐matrix expressions for 15 state space models that underlie the most common exponential smoothing methods. We discuss relationships between our expressions and previous suggestions for finding forecast error variances and prediction intervals for exponential smoothing methods. Simpler approximations are developed for the more complex schemes and their validity examined. The paper concludes with a numerical example using a non‐linear model. Copyright © 2005 John Wiley & Sons, Ltd.     

Long‐term streamflow forecasting using artificial neural network based on preprocessing technique

Artificial neural network (ANN) combined with signal decomposing methods is effective for long‐term streamflow time series forecasting. ANN is a kind of machine learning method utilized widely for streamflow time series, and which performs well in forecasting nonstationary time series without the need of physical analysis for complex and dynamic hydrological processes. Most studies take multiple factors determining the streamflow as inputs such as rainfall. In this study, a long‐term streamflow forecasting model depending only on the historical streamflow data is proposed. Various preprocessing techniques, including empirical mode decomposition (EMD), ensemble empirical mode decomposition (EEMD) and discrete wavelet transform (DWT), are first used to decompose the streamflow time series into simple components with different timescale characteristics, and the relation between these components and the original streamflow at the next time step is analyzed by ANN. Hybrid models EMD‐ANN, EEMD‐ANN and DWT‐ANN are developed in this study for long‐term daily streamflow forecasting, and performance measures root mean square error (RMSE), mean absolute percentage error (MAPE) and Nash–Sutcliffe efficiency (NSE) indicate that the proposed EEMD‐ANN method performs better than EMD‐ANN and DWT‐ANN models, especially in high flow forecasting.     

A Multiplicative Error Model with Heterogeneous Components for Forecasting Realized Volatility

To forecast realized volatility, this paper introduces a multiplicative error model that incorporates heterogeneous components: weekly and monthly realized volatility measures. While the model captures the long‐memory property, estimation simply proceeds using quasi‐maximum likelihood estimation. This paper investigates its forecasting ability using the realized kernels of 34 different assets provided by the Oxford‐Man Institute's Realized Library. The model outperforms benchmark models such as ARFIMA, HAR, Log‐HAR and HEAVY‐RM in within‐sample fitting and out‐of‐sample (1‐, 10‐ and 22‐step) forecasts. It performed best in both pointwise and cumulative comparisons of multi‐step‐ahead forecasts, regardless of loss function (QLIKE or MSE). Copyright © 2015 John Wiley & Sons, Ltd.