An experiment to evaluate methods for estimating fossil fuel resources

Estimates of petroleum and natural gas resources vary substantially, both over time and across estimation methods. This paper develops a simulation model of global oil resources to evaluate different resource estimation techniques. Protocols for the Hubbert life cycle and USGS geological analogy methods are developed and applied to synthetic data generated by the model. It is shown that the Hubbert method can generate an accurate estimate as early as twenty years before the peak of global production, but the geological analogy approach overestimates the true resource base over the life cycle of the resource. The results show the applicability of simulation and the synthetic data approach to the problem of evaluating forecasting methods.     

Unemployment variation over the business cycles: a comparison of forecasting models

Asymmetry has been well documented in the business cycle literature. The asymmetric business cycle suggests that major macroeconomic series, such as a country's unemployment rate, are non‐linear and, therefore, the use of linear models to explain their behaviour and forecast their future values may not be appropriate. Many researchers have focused on providing evidence for the non‐linearity in the unemployment series. Only recently have there been some developments in applying non‐linear models to estimate and forecast unemployment rates. A major concern of non‐linear modelling is the model specification problem; it is very hard to test all possible non‐linear specifications, and to select the most appropriate specification for a particular model. Artificial neural network (ANN) models provide a solution to the difficulty of forecasting unemployment over the asymmetric business cycle. ANN models are non‐linear, do not rely upon the classical regression assumptions, are capable of learning the structure of all kinds of patterns in a data set with a specified degree of accuracy, and can then use this structure to forecast future values of the data. In this paper, we apply two ANN models, a back‐propagation model and a generalized regression neural network model to estimate and forecast post‐war aggregate unemployment rates in the USA, Canada, UK, France and Japan. We compare the out‐of‐sample forecast results obtained by the ANN models with those obtained by several linear and non‐linear times series models currently used in the literature. It is shown that the artificial neural network models are able to forecast the unemployment series as well as, and in some cases better than, the other univariate econometrics time series models in our test. Copyright © 2004 John Wiley & Sons, Ltd.     

The performance of non‐linear exchange rate models: a forecasting comparison

In recent years there has been a considerable development in modelling non‐linearities and asymmetries in economic and financial variables. The aim of the current paper is to compare the forecasting performance of different models for the returns of three of the most traded exchange rates in terms of the US dollar, namely the French franc (FF/$), the German mark (DM/$) and the Japanese yen (Y/$). The relative performance of non‐linear models of the SETAR, STAR and GARCH types is contrasted with their linear counterparts. The results show that if attention is restricted to mean square forecast errors, the performance of the models, when distinguishable, tends to favour the linear models. The forecast performance of the models is evaluated also conditional on the regime at the forecast origin and on density forecasts. This analysis produces more evidence of forecasting gains from non‐linear models. Copyright © 2002 John Wiley & Sons, Ltd.     

Evaluating volatility dynamics and the forecasting ability of Markov switching models

This paper uses Markov switching models to capture volatility dynamics in exchange rates and to evaluate their forecasting ability. We identify that increased volatilities in four euro‐based exchange rates are due to underlying structural changes. Also, we find that currencies are closely related to each other, especially in high‐volatility periods, where cross‐correlations increase significantly. Using Markov switching Monte Carlo approach we provide evidence in favour of Markov switching models, rejecting random walk hypothesis. Testing in‐sample and out‐of‐sample Markov trading rules based on Dueker and Neely (Journal of Banking and Finance, 2007) we find that using econometric methodology is able to forecast accurately exchange rate movements. When applied to the Euro/US dollar and the euro/British pound daily returns data, the model provides exceptional out‐of‐sample returns. However, when applied to the euro/Brazilian real and the euro/Mexican peso, the model loses power. Higher volatility exercised in the Latin American currencies seems to be a critical factor for this failure. Copyright © 2009 John Wiley & Sons, Ltd.     

A forecasting procedure for nonlinear autoregressive time series models

Forecasting for nonlinear time series is an important topic in time series analysis. Existing numerical algorithms for multi‐step‐ahead forecasting ignore accuracy checking, alternative Monte Carlo methods are also computationally very demanding and their accuracy is difficult to control too. In this paper a numerical forecasting procedure for nonlinear autoregressive time series models is proposed. The forecasting procedure can be used to obtain approximate m‐step‐ahead predictive probability density functions, predictive distribution functions, predictive mean and variance, etc. for a range of nonlinear autoregressive time series models. Examples in the paper show that the forecasting procedure works very well both in terms of the accuracy of the results and in the ability to deal with different nonlinear autoregressive time series models. Copyright © 2005 John Wiley & Sons, Ltd.     

A fractal forecasting model for financial time series

Financial market time series exhibit high degrees of non‐linear variability, and frequently have fractal properties. When the fractal dimension of a time series is non‐integer, this is associated with two features: (1) inhomogeneity—extreme fluctuations at irregular intervals, and (2) scaling symmetries—proportionality relationships between fluctuations over different separation distances. In multivariate systems such as financial markets, fractality is stochastic rather than deterministic, and generally originates as a result of multiplicative interactions. Volatility diffusion models with multiple stochastic factors can generate fractal structures. In some cases, such as exchange rates, the underlying structural equation also gives rise to fractality. Fractal principles can be used to develop forecasting algorithms. The forecasting method that yields the best results here is the state transition‐fitted residual scale ratio (ST‐FRSR) model. A state transition model is used to predict the conditional probability of extreme events. Ratios of rates of change at proximate separation distances are used to parameterize the scaling symmetries. Forecasting experiments are run using intraday exchange rate futures contracts measured at 15‐minute intervals. The overall forecast error is reduced on average by up to 7% and in one instance by nearly a quarter. However, the forecast error during the outlying events is reduced by 39% to 57%. The ST‐FRSR reduces the predictive error primarily by capturing extreme fluctuations more accurately. Copyright © 2004 John Wiley & Sons, Ltd.     

A comparison of adaptive structural forecasting methods for electricity sales

This paper presents the results of a study to determine whether new forecasting technologies might be of use to electric utilities for sales forecasting up to 3 years into the future. The methods considered included ordinary least squares on dynamic structural models, autocorrelated error models, adaptive variance and adaptive parameter models. Overall, the more adaptive models performed best, but most of the methods proved vastly superior to simple least squares models which do not take dynamics into account.     

Structural,VAR and BVAR models of exchange rate determination: A comparison of their forecasting performance

This paper compares the out-of-sample forecasting accuracy of a wide class of structural, BVAR and VAR models for major sterling exchange rates over different forecast horizons. As representative structural models we employ a portfolio balance model and a modified uncovered interest parity model, with the latter producing the more accurate forecasts. Proper attention to the long-run properties and the short-run dynamics of structural models can improve on the forecasting performance of the random walk model. The structural model shows substantial improvement in medium-term forecasting accuracy, whereas the BVAR model is the more accurate in the short term. BVAR and VAR models in levels strongly out predict these models formulated in difference form at all forecast horizons.     

Evaluation of correlation forecasting models for risk management

Reliable correlation forecasts are of paramount importance in modern risk management systems. A plethora of correlation forecasting models have been proposed in the open literature, yet their impact on the accuracy of value‐at‐risk calculations has not been explicitly investigated. In this paper, traditional and modern correlation forecasting techniques are compared using standard statistical and risk management loss functions. Three portfolios consisting of stocks, bonds and currencies are considered. We find that GARCH models can better account for the correlation's dynamic structure in the stock and bond portfolios. On the other hand, simpler specifications such as the historical mean model or simple moving average models are better suited for the currency portfolio. Copyright © 2007 John Wiley & Sons, Ltd.     

Short term load forecasting in electric power systems: A comparison of ARMA models and extended wiener filtering

On-line prediction of electric load in the buses of the EHV grid of a power generation and transmission system is basic information required by on-line procedures for centralized advanced dispatching of power generation. This paper presents two alternative approaches to on-line short term forecasting of the residual component of the load obtained after the removal of the base load from a time series of total load. The first approach involves the use of stochastic ARMA models with time-varying coefficients. The second consists in the use of an extension of Wiener filtering due to Zadeh and Ragazzini. Real data representing a load process measured in an area of Northern Italy and simulated data reproducing a non-stationary process with known characteristics constitute the basis of a numerical comparison allowing one to determine under which conditions each method is more appropriate.     

A forecasting comparison of classical and Bayesian methods for modelling logistic diffusion

A Bayesian procedure for forecasting S‐shaped growth is introduced and compared to classical methods of estimation and prediction using three variants of the logistic functional form and annual times series of the diffusion of music compact discs in twelve countries. The Bayesian procedure was found not only to improve forecast accuracy, using the medians of the predictive densities as point forecasts, but also to produce intervals with a width and asymmetry more in accord with the outcomes than intervals from the classical alternative. While the analysis in this paper focuses on logistic growth, the problem is set up so that the methods are transportable to other characterizations of the growth process. Copyright © 2001 John Wiley & Sons, Ltd.     

A comparison of approximate Bayesian forecasting methods for non‐Gaussian time series

We present the results on the comparison of efficiency of approximate Bayesian methods for the analysis and forecasting of non‐Gaussian dynamic processes. A numerical algorithm based on MCMC methods has been developed to carry out the Bayesian analysis of non‐linear time series. Although the MCMC‐based approach is not fast, it allows us to study the efficiency, in predicting future observations, of approximate propagation procedures that, being algebraic, have the practical advantage of being very quick. Copyright © 2000 John Wiley & Sons, Ltd.     

Linear regression forecasting in the presence of ar(1) disturbances

This paper is concerned with time-series forecasting based on the linear regression model in the presence of AR(1) disturbances. The standard approach is to estimate the AR(1) parameter, ρ, and then construct forecasts assuming the estimated value is the true value. We introduce a new approach which can be viewed as a weighted average of predictions assuming different values of ρ. The weights are proportional to the marginal likelihood of ρ. A Monte Carlo experiment was conducted to compare the new method with five more conventional predictors. Its results suggest that the new approach has a distinct edge over existing procedures.     

Adaptive forecasting of the EURIBOR swap term structure

In this paper we adopt a principal components analysis (PCA) to reduce the dimensionality of the term structure and employ autoregressive (AR) models to forecast principal components which, in turn, are used to forecast swap rates. Arguing in favour of structural variation, we propose data‐driven, adaptive model selection strategies based on the PCA/AR model. To evaluate ex ante forecasting performance for particular rates, distinct forecast features, such as mean squared errors, directional accuracy and directional forecast value, are considered. It turns out that, relative to benchmark models, the adaptive approach offers additional forecast accuracy in terms of directional accuracy and directional forecast value. Copyright © 2009 John Wiley & Sons, Ltd.     

A comparison of two models of scientific progress

Does science progress toward some goal or merely away from primitive beginnings? Two agent-based models are built to explain how possibly both kinds of progressive scientific change can result from the interactions of individuals exploring an epistemic landscape. These models are shown to result in qualitatively different predictions about what the resulting system of science should be like.     

Google Trends and the forecasting performance of exchange rate models

In this paper, we use Google Trends data for exchange rate forecasting in the context of a broad literature review that ties the exchange rate movements with macroeconomic fundamentals. The sample covers 11 OECD countries’ exchange rates for the period from January 2004 to June 2014. In out‐of‐sample forecasting of monthly returns on exchange rates, our findings indicate that the Google Trends search query data do a better job than the structural models in predicting the true direction of changes in nominal exchange rates. We also observed that Google Trends‐based forecasts are better at picking up the direction of the changes in the monthly nominal exchange rates after the Great Recession era (2008–2009). Based on the Clark and West inference procedure of equal predictive accuracy testing, we found that the relative performance of Google Trends‐based exchange rate predictions against the null of a random walk model is no worse than the purchasing power parity model. On the other hand, although the monetary model fundamentals could beat the random walk null only in one out of 11 currency pairs, with Google Trends predictors we found evidence of better performance for five currency pairs. We believe that these findings necessitate further research in this area to investigate the extravalue one can get from Google search query data.     

A comparison between linear and nonlinear forecasts for nonlinear AR models

In this paper the relative forecast performance of nonlinear models to linear models is assessed by the conditional probability that the absolute forecast error of the nonlinear forecast is smaller than that of the linear forecast. The comparison probability is explicitly expressed and is shown to be an increasing function of the distance between nonlinear and linear forecasts under certain conditions. This expression of the comparison probability may not only be useful in determining the predictor, which is either a more accurate or a simpler forecast, to be used but also provides a good explanation for an odd phenomenon discussed by Pemberton. The relative forecast performance of a nonlinear model to a linear model is demonstrated to be sensitive to its forecast origins. A new forecast is thus proposed to improve the relative forecast performance of nonlinear models based on forecast origins. © 1997 John Wiley & Sons, Ltd.     

Evaluating the predictive accuracy of volatility models

Standard statistical loss functions, such as mean‐squared error, are commonly used for evaluating financial volatility forecasts. In this paper, an alternative evaluation framework, based on probability scoring rules that can be more closely tailored to a forecast user's decision problem, is proposed. According to the decision at hand, the user specifies the economic events to be forecast, the scoring rule with which to evaluate these probability forecasts, and the subsets of the forecasts of particular interest. The volatility forecasts from a model are then transformed into probability forecasts of the relevant events and evaluated using the selected scoring rule and calibration tests. An empirical example using exchange rate data illustrates the framework and confirms that the choice of loss function directly affects the forecast evaluation results. Copyright © 2001 John Wiley & Sons, Ltd.     

Comparing the accuracy of density forecasts from competing models

A rapidly growing literature emphasizes the importance of evaluating the forecast accuracy of empirical models on the basis of density (as opposed to point) forecasting performance. We propose a test statistic for the null hypothesis that two competing models have equal density forecast accuracy. Monte Carlo simulations suggest that the test, which has a known limiting distribution, displays satisfactory size and power properties. The use of the test is illustrated with an application to exchange rate forecasting. Copyright © 2004 John Wiley & Sons, Ltd.     

On the usefulness of macroeconomic forecasts as inputs to forecasting models

A forecasting model for y_t based on its relationship to exogenous variables (e.g. x?_t) must use x?_t, the forecast of x?_t. An example is given where commercially available x?_t's are sufficiently inaccurate that a univariate model for y_t appears preferable. For a variety of types of models inclusion of an exogenous variable x?_t is shown to worsen the y_t forecasts whenever x?_t must itself be forecast by x?_t and MSE (x?_t) > Var (x?_t). Tests with forecasts from a variety of sources indicate that, with a few notable exceptions, MSE (x?_t) > Var (x?_t) is common for macroeconomic forecasts more than a quarter or two ahead. Thus, either:

• (a) available medium range forecasts for many macroeconomic variables (e.g. the GNP growth rate) are not an improvement over the sample mean (so that such variables are not useful explanatory variables in forecasting models), and/or
• (b) the suboptimization involved in directly replacing x?_t by x?_t is a luxury that we cannot afford.