Long‐term streamflow forecasting using artificial neural network based on preprocessing technique

Artificial neural network (ANN) combined with signal decomposing methods is effective for long‐term streamflow time series forecasting. ANN is a kind of machine learning method utilized widely for streamflow time series, and which performs well in forecasting nonstationary time series without the need of physical analysis for complex and dynamic hydrological processes. Most studies take multiple factors determining the streamflow as inputs such as rainfall. In this study, a long‐term streamflow forecasting model depending only on the historical streamflow data is proposed. Various preprocessing techniques, including empirical mode decomposition (EMD), ensemble empirical mode decomposition (EEMD) and discrete wavelet transform (DWT), are first used to decompose the streamflow time series into simple components with different timescale characteristics, and the relation between these components and the original streamflow at the next time step is analyzed by ANN. Hybrid models EMD‐ANN, EEMD‐ANN and DWT‐ANN are developed in this study for long‐term daily streamflow forecasting, and performance measures root mean square error (RMSE), mean absolute percentage error (MAPE) and Nash–Sutcliffe efficiency (NSE) indicate that the proposed EEMD‐ANN method performs better than EMD‐ANN and DWT‐ANN models, especially in high flow forecasting.     

An integrated bayesian vector auto regression and error correction model for forecasting electricity consumption and prices

The analysis and forecasting of electricity consumption and prices has received considerable attention over the past forty years. In the 1950s and 1960s most of these forecasts and analyses were generated by simultaneous equation econometric models. Beginning in the 1970s, there was a shift in the modeling of economic variables from the structural equations approach with strong identifying restrictions towards a joint time-series model with very few restrictions. One such model is the vector auto regression (VAR) model. It was soon discovered that the unrestricted VAR models do not forecast well. The Bayesian vector auto regression (BVAR) approach as well the error correction model (ECM) and models based on the theory of co integration have been offered as alternatives to the simple VAR model. This paper argues that the BVAF., ECM, and co integration models are simply VAR models with various restrictions placed on the coefficients. Based on this notion of a restricted VAR model, a four-step procedure for specifying VAR forecasting models is presented and then applied to monthly data on US electricity consumption and prices.     

Why do EMD‐based methods improve prediction? A multiscale complexity perspective

Empirical mode decomposition (EMD)‐based ensemble methods have become increasingly popular in the research field of forecasting, substantially enhancing prediction accuracy. The key factor in this type of method is the multiscale decomposition that immensely mitigates modeling complexity. Accordingly, this study probes this factor and makes further innovations from a new perspective of multiscale complexity. In particular, this study quantitatively investigates the relationship between the decomposition performance and prediction accuracy, thereby developing (1) a novel multiscale complexity measurement (for evaluating multiscale decomposition), (2) a novel optimized EMD (OEMD) (considering multiscale complexity), and (3) a novel OEMD‐based forecasting methodology (using the proposed OEMD in multiscale analysis). With crude oil and natural gas prices as samples, the empirical study statistically indicates that the forecasting capability of EMD‐based methods is highly reliant on the decomposition performance; accordingly, the proposed OEMD‐based methods considering multiscale complexity significantly outperform the benchmarks based on typical EMDs in prediction accuracy.     

Forecasting Simultaneously High‐Dimensional Time Series: A Robust Model‐Based Clustering Approach

This paper considers the problem of forecasting high‐dimensional time series. It employs a robust clustering approach to perform classification of the component series. Each series within a cluster is assumed to follow the same model and the data are then pooled for estimation. The classification is model‐based and robust to outlier contamination. The robustness is achieved by using the intrinsic mode functions of the Hilbert–Huang transform at lower frequencies. These functions are found to be robust to outlier contamination. The paper also compares out‐of‐sample forecast performance of the proposed method with several methods available in the literature. The other forecasting methods considered include vector autoregressive models with ∕ without LASSO, group LASSO, principal component regression, and partial least squares. The proposed method is found to perform well in out‐of‐sample forecasting of the monthly unemployment rates of 50 US states. Copyright © 2013 John Wiley & Sons, Ltd.     

Time series forecasting using functional partial least square regression with stochastic volatility,GARCH, and exponential smoothing

We propose a method for improving the predictive ability of standard forecasting models used in financial economics. Our approach is based on the functional partial least squares (FPLS) model, which is capable of avoiding multicollinearity in regression by efficiently extracting information from the high‐dimensional market data. By using its well‐known ability, we can incorporate auxiliary variables that improve the predictive accuracy. We provide an empirical application of our proposed methodology in terms of its ability to predict the conditional average log return and the volatility of crude oil prices via exponential smoothing, Bayesian stochastic volatility, and GARCH (generalized autoregressive conditional heteroskedasticity) models, respectively. In particular, what we call functional data analysis (FDA) traces in this article are obtained via the FPLS regression from both the crude oil returns and auxiliary variables of the exchange rates of major currencies. For forecast performance evaluation, we compare out‐of‐sample forecasting accuracy of the standard models with FDA traces to the accuracy of the same forecasting models with the observed crude oil returns, principal component regression (PCR), and least absolute shrinkage and selection operator (LASSO) models. We find evidence that the standard models with FDA traces significantly outperform our competing models. Finally, they are also compared with the test for superior predictive ability and the reality check for data snooping. Our empirical results show that our new methodology significantly improves predictive ability of standard models in forecasting the latent average log return and the volatility of financial time series.     

Energy consumption,survey data and the prediction of industrial production in Italy: a comparison and combination of different models

We investigate the prediction of italian industrial production and first specify a model based on electricity consumption showing that the cubic trend in such a model mostly captures the evolution over time of the electricity coefficient, which can be well approximated by a smooth transition model, with no gains in predictive power. We also analyse the performance of models based on data of two different business surveys. According to the standard statistics of forecasting accuracy, the linear energy‐based model is not outperformed by any other model, nor by a combination of forecasts. However, a more comprehensive set of evaluation criteria sheds light on the relative merit of each individual model. A modelling strategy which makes full use of all information available is proposed. Copyright © 2000 John Wiley & Sons, Ltd.     

Time series forecasting using robust regression

The method of ordinary least squares (OLS) and generalizations of it have been the mainstay of most forecasting methodologies for many years. It is well-known, however, that outliers or unusual values can have a large influence on least-squares estimators. Users of automatic forecasting packages, in particular, need to be aware of the influence that outlying data values can have on statistical analyses and forecasting results. Robust methods are available to modify least-squares procedures so that outliers have much less influence on the final estimates; yet these formal methods have not found their way into general forecasting procedures. This paper provides a case study in which classical least-square-estimation procedures are complemented with a robust alternative to enhance statistical fit criteria and improve forecasting performance. The study suggests that much can be gained in understanding the nature of outliers and their influence on forecasting performance by performing a robust regression in addition to OLS.     

Short‐term forecasting of industrial electricity consumption in Brazil

This paper presents short‐term forecasting methods applied to electricity consumption in Brazil. The focus is on comparing the results obtained after using two distinct approaches: dynamic non‐linear models and econometric models. The first method, that we propose, is based on structural statistical models for multiple time series analysis and forecasting. It involves non‐observable components of locally linear trends for each individual series and a shared multiplicative seasonal component described by dynamic harmonics. The second method, adopted by the electricity power utilities in Brazil, consists of extrapolation of the past data and is based on statistical relations of simple or multiple regression type. To illustrate the proposed methodology, a numerical application is considered with real data. The data represents the monthly industrial electricity consumption in Brazil from the three main power utilities: Eletropaulo, Cemig and Light, situated at the major energy‐consuming states, Sao Paulo, Rio de Janeiro and Minas Gerais, respectively, in the Brazilian Southeast region. The chosen time period, January 1990 to September 1994, corresponds to an economically unstable period just before the beginning of the Brazilian Privatization Program. Implementation of the algorithms considered in this work was made via the statistical software S‐PLUS. Copyright © 1999 John Wiley & Sons, Ltd.     

Technological forecasting with nonlinear models

The S-shaped growth curves such as Gompertz, logistic, normal and Weibuli are widely used for forecasting technological substitutions. A family of data-based transformed (DBT) models, which are linear in the regression parameters, including the above-mentioned four models as special cases has been shown to be quite useful for short-term forecasts. This paper explores modeling the technology penetration data directly with assumed S-shaped growth curves. The resulting models, which are nonlinear in the regression parameters, also incorporate proper dependence structure and power transformation. It appears that the nonlinear modeling is a viable alternative to the DBT and other conventional forecasting models in forecasting technological substitutions. Hence, an appropriate strategy is to consider the nonlinear modeling approaches as possible alternatives and use the data at hand to select, via pseudo-cross-validation, the best model for forecasting purposes.     

Forecasting Daily and Monthly Exchange Rates with Machine Learning Techniques

In this paper we propose and test a forecasting model on monthly and daily spot prices of five selected exchange rates. In doing so, we combine a novel smoothing technique (initially applied in signal processing) with a variable selection methodology and two regression estimation methodologies from the field of machine learning (ML). After the decomposition of the original exchange rate series using an ensemble empirical mode decomposition (EEMD) method into a smoothed and a fluctuation component, multivariate adaptive regression splines (MARS) are used to select the most appropriate variable set from a large set of explanatory variables that we collected. The selected variables are then fed into two distinctive support vector machines (SVR) models that produce one‐period‐ahead forecasts for the two components. Neural networks (NN) are also considered as an alternative to SVR. The sum of the two forecast components is the final forecast of the proposed scheme. We show that the above implementation exhibits a superior in‐sample and out‐of‐sample forecasting ability when compared to alternative forecasting models. The empirical results provide evidence against the efficient market hypothesis for the selected foreign exchange markets. Copyright © 2015 John Wiley & Sons, Ltd.     

Comparison of two non‐parametric models for daily traffic forecasting in Hong Kong

The most up‐to‐date annual average daily traffic (AADT) is always required for transport model development and calibration. However, the current‐year AADT data are not always available. The short‐term traffic flow forecasting models can be used to predict the traffic flows for the current year. In this paper, two non‐parametric models, non‐parametric regression (NPR) and Gaussian maximum likelihood (GML), are chosen for short‐term traffic forecasting based on historical data collected for the annual traffic census (ATC) in Hong Kong. These models are adapted as they are more flexible and efficient in forecasting the daily vehicular flows in the Hong Kong ATC core stations (in total of 87 stations). The daily vehicular flows predicted by these models are then used to calculate the AADT of the current year, 1999. The overall prediction and comparison results show that the NPR model produces better forecasts than the GML model using the ATC data in Hong Kong. Copyright © 2006 John Wiley _ Sons, Ltd.     

Forecasting load-duration curves

A new method is proposed for forecasting electricity load-duration curves. The approach first forecasts the load curve and then uses the resulting predictive densities to forecast the load-duration curve. A virtue of this procedure is that both load curves and load-duration curves can be predicted using the same model, and confidence intervals can be generated for both predictions. The procedure is applied to the problem of predicting New Zealand electricity consumption. A structural time-series model is used to forecast the load curve based on half-hourly data. The model is tailored to handle effects such as daylight savings, holidays and weekends, as well as trend, annual, weekly and daily cycles. Time-series methods, including Kalman filtering, smoothing and prediction, are used to fit the model and to achieve the desired forecasts of the load-duration curve.     

Multivariate Bayesian regression applied to the problem of network security

An Erratum has been published for this article in Journal of Forecasting 23(6): 461 (2004) . This paper examines the problem of intrusion in computer systems that causes major breaches or allows unauthorized information manipulation. A new intrusion‐detection system using Bayesian multivariate regression is proposed to predict such unauthorized invasions before they occur and to take further action. We develop and use a multivariate dynamic linear model based on a unique approach leaving the unknown observational variance matrix distribution unspecified. The result is simultaneous forecasting free of the Wishart limitations that is proved faster and more reliable. Our proposed system uses software agent technology. The distributed software agent environment places an agent in each of the computer system workstations. The agent environment creates a user profile for each user. Every user has his or her profile monitored by the agent system and according to our statistical model prediction is possible. Implementation aspects are discussed using real data and an assessment of the model is provided. Copyright © 2002 John Wiley & Sons, Ltd.     

Trading volume and realized volatility forecasting: Evidence from the China stock market

The existing contradictory findings on the contribution of trading volume to volatility forecasting prompt us to seek new solutions to test the sequential information arrival hypothesis (SIAH). Departing from other empirical analyses that mainly focus on sophisticated testing methods, this research offers new insights into the volume-volatility nexus by decomposing and reconstructing the trading activity into short-run components that typically represent irregular information flow and long-run components that denote extreme information flow in the stock market. We are the first to attempt at incorporating an improved empirical mode decomposition (EMD) method to investigate the volatility forecasting ability of trading volume along with the Heterogeneous Autoregressive (HAR) model. Previous trading volume is used to obtain the decompositions to forecast the future volatility to ensure an ex ante forecast, and both the decomposition and forecasting processes are carried out by the rolling window scheme. Rather than trading volume by itself, the results show that the reconstructed components are also able to significantly improve out-of-sample realized volatility (RV) forecasts. This finding is robust both in one-step ahead and multiple-step ahead forecasting horizons under different estimation windows. We thus fill the gap in studies by (1) extending the literature on the volume-volatility linkage to EMD-HAR analysis and (2) providing a clear view on how trading volume helps improve RV forecasting accuracy.     

Forecasting economic time series that require a power transformation: Case of state tax receipts

In this study, time series analysis is applied to the problem of forecasting state income tax receipts. The data series is of special interest since it exhibits a strong trend with a high multiplicative seasonal component. An appropriate model is identified by simultaneous estimation of the parameters of the power transformation and the ARMA model using the Schwarz (1978) Bayesian information criterion. The forecasting performance of the time series model obtained from this procedure is compared with alternative time series and regression models. The study illustrates how an information criterion can be employed for identifying time series models that require a power transformation, as exemplified by state tax receipts. It also establishes time series analysis as a viable technique for forecasting state tax receipts.     

Multicollinearity in regression: Review and examples

When building regression models for forecasting, analysts often encounter the problem of multicollinearity or illconditioning in their data sets. In such cases, large variances and covariances can make subset selection and parameter estimation difficult to impossible. In this paper, we suggest several approaches for extending estimation results to forecasting and review theoretical results useful for forecasting with multicollinearity. Several examples are provided.     

Currency forecasting based on an error components‐seemingly unrelated nonlinear regression model

This paper proposes to forecast foreign exchange rates by means of an error components‐seemingly unrelated nonlinear regression (EC‐SUNR) model and, simultaneously, explore the interrelationships among currencies from newly industrializing economies with those of highly industrialized countries. Based on the empirical results, we find that the EC‐SUNR model improves on the performance of forecasting foreign exchange rates in comparison with an intrinsically nonlinear dynamic speed of adjustment model that has been shown to outperform several other important models in the forecasting literature. We also find evidence showing that the foreign exchange markets of the newly industrializing countries are influenced by those of the highly industrialized countries and vice versa, and that such interrelationships affect the accuracy of currency forecasting. Copyright © 2005 John Wiley & Sons, Ltd.     

基于粗糙集与灰色动态预测模型在电力负荷短期预测的应用

针对电力系统多因素负荷预测问题的复杂性,结合粗糙集理论与GM（1,N）模型各自的优势,提出一种基于粗糙集理论的GM（1,N）预测模型.采取粗糙集理论对影响负荷预测因素进行简约,利用GM（1,N）建立简约后的因素变量和负荷之间的关系建立模型,并与GM（1,1）预测模型进行了比较,结果反映基于粗糙集理论的GM（1,N）预测模型的优越性,精准度达到94.055%.     

Collinearity and the use of latent root regression for combining GNP forecasts

In combining economic forecasts a problem often faced is that the individual forecasts display some degree of dependence. We discuss latent root regression for combining collinear GNP forecasts. Our results indicate that latent root regression produces more efficient combining weight estimates (regression parameter estimates) than ordinary least squares estimation (OLS), although out-of-sample forecasting performance is comparable to OLS.     

Vector smooth transition regression models for US GDP and the composite index of leading indicators

In this paper, I extend to a multiple‐equation context the linearity, model selection and model adequacy tests recently proposed for univariate smooth transition regression models. Using this result, I examine the nonlinear forecasting power of the Conference Board composite index of leading indicators to predict both output growth and the business‐cycle phases of the US economy in real time. Copyright © 2004 John Wiley & Sons, Ltd.