Forecasting Daily and Monthly Exchange Rates with Machine Learning Techniques

In this paper we propose and test a forecasting model on monthly and daily spot prices of five selected exchange rates. In doing so, we combine a novel smoothing technique (initially applied in signal processing) with a variable selection methodology and two regression estimation methodologies from the field of machine learning (ML). After the decomposition of the original exchange rate series using an ensemble empirical mode decomposition (EEMD) method into a smoothed and a fluctuation component, multivariate adaptive regression splines (MARS) are used to select the most appropriate variable set from a large set of explanatory variables that we collected. The selected variables are then fed into two distinctive support vector machines (SVR) models that produce one‐period‐ahead forecasts for the two components. Neural networks (NN) are also considered as an alternative to SVR. The sum of the two forecast components is the final forecast of the proposed scheme. We show that the above implementation exhibits a superior in‐sample and out‐of‐sample forecasting ability when compared to alternative forecasting models. The empirical results provide evidence against the efficient market hypothesis for the selected foreign exchange markets. Copyright © 2015 John Wiley & Sons, Ltd.     

An Adaptive Multiscale Ensemble Learning Paradigm for Nonstationary and Nonlinear Energy Price Time Series Forecasting

For forecasting nonstationary and nonlinear energy prices time series, a novel adaptive multiscale ensemble learning paradigm incorporating ensemble empirical mode decomposition (EEMD), particle swarm optimization (PSO) and least square support vector machines (LSSVM) with kernel function prototype is developed. Firstly, the extrema symmetry expansion EEMD, which can effectively restrain the mode mixing and end effects, is used to decompose the energy price into simple modes. Secondly, by using the fine‐to‐coarse reconstruction algorithm, the high‐frequency, low‐frequency and trend components are identified. Furthermore, autoregressive integrated moving average is applicable to predicting the high‐frequency components. LSSVM is suitable for forecasting the low‐frequency and trend components. At the same time, a universal kernel function prototype is introduced for making up the drawbacks of single kernel function, which can adaptively select the optimal kernel function type and model parameters according to the specific data using the PSO algorithm. Finally, the prediction results of all the components are aggregated into the forecasting values of energy price time series. The empirical results show that, compared with the popular prediction methods, the proposed method can significantly improve the prediction accuracy of energy prices, with high accuracy both in the level and directional predictions. Copyright © 2016 John Wiley & Sons, Ltd.     

Long‐term streamflow forecasting using artificial neural network based on preprocessing technique

Artificial neural network (ANN) combined with signal decomposing methods is effective for long‐term streamflow time series forecasting. ANN is a kind of machine learning method utilized widely for streamflow time series, and which performs well in forecasting nonstationary time series without the need of physical analysis for complex and dynamic hydrological processes. Most studies take multiple factors determining the streamflow as inputs such as rainfall. In this study, a long‐term streamflow forecasting model depending only on the historical streamflow data is proposed. Various preprocessing techniques, including empirical mode decomposition (EMD), ensemble empirical mode decomposition (EEMD) and discrete wavelet transform (DWT), are first used to decompose the streamflow time series into simple components with different timescale characteristics, and the relation between these components and the original streamflow at the next time step is analyzed by ANN. Hybrid models EMD‐ANN, EEMD‐ANN and DWT‐ANN are developed in this study for long‐term daily streamflow forecasting, and performance measures root mean square error (RMSE), mean absolute percentage error (MAPE) and Nash–Sutcliffe efficiency (NSE) indicate that the proposed EEMD‐ANN method performs better than EMD‐ANN and DWT‐ANN models, especially in high flow forecasting.     

On the forecasting of high-frequency financial time series based on ARIMA model improved by deep learning

Through empirical research, it is found that the traditional autoregressive integrated moving average (ARIMA) model has a large deviation for the forecasting of high-frequency financial time series. With the improvement in storage capacity and computing power of high-frequency financial time series, this paper combines the traditional ARIMA model with the deep learning model to forecast high-frequency financial time series. It not only preserves the theoretical basis of the traditional model and characterizes the linear relationship, but also can characterize the nonlinear relationship of the error term according to the deep learning model. The empirical study of Monte Carlo numerical simulation and CSI 300 index in China show that, compared with ARIMA, support vector machine (SVM), long short-term memory (LSTM) and ARIMA-SVM models, the improved ARIMA model based on LSTM not only improves the forecasting accuracy of the single ARIMA model in both fitting and forecasting, but also reduces the computational complexity of only a single deep learning model. The improved ARIMA model based on deep learning not only enriches the models for the forecasting of time series, but also provides effective tools for high-frequency strategy design to reduce the investment risks of stock index.     

Stock market volatility and the forecasting performance of stock index futures

This study attempts to apply the general equilibrium model of stock index futures with both stochastic market volatility and stochastic interest rates to the TAIFEX and the SGX Taiwan stock index futures data, and compares the predictive power of the cost of carry and the general equilibrium models. This study also represents the first attempt to investigate which of the five volatility estimators can enhance the forecasting performance of the general equilibrium model. Additionally, the impact of the up‐tick rule and other various explanatory factors on mispricing is also tested using a regression framework. Overall, the general equilibrium model outperforms the cost of carry model in forecasting prices of the TAIFEX and the SGX futures. This finding indicates that in the higher volatility of the Taiwan stock market incorporating stochastic market volatility into the pricing model helps in predicting the prices of these two futures. Furthermore, the comparison results of different volatility estimators support the conclusion that the power EWMA and the GARCH(1,1) estimators can enhance the forecasting performance of the general equilibrium model compared to the other estimators. Additionally, the relaxation of the up‐tick rule helps reduce the degree of mispricing. Copyright © 2008 John Wiley & Sons, Ltd.     

Stock index prediction based on wavelet transform and FCD-MLGRU

With the development of artificial intelligence, deep learning is widely used in the field of nonlinear time series forecasting. It is proved in practice that deep learning models have higher forecasting accuracy compared with traditional linear econometric models and machine learning models. With the purpose of further improving forecasting accuracy of financial time series, we propose the WT-FCD-MLGRU model, which is the combination of wavelet transform, filter cycle decomposition and multilag neural networks. Four major stock indices are chosen to test the forecasting performance among traditional econometric model, machine learning model and deep learning models. According to the result of empirical analysis, deep learning models perform better than traditional econometric model such as autoregressive integrated moving average and improved machine learning model SVR. Besides, our proposed model has the minimum forecasting error in stock index prediction.     

Short‐term salmon price forecasting

This study establishes a benchmark for short‐term salmon price forecasting. The weekly spot price of Norwegian farmed Atlantic salmon is predicted 1–5 weeks ahead using data from 2007 to 2014. Sixteen alternative forecasting methods are considered, ranging from classical time series models to customized machine learning techniques to salmon futures prices. The best predictions are delivered by k‐nearest neighbors method for 1 week ahead; vector error correction model estimated using elastic net regularization for 2 and 3 weeks ahead; and futures prices for 4 and 5 weeks ahead. While the nominal gains in forecast accuracy over a naïve benchmark are small, the economic value of the forecasts is considerable. Using a simple trading strategy for timing the sales based on price forecasts could increase the net profit of a salmon farmer by around 7%.     

Forecasting volatility with support vector machine‐based GARCH model

Recently, support vector machine (SVM), a novel artificial neural network (ANN), has been successfully used for financial forecasting. This paper deals with the application of SVM in volatility forecasting under the GARCH framework, the performance of which is compared with simple moving average, standard GARCH, nonlinear EGARCH and traditional ANN‐GARCH models by using two evaluation measures and robust Diebold–Mariano tests. The real data used in this study are daily GBP exchange rates and NYSE composite index. Empirical results from both simulation and real data reveal that, under a recursive forecasting scheme, SVM‐GARCH models significantly outperform the competing models in most situations of one‐period‐ahead volatility forecasting, which confirms the theoretical advantage of SVM. The standard GARCH model also performs well in the case of normality and large sample size, while EGARCH model is good at forecasting volatility under the high skewed distribution. The sensitivity analysis to choose SVM parameters and cross‐validation to determine the stopping point of the recurrent SVM procedure are also examined in this study. Copyright © 2009 John Wiley & Sons, Ltd.     

Traditional versus novel forecasting techniques: how much do we gain?

This article applies two novel techniques to forecast the value of US manufacturing shipments over the period 1956–2000: wavelets and support vector machines (SVM). Wavelets have become increasingly popular in the fields of economics and finance in recent years, whereas SVM has emerged as a more user‐friendly alternative to artificial neural networks. These two methodologies are compared with two well‐known time series techniques: multiplicative seasonal autoregressive integrated moving average (ARIMA) and unobserved components (UC). Based on forecasting accuracy and encompassing tests, and forecasting combination, we conclude that UC and ARIMA generally outperform wavelets and SVM. However, in some cases the latter provide valuable forecasting information that it is not contained in the former. Copyright © 2008 John Wiley & Sons, Ltd.     

Forecasting Interest Rates and Yield Spreads: The Informational Content of Implied Futures Yields and Best-fitting Forward Rate Models

Forecasts of interest rates for different maturities are essential for forecasts of asset prices. The growth of derivatives markets coupled with the development of complex theories of the term structure of interest rates have provided forecasters with a rich array of variables for predicting interest rates and yield spreads. This paper extends previous work on forecasting future interest rates and yield spreads using market data for T-bills, T-Notes, and Treasury Bond spot and futures contracts. The information conveyed in technical models that use market data is also assessed, using a recent innovation in interest rate modelling, the maximum smoothness approach. Forecasts from this model are compared with predicted yields and yield spreads derived from futures prices as well as with those of the random walk model. The results show some evidence of market segmentation, with more arbitrage evident for nearby maturities. Market participants appear to show a greater degree of consensus on short-term interest rates than on longer-term interest rates. There is some indication that forecasts from the futures markets are marginally better than those provided by those of the maximum-smoothness approach, consistent with the informational advantages of futures markets. Finally, futures and maximum-smoothness market forecasts are shown to outperform those of the random walk model.© 1997 John Wiley & Sons, Ltd.     

Sales forecasting using multi-equation transfer function models

The purpose of this study is first, to demonstrate how multivariate forecasting models can be effectively used to generate high performance forecasts for typical business applications. Second, this study compares the forecasts generated by a simultaneous transfer function model (STF) model and a white noise regression model with that of a univariate ARIMA model. The accuracy of these forecasting models is judged using their residual variances and forecasting errors in a post-sample period. It is found that ignoring the residual serial correlation can greatly degrade the forecasting performance of a multi-variable model, and in some situations, cause a multi-variable model to perform inferior to a univariate ARIMA model. This paper also demonstrates how a forecaster can use an STF model to compute both the multi-step ahead forecasts and their variances easily.     

Dynamic relationship analysis of us gasoline and crude oil prices

This paper studies the dynamic relationships between US gasoline prices, crude oil prices, and the stock of gasoline. Using monthly data between January 1973 and December 1987, we find that the US gasoline price is mainly influenced by the price of crude oil. The stock of gasoline has little or no influence on the price of gasoline during the period before the second energy crisis, and seems to have some influence during the period after. We also find that the dynamic relationship between the prices of gasoline and crude oil changes over time, shifting from a longer lag response to a shorter lag response. Box-Jenkins ARIMA and transfer function models are employed in this study. These models are estimated using estimation procedure with and without outlier adjustment. For model estimation with outlier adjustment, an iterative procedure for the joint estimation of model parameters and outlier effects is employed. The forecasting performance of these models is carefully examined. For the purpose of illustration, we also analyze these time series using classical white-noise regression models. The results show the importance of using appropriate time-series methods in modeling and forecasting when the data are serially correlated. This paper also demonstrates the problems of time-series modeling when outliers are present.     

Forecasting carbon price using a multi-objective least squares support vector machine with mixture kernels

For improving forecasting accuracy and trading performance, this paper proposes a new multi-objective least squares support vector machine with mixture kernels to forecast asset prices. First, a mixture kernel function is introduced into taking full use of global and local kernel functions, which is adaptively determined following a data-driven procedure. Second, a multi-objective fitness function is proposed by incorporating level forecasting and trading performance, and particle swarm optimization is used to synchronously search the optimal model selections of least squares support vector machine with mixture kernels. Taking CO₂ assets as examples, the results obtained show that compared with the popular models, the proposed model can achieve higher forecasting accuracy and higher trading performance. The advantages of the mixture kernel function and the multi-objective fitness function can improve the forecasting ability of the asset price. The findings also show that the models with a high-level forecasting accuracy cannot always have a high trading performance of asset price forecasting. In contrast, high directional forecasting usually means a high trading performance.     

The role of jumps in the agricultural futures market on forecasting stock market volatility: New evidence

In this study, we explore the effect of cojumps within the agricultural futures market, and cojumps between the agricultural futures market and the stock market, on stock volatility forecasting. Also, we take into account large and small components of cojumps. We have several noteworthy findings. First, large jumps may lead to more substantial fluctuations and are more powerful than small jumps. The effect of cojumps and their decompositions on future volatility are mixed. Second, a model including large and small cojumps between the agricultural futures market and the stock market can achieve a higher forecasting accuracy, implying that large and small cojumps contain more useful predictive information than cojumps themselves. Third, our conclusions are robust based on various robustness tests such as the realized kernel, expanding forecasts, different forecasting windows, different jump tests, and different threshold values.     

A new PM2.5 concentration forecasting system based on AdaBoost-ensemble system with deep learning approach

A reliable and efficient forecasting system can be used to warn the general public against the increasing PM_2.5 concentration. This paper proposes a novel AdaBoost-ensemble technique based on a hybrid data preprocessing-analysis strategy, with the following contributions: (i) a new decomposition strategy is proposed based on the hybrid data preprocessing-analysis strategy, which combines the merits of two popular decomposition algorithms and has been proven to be a promising decomposition strategy; (ii) the long short-term memory (LSTM), as a powerful deep learning forecasting algorithm, is applied to individually forecast the decomposed components, which can effectively capture the long-short patterns of complex time series; and (iii) a novel AdaBoost-LSTM ensemble technique is then developed to integrate the individual forecasting results into the final forecasting results, which provides significant improvement to the forecasting performance. To evaluate the proposed model, a comprehensive and scientific assessment system with several evaluation criteria, comparison models, and experiments is designed. The experimental results indicate that our developed hybrid model considerably surpasses the compared models in terms of forecasting precision and statistical testing and that its excellent forecasting performance can guide in developing effective control measures to decrease environmental contamination and prevent the health issues caused by a high PM_2.5 concentration.     

Forecasting the price of crude oil via convenience yield predictions

The paper develops an oil price forecasting technique which is based on the present value model of rational commodity pricing. The approach suggests shifting the forecasting problem to the marginal convenience yield, which can be derived from the cost‐of‐carry relationship. In a recursive out‐of‐sample analysis, forecast accuracy at horizons within one year is checked by the root mean squared error as well as the mean error and the frequency of a correct direction‐of‐change prediction. For all criteria employed, the proposed forecasting tool outperforms the approach of using futures prices as direct predictors of future spot prices. Vis‐à‐vis the random‐walk model, it does not significantly improve forecast accuracy but provides valuable statements on the direction of change. Copyright © 2007 John Wiley & Sons, Ltd.     

Predicting opening spot prices using extended futures trading

Previous studies found that extended futures trading contains useful information in explaining subsequent overnight spot returns. This study therefore compares the performance of using the extended trading of the TAIFEX (Taiwan Futures Exchange) index futures and single‐stock futures to predict their opening underlying spot prices. Furthermore, according to the efficient market hypothesis, the share price fully reflects all the information available and should adjust to new information instantaneously. However, several studies have demonstrated that short‐sales restrictions delay the speed of price adjustment to negative information. The relevant question is whether short‐selling restrictions also slow down the speed at which the opening spot price adjusts to the new information revealed through extended futures trading, and thus reducing the price prediction function of extended futures trading. The empirical results find that using the opening futures price and the prediction method proposed in this study can more accurately predict the opening spot price on the same day. Furthermore, the performance of using the extended trading of index futures to predict the opening spot index price is superior to that of using the extended trading of single‐stock futures to predict the opening stock price. Finally, as found in previous studies, short‐selling restrictions also slow down the speed of stock price adjustment to the new information revealed through extended futures trading. Thus both the up‐tick rule and the short‐selling bans (especially the latter) negatively affect the price forecasting performance of extended futures trading.     

Forecasting Government Bond Yields with Neural Networks Considering Cointegration

This paper discusses techniques that might be helpful in predicting interest rates and tries to evaluate a new hybrid forecasting approach. Results of examining government bond yields in Germany and France reported in this study indicate that a hybrid forecasting approach which combines techniques of cointegration analysis with neural network (NN) forecasting models can produce superior results to the use of NN forecasting models alone. The findings documented in this paper could be a consequence of the fact that examining differenced data under certain conditions will lead to a loss of information and that the inclusion of the error correction term from the cointegration model can help to cope with this problem. The paper also discusses some possibly interesting directions for further research. Copyright © 2015 John Wiley & Sons, Ltd.     

Why do EMD‐based methods improve prediction? A multiscale complexity perspective

Empirical mode decomposition (EMD)‐based ensemble methods have become increasingly popular in the research field of forecasting, substantially enhancing prediction accuracy. The key factor in this type of method is the multiscale decomposition that immensely mitigates modeling complexity. Accordingly, this study probes this factor and makes further innovations from a new perspective of multiscale complexity. In particular, this study quantitatively investigates the relationship between the decomposition performance and prediction accuracy, thereby developing (1) a novel multiscale complexity measurement (for evaluating multiscale decomposition), (2) a novel optimized EMD (OEMD) (considering multiscale complexity), and (3) a novel OEMD‐based forecasting methodology (using the proposed OEMD in multiscale analysis). With crude oil and natural gas prices as samples, the empirical study statistically indicates that the forecasting capability of EMD‐based methods is highly reliant on the decomposition performance; accordingly, the proposed OEMD‐based methods considering multiscale complexity significantly outperform the benchmarks based on typical EMDs in prediction accuracy.     

Forecasting with balanced state space representations of multivariate distributed lag models

A procedure for estimating state space models for multivariate distributed lag processes is described. It involves singular value decomposition techniques and yields an internally balanced state space representation which has attractive properties. Following the specifications of a forecasting competition, the approach is applied to generate ex-post forecasts for US real GNP growth rates. The forecasts of the estimated state space model are compared to those of twelve econometric models and an ARIMA model.