A new PM2.5 concentration forecasting system based on AdaBoost-ensemble system with deep learning approach

A reliable and efficient forecasting system can be used to warn the general public against the increasing PM_2.5 concentration. This paper proposes a novel AdaBoost-ensemble technique based on a hybrid data preprocessing-analysis strategy, with the following contributions: (i) a new decomposition strategy is proposed based on the hybrid data preprocessing-analysis strategy, which combines the merits of two popular decomposition algorithms and has been proven to be a promising decomposition strategy; (ii) the long short-term memory (LSTM), as a powerful deep learning forecasting algorithm, is applied to individually forecast the decomposed components, which can effectively capture the long-short patterns of complex time series; and (iii) a novel AdaBoost-LSTM ensemble technique is then developed to integrate the individual forecasting results into the final forecasting results, which provides significant improvement to the forecasting performance. To evaluate the proposed model, a comprehensive and scientific assessment system with several evaluation criteria, comparison models, and experiments is designed. The experimental results indicate that our developed hybrid model considerably surpasses the compared models in terms of forecasting precision and statistical testing and that its excellent forecasting performance can guide in developing effective control measures to decrease environmental contamination and prevent the health issues caused by a high PM_2.5 concentration.     

A novel hybrid fine particulate matter (PM2.5) forecasting and its further application system: Case studies in China

Air pollution has received more attention from many countries and scientists due to its high threat to human health. However, air pollution prediction remains a challenging task because of its nonstationarity, randomness, and nonlinearity. In this research, a novel hybrid system is successfully developed for PM_2.5 concentration prediction and its application in health effects and economic loss assessment. First, an efficient data mining method is adopted to capture and extract the primary characteristic of PM_2.5 dataset and alleviate the noises' adverse effects. Second, Harris hawks optimization algorithm is introduced to tune the extreme learning machine model with high prediction accuracy, then the optimized extreme learning machine can be established to obtain the forecasting values of PM_2.5 series. Next, PM_2.5-related health effects and economic costs was estimated based on the predicted PM_2.5 values, the related health effects, and environmental value assessment methods. Several experiments are designed using three daily PM_2.5 datasets from Beijing, Tianjin, and Shijiazhuang. Lastly, the corresponding experimental results showed that this proposed system can not only provide early warning information for environmental management, assist in the formulation of effective measures to reduce air pollutant emissions, and prevent health problems but also help for further research and application in different fields, such as health issues due to PM_2.5 pollutant.     

Forecasting carbon price using a multi-objective least squares support vector machine with mixture kernels

For improving forecasting accuracy and trading performance, this paper proposes a new multi-objective least squares support vector machine with mixture kernels to forecast asset prices. First, a mixture kernel function is introduced into taking full use of global and local kernel functions, which is adaptively determined following a data-driven procedure. Second, a multi-objective fitness function is proposed by incorporating level forecasting and trading performance, and particle swarm optimization is used to synchronously search the optimal model selections of least squares support vector machine with mixture kernels. Taking CO₂ assets as examples, the results obtained show that compared with the popular models, the proposed model can achieve higher forecasting accuracy and higher trading performance. The advantages of the mixture kernel function and the multi-objective fitness function can improve the forecasting ability of the asset price. The findings also show that the models with a high-level forecasting accuracy cannot always have a high trading performance of asset price forecasting. In contrast, high directional forecasting usually means a high trading performance.     

Assessment of agricultural energy consumption of Turkey by MLR and Bayesian optimized SVR and GPR models

Agricultural productivity highly depends on the cost of energy required for cultivation. Thus prior knowledge of energy consumption is an important step for energy planning and policy development in agriculture. The aim of the present study is to evaluate the application potential of multiple linear regression (MLR) and machine learning tools such as support vector regression (SVR) and Gaussian process regression (GPR) to forecast the agricultural energy consumption of Turkey. In the development of the models, widespread indicators such as agricultural value-added, total arable land, gross domestic product share of agriculture, and population data were used as input parameters. Twenty-eight-year historical data from 1990 to 2017 were utilized for the training and testing stages of the models. A Bayesian optimization method was applied to improve the prediction capability of SVR and GPR models. The performance of the models was measured by various statistical tools. The results indicated that the Bayesian optimized GPR (BGPR) model with exponential kernel function showed a superior prediction capability over MLR and Bayesian optimized SVR model. The root mean square error, mean absolute deviation, mean absolute percentage error, and coefficient of determination (R²) values for the BGPR model were determined as 0.0022, 0.0005, 0.2041, and 0.9999 in the training phase and 0.0452, 0.0310, 7.7152, and 0.9677 in the testing phase, respectively. As a result, it can be concluded that the proposed BGPR model is an efficient technique and has the potential to predict agricultural energy consumption with high accuracy.     

Estimating and Forecasting APARCH‐Skew‐t Model by Wavelet Support Vector Machines

This paper concentrates on comparing estimation and forecasting ability of quasi‐maximum likelihood (QML) and support vector machines (SVM) for financial data. The financial series are fitted into a family of asymmetric power ARCH (APARCH) models. As the skewness and kurtosis are common characteristics of the financial series, a skew‐t distributed innovation is assumed to model the fat tail and asymmetry. Prior research indicates that the QML estimator for the APARCH model is inefficient when the data distribution shows departure from normality, so the current paper utilizes the semi‐parametric‐based SVM method and shows that it is more efficient than the QML under the skewed Student's‐t distributed error. As the SVM is a kernel‐based technique, we further investigate its performance by applying separately a Gaussian kernel and a wavelet kernel. The results suggest that the SVM‐based method generally performs better than QML for both in‐sample and out‐of‐sample data. The outcomes also highlight the fact that the wavelet kernel outperforms the Gaussian kernel with lower forecasting error, better generation capability and more computation efficiency. Copyright © 2014 John Wiley & Sons, Ltd.     

The Informational Content of the Term Spread in Forecasting the US Inflation Rate: A Nonlinear Approach

The difficulty in modelling inflation and the significance in discovering the underlying data‐generating process of inflation is expressed in an extensive literature regarding inflation forecasting. In this paper we evaluate nonlinear machine learning and econometric methodologies in forecasting US inflation based on autoregressive and structural models of the term structure. We employ two nonlinear methodologies: the econometric least absolute shrinkage and selection operator (LASSO) and the machine‐learning support vector regression (SVR) method. The SVR has never been used before in inflation forecasting considering the term spread as a regressor. In doing so, we use a long monthly dataset spanning the period 1871:1–2015:3 that covers the entire history of inflation in the US economy. For comparison purposes we also use ordinary least squares regression models as a benchmark. In order to evaluate the contribution of the term spread in inflation forecasting in different time periods, we measure the out‐of‐sample forecasting performance of all models using rolling window regressions. Considering various forecasting horizons, the empirical evidence suggests that the structural models do not outperform the autoregressive ones, regardless of the model's method. Thus we conclude that the term spread models are not more accurate than autoregressive models in inflation forecasting. Copyright © 2016 John Wiley & Sons, Ltd.     

Forecasting Daily and Monthly Exchange Rates with Machine Learning Techniques

In this paper we propose and test a forecasting model on monthly and daily spot prices of five selected exchange rates. In doing so, we combine a novel smoothing technique (initially applied in signal processing) with a variable selection methodology and two regression estimation methodologies from the field of machine learning (ML). After the decomposition of the original exchange rate series using an ensemble empirical mode decomposition (EEMD) method into a smoothed and a fluctuation component, multivariate adaptive regression splines (MARS) are used to select the most appropriate variable set from a large set of explanatory variables that we collected. The selected variables are then fed into two distinctive support vector machines (SVR) models that produce one‐period‐ahead forecasts for the two components. Neural networks (NN) are also considered as an alternative to SVR. The sum of the two forecast components is the final forecast of the proposed scheme. We show that the above implementation exhibits a superior in‐sample and out‐of‐sample forecasting ability when compared to alternative forecasting models. The empirical results provide evidence against the efficient market hypothesis for the selected foreign exchange markets. Copyright © 2015 John Wiley & Sons, Ltd.     

An Adaptive Multiscale Ensemble Learning Paradigm for Nonstationary and Nonlinear Energy Price Time Series Forecasting

For forecasting nonstationary and nonlinear energy prices time series, a novel adaptive multiscale ensemble learning paradigm incorporating ensemble empirical mode decomposition (EEMD), particle swarm optimization (PSO) and least square support vector machines (LSSVM) with kernel function prototype is developed. Firstly, the extrema symmetry expansion EEMD, which can effectively restrain the mode mixing and end effects, is used to decompose the energy price into simple modes. Secondly, by using the fine‐to‐coarse reconstruction algorithm, the high‐frequency, low‐frequency and trend components are identified. Furthermore, autoregressive integrated moving average is applicable to predicting the high‐frequency components. LSSVM is suitable for forecasting the low‐frequency and trend components. At the same time, a universal kernel function prototype is introduced for making up the drawbacks of single kernel function, which can adaptively select the optimal kernel function type and model parameters according to the specific data using the PSO algorithm. Finally, the prediction results of all the components are aggregated into the forecasting values of energy price time series. The empirical results show that, compared with the popular prediction methods, the proposed method can significantly improve the prediction accuracy of energy prices, with high accuracy both in the level and directional predictions. Copyright © 2016 John Wiley & Sons, Ltd.     

A generalized regression model based on hybrid empirical mode decomposition and support vector regression with back-propagation neural network for mid-short-term load forecasting

Since load forecasting plays a decisive role in the safe and stable operation of power systems, it is particularly important to explore forecasting methods accurately. In this article, the hybrid empirical mode decomposition (EMD) and support vector regression (SVR) with back-propagation neural network (BPNN), namely the EMDHR-SVR-BPNN model, is proposed. Information theory is mainly used to solve the data tendency problem, and the EMD method is used to solve the data volatility problem. There is no interaction between these two methods; thus these two models can complement each other through generalized regression of orthogonal decomposition. Taking the load data from the New South Wales (NSW, Australia) market as an example, the obtained simulation results are compared with other models. It is concluded that the proposed EMDHR-SVR-BPNN model not only improves the forecasting accuracy but also has good fitting ability. It can reflect the changing tendency of data in a timely manner, providing a strong basis for the electricity generation of the power sector in the future, thus reducing electricity waste. The proposed EMDHR-SVR-BPNN model has potential for employment in mid-short term load forecasting.     

Stock index prediction based on wavelet transform and FCD-MLGRU

With the development of artificial intelligence, deep learning is widely used in the field of nonlinear time series forecasting. It is proved in practice that deep learning models have higher forecasting accuracy compared with traditional linear econometric models and machine learning models. With the purpose of further improving forecasting accuracy of financial time series, we propose the WT-FCD-MLGRU model, which is the combination of wavelet transform, filter cycle decomposition and multilag neural networks. Four major stock indices are chosen to test the forecasting performance among traditional econometric model, machine learning model and deep learning models. According to the result of empirical analysis, deep learning models perform better than traditional econometric model such as autoregressive integrated moving average and improved machine learning model SVR. Besides, our proposed model has the minimum forecasting error in stock index prediction.     

改进果蝇优化算法优化广义回归神经网络的预测问题研究

为提高传统非线性预测模型的预测精度,提出一种基于改进果蝇优化算法优化广义回归神经网络的预测方法,将果蝇群体分两部分分别进行迭代寻优,从而改进了果蝇优化算法的寻优性能,进而避免了在寻优过程中陷入局部最优。该方法利用改进果蝇优化算法优化广义回归神经网络的径向基函数扩展参数,然后用训练好的广义回归神经网络预测模型进行预测,最后通过订单预测算例进行实证研究。实证研究结果显示,该方法在解决订单预测问题中与未改进的果蝇优化算法优化广义回归神经网络和传统的广义回归神经网络方法对比,具有更高的预测精度和更好的非线性拟合能力。     

Forecasting Volatility with Many Predictors

This study investigates the forecasting performance of the GARCH(1,1) model by adding an effective covariate. Based on the assumption that many volatility predictors are available to help forecast the volatility of a target variable, this study shows how to construct a covariate from these predictors and plug it into the GARCH(1,1) model. This study presents a method of building a covariate such that the covariate contains the maximum possible amount of predictor information of the predictors for forecasting volatility. The loading of the covariate constructed by the proposed method is simply the eigenvector of a matrix. The proposed method enjoys the advantages of easy implementation and interpretation. Simulations and empirical analysis verify that the proposed method performs better than other methods for forecasting the volatility, and the results are quite robust to model misspecification. Specifically, the proposed method reduces the mean square error of the GARCH(1,1) model by 30% for forecasting the volatility of S&P 500 Index. The proposed method is also useful in improving the volatility forecasting of several GARCH‐family models and for forecasting the value‐at‐risk. Copyright © 2013 John Wiley & Sons, Ltd.     

Modeling European industrial production with multivariate singular spectrum analysis: A cross‐industry analysis

In this paper, an optimized multivariate singular spectrum analysis (MSSA) approach is proposed to find leading indicators of cross‐industry relations between 24 monthly, seasonally unadjusted industrial production (IP) series for German, French, and UK economies. Both recurrent and vector forecasting algorithms of horizontal MSSA (HMSSA) are considered. The results from the proposed multivariate approach are compared with those obtained via the optimized univariate singular spectrum analysis (SSA) forecasting algorithm to determine the statistical significance of each outcome. The data are rigorously tested for normality, seasonal unit root hypothesis, and structural breaks. The results are presented such that users can not only identify the most appropriate model based on the aim of the analysis, but also easily identify the leading indicators for each IP variable in each country. Our findings show that, for all three countries, forecasts from the proposed MSSA algorithm outperform the optimized SSA algorithm in over 70% of cases. Accordingly, this new approach succeeds in identifying leading indicators and is a viable option for selecting the SSA choices L and r, which minimizes a loss function.     

Assessing time series models for forecasting international migration: Lessons from the United Kingdom

Migration is one of the most unpredictable demographic processes. The aim of this article is to provide a blueprint for assessing various possible forecasting approaches in order to help safeguard producers and users of official migration statistics against misguided forecasts. To achieve that, we first evaluate the various existing approaches to modelling and forecasting of international migration flows. Subsequently, we present an empirical comparison of ex post performance of various forecasting methods, applied to international migration to and from the United Kingdom. The overarching goal is to assess the uncertainty of forecasts produced by using different forecasting methods, both in terms of their errors (biases) and calibration of uncertainty. The empirical assessment, comparing the results of various forecasting models against past migration estimates, confirms the intuition about weak predictability of migration, but also highlights varying levels of forecast errors for different migration streams. There is no single forecasting approach that would be well suited for different flows. We therefore recommend adopting a tailored approach to forecasts, and applying a risk management framework to their results, taking into account the levels of uncertainty of the individual flows, as well as the differences in their potential societal impact.     

Combination of forecasts in electricity demand prediction

Accurate demand prediction is of great importance in the electricity supply industry. Electricity cannot be stored, and generating plant must be scheduled well in advance to meet future demand. Up to now, where online information about external conditions is unavailable, time series methods on the historical demand series have been used for short-term demand prediction. These have drawbacks, both in their sensitivity to changing weather conditions and in their poor modelling of the daily/weekly business cycles. To overcome these problems a framework has been constructed whereby forecasts from different prediction methods and different forecasting origins can be selected and combined, solely on the basis of recent forecasting performance, with no a priori assumptions of demand behaviour. This added flexibility in univariate forecasting provides a significant improvement in prediction accuracy.     

Ex post and ex ante analysis of provisional data

In this paper we suggest a framework to assess the degree of reliability of provisional estimates as forecasts of final data, and we re‐examine the question of the most appropriate way in which available data should be used for ex ante forecasting in the presence of a data‐revision process. Various desirable properties for provisional data are suggested, as well as procedures for testing them, taking into account the possible non‐stationarity of economic variables. For illustration, the methodology is applied to assess the quality of the US M1 data production process and to derive a conditional model whose performance in forecasting is then tested against other alternatives based on simple transformations of provisional data or of past final data. Copyright © 1999 John Wiley & Sons, Ltd.     

Strategic planning and forecasting

This paper examines the role of forecasting in strategic planning through the use of analytical portfolio models and corporate simulation models. It also outlines a conceptual framework on which it may be possible to develop a theory of strategic planning—namely, microeconomic theory. It, finally, describes a practical application of this theoretical framework, known as the strategy matrix. It concludes by noting the importance of forecasting as an input to the strategy matrix.     

Forecasting business failure in China using case‐based reasoning with hybrid case respresentation

Case‐based reasoning (CBR) is a very effective and easily understandable method for solving real‐world problems. Business failure prediction (BFP) is a forecasting tool that helps people make more precise decisions. CBR‐based BFP is a hot topic in today's global financial crisis. Case representation is critical when forecasting business failure with CBR. This research describes a pioneer investigation on hybrid case representation by employing principal component analysis (PCA), a feature extraction method, along with stepwise multivariate discriminant analysis (MDA), a feature selection approach. In this process, sample cases are represented with all available financial ratios, i.e., features. Next, the stepwise MDA is used to select optimal features to produce a reduced‐case representation. Finally, PCA is employed to extract the final information representing the sample cases. All data signified by hybrid case representation are recorded in a case library, and the k‐nearest‐neighbor algorithm is used to make the forecasting. Thus we constructed a hybrid CBR (HCBR) by integrating hybrid case representation into the forecasting tool. We empirically tested the performance of HCBR with data collected for short‐term BFP of Chinese listed companies. Empirical results indicated that HCBR can produce more promising prediction performance than MDA, logistic regression, classical CBR, and support vector machine. Copyright © 2009 John Wiley & Sons, Ltd.     

The dynamic and stochastic instability of betas: Implications for forecasting stock returns

The purpose of this paper is to simultaneously investigate several important issues that feature the dynamic and stochastic behavior of beta coefficients for individual stocks and affect the forecasting of stock returns. The issues include randomness, nonstantionarity, and shifts in the mean and variance parameters of the beta coefficient, and are addressed within the framework of variable-mean-response (VMR) random coefficients models in which the problem of heteroscedasticity is present. Estimation is done using a four-step generalized least squares method. The hypotheses concerning randomness and nonstationarity of betas are tested. The time paths, sizes, and marginal rates of mean shifts are determined. The issue of variance shift is examined on the basis of five special tests, called T*, B, S', G and W. Then the impacts of the dynamic and stochastic instability on the estimation of betas is tested by a nonparametric procedure. Finally, the VMR models' ability of forecasting stock returns is evaluated against the standard capital asset pricing model. The empirical findings shed new light on the continuing debate as to whether the beta coefficient is random and nonstationary and have important implications for modeling and forecasting the measurement of performance and the determination of stock returns.     

The industrial asymmetry of the stock price prediction with investor sentiment: Based on the comparison of predictive effects with SVR

As a representative emerging financial market, the Chinese stock market is more prone to volatility because of investor sentiment. It is reasonable to use efficient predictive methods to analyze the influence of investor sentiment on stock price forecasting. This paper conducts a comparative study about the predictive performance of artificial neural network, support vector regression (SVR) and autoregressive integrated moving average and selects SVR to study the asymmetry effect of investor sentiment on different industry index predictions. After studying the relevant financial indicators, the results divide the Shenwan first-class industries into two types and show that the industries affected by investor sentiment are composed of young companies with high growth and high operative pressure and there are a great number of investment bubbles in those companies.