Backtesting Value‐at‐Risk: A Generalized Markov Test

Testing the validity of value‐at‐risk (VaR) forecasts, or backtesting, is an integral part of modern market risk management and regulation. This is often done by applying independence and coverage tests developed by Christoffersen (International Economic Review, 1998; 39(4), 841–862) to so‐called hit‐sequences derived from VaR forecasts and realized losses. However, as pointed out in the literature, these aforementioned tests suffer from low rejection frequencies, or (empirical) power when applied to hit‐sequences derived from simulations matching empirical stylized characteristics of return data. One key observation of the studies is that higher‐order dependence in the hit‐sequences may cause the observed lower power performance. We propose to generalize the backtest framework for VaR forecasts, by extending the original first‐order dependence of Christoffersen to allow for a higher‐ or kth‐order dependence. We provide closed‐form expressions for the tests as well as asymptotic theory. Not only do the generalized tests have power against kth‐order dependence by definition, but also included simulations indicate improved power performance when replicating the aforementioned studies. Further, included simulations show much improved size properties of one of the suggested tests. Copyright © 2017 John Wiley & Sons, Ltd.     

Using CAViaR Models with Implied Volatility for Value‐at‐Risk Estimation

This paper proposes value‐at risk (VaR) estimation methods that are a synthesis of conditional autoregressive value at risk (CAViaR) time series models and implied volatility. The appeal of this proposal is that it merges information from the historical time series and the different information supplied by the market's expectation of risk. Forecast‐combining methods, with weights estimated using quantile regression, are considered. We also investigate plugging implied volatility into the CAViaR models—a procedure that has not been considered in the VaR area so far. Results for daily index returns indicate that the newly proposed methods are comparable or superior to individual methods, such as the standard CAViaR models and quantiles constructed from implied volatility and the empirical distribution of standardised residuals. We find that the implied volatility has more explanatory power as the focus moves further out into the left tail of the conditional distribution of S&P 500 daily returns. Copyright © 2012 John Wiley & Sons, Ltd.     

Improving Hull and White's Method of Estimating Portfolio Value‐at‐Risk

We propose a method approach. We use six international stock price indices and three hypothetical portfolios formed by these indices. The sample was observed daily from 1 January 1996 to 31 December 2006. Confirmed by the failure rates and backtesting developed by Kupiec (Technique for verifying the accuracy of risk measurement models. Journal of Derivatives 1995; 3 : 73–84) and Christoffersen (Evaluating interval forecasts. International Economic Review 1998; 39 : 841–862), the empirical results show that our method can considerably improve the estimation accuracy of value‐at‐risk. Thus the study establishes an effective alternative model for risk prediction and hence also provides a reliable tool for the management of portfolios. Copyright © 2011 John Wiley & Sons, Ltd.     

Market risk management of banks: implications from the accuracy of Value‐at‐Risk forecasts

This paper adopts the backtesting criteria of the Basle Committee to compare the performance of a number of simple Value‐at‐Risk (VaR) models. These criteria provide a new standard on forecasting accuracy. Currently central banks in major money centres, under the auspices of the Basle Committee of the Bank of International settlement, adopt the VaR system to evaluate the market risk of their supervised banks. Banks are required to report VaRs to bank regulators with their internal models. These models must comply with Basle's backtesting criteria. If a bank fails the VaR backtesting, higher capital requirements will be imposed. VaR is a function of volatility forecasts. Past studies mostly conclude that ARCH and GARCH models provide better volatility forecasts. However, this paper finds that ARCH‐ and GARCH‐based VaR models consistently fail to meet Basle's backtesting criteria. These findings suggest that the use of ARCH‐ and GARCH‐based models to forecast their VaRs is not a reliable way to manage a bank's market risk. Copyright © 2002 John Wiley & Sons, Ltd.     

Selection of Value‐at‐Risk models

Value‐at‐Risk (VaR) is widely used as a tool for measuring the market risk of asset portfolios. However, alternative VaR implementations are known to yield fairly different VaR forecasts. Hence, every use of VaR requires choosing among alternative forecasting models. This paper undertakes two case studies in model selection, for the S&P 500 index and India's NSE‐50 index, at the 95% and 99% levels. We employ a two‐stage model selection procedure. In the first stage we test a class of models for statistical accuracy. If multiple models survive rejection with the tests, we perform a second stage filtering of the surviving models using subjective loss functions. This two‐stage model selection procedure does prove to be useful in choosing a VaR model, while only incompletely addressing the problem. These case studies give us some evidence about the strengths and limitations of present knowledge on estimation and testing for VaR. Copyright © 2003 John Wiley & Sons, Ltd.     

Exponentially Smoothing the Skewed Laplace Distribution for Value‐at‐Risk Forecasting

Value‐at‐risk (VaR) is a standard measure of market risk in financial markets. This paper proposes a novel, adaptive and efficient method to forecast both volatility and VaR. Extending existing exponential smoothing as well as GARCH formulations, the method is motivated from an asymmetric Laplace distribution, where skewness and heavy tails in return distributions, and their potentially time‐varying nature, are taken into account. The proposed volatility equation also involves novel time‐varying dynamics. Back‐testing results illustrate that the proposed method offers a viable, and more accurate, though conservative, improvement in forecasting VaR compared to a range of popular alternatives. Copyright © 2013 John Wiley & Sons, Ltd.     

The Role of High‐Frequency Intra‐daily Data,Daily Range and Implied Volatility in Multi‐period Value‐at‐Risk Forecasting

This paper assesses the informational content of alternative realized volatility estimators, daily range and implied volatility in multi‐period out‐of‐sample Value‐at‐Risk (VaR) predictions. We use the recently proposed Realized GARCH model combined with the skewed Student's t distribution for the innovations process and a Monte Carlo simulation approach in order to produce the multi‐period VaR estimates. Our empirical findings, based on the S&P 500 stock index, indicate that almost all realized and implied volatility measures can produce statistically and regulatory precise VaR forecasts across forecasting horizons, with the implied volatility being especially accurate in monthly VaR forecasts. The daily range produces inferior forecasting results in terms of regulatory accuracy and Basel II compliance. However, robust realized volatility measures, which are immune against microstructure noise bias or price jumps, generate superior VaR estimates in terms of capital efficiency, as they minimize the opportunity cost of capital and the Basel II regulatory capital. Copyright © 2013 John Wiley & Sons, Ltd.     

Forecasting value‐at‐risk with a parsimonious portfolio spillover GARCH (PS‐GARCH) model

Accurate modelling of volatility (or risk) is important in finance, particularly as it relates to the modelling and forecasting of value‐at‐risk (VaR) thresholds. As financial applications typically deal with a portfolio of assets and risk, there are several multivariate GARCH models which specify the risk of one asset as depending on its own past as well as the past behaviour of other assets. Multivariate effects, whereby the risk of a given asset depends on the previous risk of any other asset, are termed spillover effects. In this paper we analyse the importance of considering spillover effects when forecasting financial volatility. The forecasting performance of the VARMA‐GARCH model of Ling and McAleer (2003), which includes spillover effects from all assets, the CCC model of Bollerslev (1990), which includes no spillovers, and a new Portfolio Spillover GARCH (PS‐GARCH) model, which accommodates aggregate spillovers parsimoniously and hence avoids the so‐called curse of dimensionality, are compared using a VaR example for a portfolio containing four international stock market indices. The empirical results suggest that spillover effects are statistically significant. However, the VaR threshold forecasts are generally found to be insensitive to the inclusion of spillover effects in any of the multivariate models considered. Copyright © 2008 John Wiley & Sons, Ltd.     

A decision rule to minimize daily capital charges in forecasting value‐at‐risk

Under the Basel II Accord, banks and other authorized deposit‐taking institutions (ADIs) have to communicate their daily risk estimates to the monetary authorities at the beginning of the trading day, using a variety of value‐at‐risk (VaR) models to measure risk. Sometimes the risk estimates communicated using these models are too high, thereby leading to large capital requirements and high capital costs. At other times, the risk estimates are too low, leading to excessive violations, so that realized losses are above the estimated risk. In this paper we analyze the profit‐maximizing problem of an ADI subject to capital requirements under the Basel II Accord as ADIs have to choose an optimal VaR reporting strategy that minimizes daily capital charges. Accordingly, we suggest a dynamic communication and forecasting strategy that responds to violations in a discrete and instantaneous manner, while adapting more slowly in periods of no violations. We apply the proposed strategy to Standard & Poor's 500 Index and show there can be substantial savings in daily capital charges, while restricting the number of violations to within the Basel II penalty limits. Copyright © 2009 John Wiley & Sons, Ltd.     

Forecasting High‐Frequency Risk Measures

This article proposes intraday high‐frequency risk (HFR) measures for market risk in the case of irregularly spaced high‐frequency data. In this context, we distinguish three concepts of value‐at‐risk (VaR): the total VaR, the marginal (or per‐time‐unit) VaR and the instantaneous VaR. Since the market risk is obviously related to the duration between two consecutive trades, these measures are completed with a duration risk measure, i.e. the time‐at‐risk (TaR). We propose a forecasting procedure for VaR and TaR for each trade or other market microstructure event. Subsequently, we perform a backtesting procedure specifically designed to assess the validity of the VaR and TaR forecasts on irregularly spaced data. The performance of the HFR measure is illustrated in an empirical application for two stocks (Bank of America and Microsoft) and an exchange‐traded fund based on Standard & Poor's 500 index. We show that the intraday HFR forecasts capture accurately the volatility and duration dynamics for these three assets. Copyright © 2015 John Wiley & Sons, Ltd.     

Incorporating higher moments into value‐at‐risk forecasting

Value‐at‐risk (VaR) forecasting generally relies on a parametric density function of portfolio returns that ignores higher moments or assumes them constant. In this paper, we propose a simple approach to forecasting of a portfolio VaR. We employ the Gram‐Charlier expansion (GCE) augmenting the standard normal distribution with the first four moments, which are allowed to vary over time. In an extensive empirical study, we compare the GCE approach to other models of VaR forecasting and conclude that it provides accurate and robust estimates of the realized VaR. In spite of its simplicity, on our dataset GCE outperforms other estimates that are generated by both constant and time‐varying higher‐moments models. Copyright © 2009 John Wiley & Sons, Ltd.     

Single‐index and portfolio models for forecasting value‐at‐risk thresholds

The variance of a portfolio can be forecast using a single index model or the covariance matrix of the portfolio. Using univariate and multivariate conditional volatility models, this paper evaluates the performance of the single index and portfolio models in forecasting value‐at‐risk (VaR) thresholds of a portfolio. Likelihood ratio tests of unconditional coverage, independence and conditional coverage of the VaR forecasts suggest that the single‐index model leads to excessive and often serially dependent violations, while the portfolio model leads to too few violations. The single‐index model also leads to lower daily Basel Accord capital charges. The univariate models which display correct conditional coverage lead to higher capital charges than models which lead to too many violations. Overall, the Basel Accord penalties appear to be too lenient and favour models which have too many violations. Copyright © 2008 John Wiley & Sons, Ltd.     

International Evidence on GFC‐Robust Forecasts for Risk Management under the Basel Accord

A risk management strategy designed to be robust to the global financial crisis (GFC), in the sense of selecting a value‐at‐risk (VaR) forecast that combines the forecasts of different VaR models, was proposed by McAleer and coworkers in 2010. The robust forecast is based on the median of the point VaR forecasts of a set of conditional volatility models. Such a risk management strategy is robust to the GFC in the sense that, while maintaining the same risk management strategy before, during and after a financial crisis, it will lead to comparatively low daily capital charges and violation penalties for the entire period. This paper presents evidence to support the claim that the median point forecast of VaR is generally GFC robust. We investigate the performance of a variety of single and combined VaR forecasts in terms of daily capital requirements and violation penalties under the Basel II Accord, as well as other criteria. In the empirical analysis we choose several major indexes, namely French CAC, German DAX, US Dow Jones, UK FTSE100, Hong Kong Hang Seng, Spanish Ibex 35, Japanese Nikkei, Swiss SMI and US S&P 500. The GARCH, EGARCH, GJR and RiskMetrics models as well as several other strategies, are used in the comparison. Backtesting is performed on each of these indexes using the Basel II Accord regulations for 2008–10 to examine the performance of the median strategy in terms of the number of violations and daily capital charges, among other criteria. The median is shown to be a profitable and safe strategy for risk management, both in calm and turbulent periods, as it provides a reasonable number of violations and daily capital charges. The median also performs well when both total losses and the asymmetric linear tick loss function are considered Copyright © 2012 John Wiley & Sons, Ltd.     

Multiple Hypothesis Testing of Market Risk Forecasting Models

Extending previous risk model backtesting literature, we construct multiple hypothesis testing (MHT) with the stationary bootstrap. We conduct multiple tests which control for the generalized confidence level and employ the bootstrap MHT to design multiple comparison testing. We consider absolute and relative predictive ability to test a range of competing risk models, focusing on value‐at‐risk and expected shortfall (ExS). In devising the test for the absolute predictive ability, we take the route of recent literature and construct balanced simultaneous confidence sets that control for the generalized family‐wise error rate, which is the joint probability of rejecting true hypotheses. We implement a step‐down method which increases the power of the MHT in isolating false discoveries. In testing for the ExS model predictive ability, we design a new simple test to draw inference about recursive model forecasting capability. In the second suite of statistical testing, we develop a novel device for measuring the relative predictive ability in the bootstrap MHT framework. The device, which we coin multiple comparison mapping, provides a statistically robust instrument designed to answer the question: ‘Which model is the best model?’ Copyright © 2016 John Wiley & Sons, Ltd.     

Forecasting Based on Decomposed Financial Return Series: A Wavelet Analysis

We transform financial return series into its frequency and time domain via wavelet decomposition to separate short‐run noise from long‐run trends and assess the relevance of each frequency to value‐at‐risk (VaR) forecast. Furthermore, we analyze financial assets in calm and turmoil market times and show that daily 95% VaR forecasts are mainly driven by the volatility that is captured by the first scales comprising the short‐run information, whereas more timescales are needed to adequately forecast 99% VaR. As a result, individual timescales linked via copulas outperform classical parametric VaR approaches that incorporate all information available. Copyright © 2015 John Wiley & Sons, Ltd.     

Forecasting the Daily Time‐Varying Beta of European Banks During the Crisis Period: Comparison Between GARCH Models and the Kalman Filter

This intention of this paper is to empirically forecast the daily betas of a few European banks by means of four generalized autoregressive conditional heteroscedasticity (GARCH) models and the Kalman filter method during the pre‐global financial crisis period and the crisis period. The four GARCH models employed are BEKK GARCH, DCC GARCH, DCC‐MIDAS GARCH and Gaussian‐copula GARCH. The data consist of daily stock prices from 2001 to 2013 from two large banks each from Austria, Belgium, Greece, Holland, Ireland, Italy, Portugal and Spain. We apply the rolling forecasting method and the model confidence sets (MCS) to compare the daily forecasting ability of the five models during one month of the pre‐crisis (January 2007) and the crisis (January 2013) periods. Based on the MCS results, the BEKK proves the best model in the January 2007 period, and the Kalman filter overly outperforms the other models during the January 2013 period. Results have implications regarding the choice of model during different periods by practitioners and academics. Copyright © 2016 John Wiley & Sons, Ltd.     

Bayesian Forecasting for Financial Risk Management,Pre and Post the Global Financial Crisis

Value‐at‐risk (VaR) forecasting via a computational Bayesian framework is considered. A range of parametric models is compared, including standard, threshold nonlinear and Markov switching generalized autoregressive conditional heteroskedasticity (GARCH) specifications, plus standard and nonlinear stochastic volatility models, most considering four error probability distributions: Gaussian, Student‐t, skewed‐t and generalized error distribution. Adaptive Markov chain Monte Carlo methods are employed in estimation and forecasting. A portfolio of four Asia–Pacific stock markets is considered. Two forecasting periods are evaluated in light of the recent global financial crisis. Results reveal that: (i) GARCH models outperformed stochastic volatility models in almost all cases; (ii) asymmetric volatility models were clearly favoured pre crisis, while at the 1% level during and post crisis, for a 1‐day horizon, models with skewed‐t errors ranked best, while integrated GARCH models were favoured at the 5% level; (iii) all models forecast VaR less accurately and anti‐conservatively post crisis. Copyright © 2011 John Wiley & Sons, Ltd.     

A Neuro‐wavelet Model for the Short‐Term Forecasting of High‐Frequency Time Series of Stock Returns

We propose a wavelet neural network (neuro‐wavelet) model for the short‐term forecast of stock returns from high‐frequency financial data. The proposed hybrid model combines the capability of wavelets and neural networks to capture non‐stationary nonlinear attributes embedded in financial time series. A comparison study was performed on the predictive power of two econometric models and four recurrent neural network topologies. Several statistical measures were applied to the predictions and standard errors to evaluate the performance of all models. A Jordan net that used as input the coefficients resulting from a non‐decimated wavelet‐based multi‐resolution decomposition of an exogenous signal showed a consistent superior forecasting performance. Reasonable forecasting accuracy for the one‐, three‐ and five step‐ahead horizons was achieved by the proposed model. The procedure used to build the neuro‐wavelet model is reusable and can be applied to any high‐frequency financial series to specify the model characteristics associated with that particular series. Copyright © 2013 John Wiley & Sons, Ltd.     

Measuring the market risk of freight rates: A forecast combination approach

This paper addresses the issue of freight rate risk measurement via value at risk (VaR) and forecast combination methodologies while focusing on detailed performance evaluation. We contribute to the literature in three ways: First, we reevaluate the performance of popular VaR estimation methods on freight rates amid the adverse economic consequences of the recent financial and sovereign debt crisis. Second, we provide a detailed and extensive backtesting and evaluation methodology. Last, we propose a forecast combination approach for estimating VaR. Our findings suggest that our combination methods produce more accurate estimates for all the sectors under scrutiny, while in some cases they may be viewed as conservative since they tend to overestimate nominal VaR.     

Modeling and Forecasting the Yield Curve by an Extended Nelson‐Siegel Class of Models: A Quantile Autoregression Approach

This paper compares the in‐sample fitting and the out‐of‐sample forecasting performances of four distinct Nelson–Siegel class models: Nelson–Siegel, Bliss, Svensson, and a five‐factor model we propose in order to enhance the fitting flexibility. The introduction of the fifth factor resulted in superior adjustment to the data. For the forecasting exercise the paper contrasts the performances of the term structure models in association with the following econometric methods: quantile autoregression evaluated at the median, VAR, AR, and a random walk. As a pattern, the quantile procedure delivered the best results for longer forecasting horizons. Copyright © 2011 John Wiley & Sons, Ltd.