0115 966 7955 Today's Opening Times 10:00 - 20:00 (BST)

ARMA-GARCH Model Theories Application

Published: Last Edited:

Disclaimer: This essay has been submitted by a student. This is not an example of the work written by our professional essay writers. You can view samples of our professional work here.

Any opinions, findings, conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of UK Essays.

Chapter 3 Theoretical Properties

3.1 Introduction

In this chapter, we study some theoretical properties of our suggested models. More specifically, we discuss the conditions of the models’ stability, so that their Markov chain representation is geometrically ergodic, and more precisely Q-geometrically ergodic, which suggests that an initial distribution which renders our models strictly stationary and β-mixing exists. Moreover, we consider conditions required in order to be able to establish consistency and asymptotic normality for the estimator vector.

In addition, we present the multivariate versions of our suggested models, which, despite the fact that they are not used in empirical applications in this thesis, could be interesting at least at theoretical level.

3.2 Geometric ergodicity

There have been several studies of the stability of nonlinear autoregressive models with heteroskedastic errors. However, most of them have concentrated mainly on Threshold Autoregressive models for the conditional mean with conditional heteroskedasticity (e.g. Ling (1999), Liu, Li and Li (1999)) or on nonlinear autoregressions with ARCH-type, and not GARCH-type, errors (e.g. Liebscher (2005), Masry and Tjøstheim (1995)).

In this section we adopt the analysis of Meitz and Saikkonen (2006), who, following the analysis of Liebscher (2005), considered the case of a general nonlinear autoregressive model of order s with first-order generalised autoregressive conditional heteroskedastic (GARCH(1,1)) errors and provided the conditions of its stability, in the sense of geometric ergodicity, and specifically Q-geometric ergodicity. Since such a model is possible to be represented as a Markov chain, their analysis is based on the theory for Markov chains (for a detailed analysis of Markov chains and their stability theory, see Meyn and Tweedie (2008)).

It can be highlighted that their results are restricted to smooth nonlinear functions for the conditional mean and conditional variance models, in the sense that their derivatives exist and are continuous. This condition, which is not convenient in the case of e.g. Threshold Autoregressive or Threshold GARCH models, is convenient in the case of our models, as they all have an exponential term and not discontinuities, and hence they are all smooth. This fact justifies our choice to follow their analysis.

It should be noted, though, that the choice of first, and not higher, order of the GARCH model is due to the arduousness when establishing irreducibility of the Markov chain, a necessary property for when proving geometric ergodicity (Meitz and Saikkonen, 2006). However, their results hold not only for nonlinear autoregressive models with GARCH errors, but also in the case of nonlinear autoregressive models combined with any smooth nonlinear GARCH-type model for the conditional variance.

It is also worth-mentioning that the property of Q-geometric ergodicity is more useful than the property of geometric ergodicity, as the former does not only suggest that an initial distribution rendering the Markov chain strictly stationary and β-mixing exists, like the geometric ergodicity do, but suggests also the existence of some moments of the stationary distribution and that the β-mixing property holds for different nonstationary initial distributions as well (Meitz and Saikkonen, 2006). Consequently, limit theorems can be applied and an asymptotic theory can be established.

In order to establish the above results, though, it is required to transform our models, which were presented in chapter 2, to a Markov chain representation. This transformation is presented in the next subsection.

3.2.1 Markov chain representation

Let , be the stochastic process of our interest which is generated by




where denotes our nonlinear autoregressive process of (e.g. ExpAR, Extended ExpAR, etc.) of order , is the conditional variance of , which is specified as a GARCH(1,1) model by assumption, and .

Meitz and Saikkonen (2006) showed that such a model is possible to be transformed to a Markov chain on as follows



where .

3.2.2 Q-geometric ergodicity

Next the definition of Q-geometric ergodicity for a Markov chain, as given by Meitz and Saikkonen (2006) and Liebscher (2005), is presented.

Definition: The Markov chain on is Q-geometrically ergodic if there exists a function , a probability measure on , and constants , , and such that and

for all and all ,

where is the n-step transition probability measure of the Markov chain defined on the Borel sets of , .

3.2.3 Assumptions

In this subsection there are presented the conditions which are sufficient when establishing Q-geometric ergodicity and the existence of certain moments for the respective Markov chain of our nonlinear autoregressive model with GARCH errors, as shown by Meitz and Saikkonen (2006) and discussed further by Chan, McAleer and Medeiros (2011). Most of the assumptions required apply to the conditional mean and conditional variance singly, which renders it easier when checking if the assumptions hold, and merely one assumption applies to both the conditional mean and conditional variance model.

Assumption 1: has a (Lebesgue) density which is positive and lower semicontinuous on . Moreover, for some real , .

Assumption 2: The function is of the form , where the functions and are bounded and smooth.

Assumption 3: Using the function from Assumption 2, set and define the matrix


Then there exists a matrix norm induced by a vector norm, such that for all , where , and .

One sufficient condition for Assumption 3 to hold is if or, equivalently, the roots of the characteristic polynomial are inside the unit circle, where (see Meitz and Saikkonen (2006), Lemma 1).

Assumption 4:

(a) The function is smooth and for some .

(b) For all , as .

(c) There exists an such that the sequence defined by , , converges to as for all . If for all and all it suffices that this convergence holds for all .

(d) There exist , and a Borel measurable function such that for all . Furthermore, .

Assumption 5: Let the real number be as in Assumption 1 and and as in Assumption 4(d). Assume that either

(a) , or

(b) and .

Assumption 6: For each initial value , there exists a control sequence such that the matrix

is nonsingular.

As can be easily seen from the above, Assumption 1 concerns the error term , Assumptions 2 and 3 concern only the conditional mean model, Assumptions 4 and 5 restrict only the conditional variance model, and only Assumption 6 concerns both the conditional mean and conditional variance. However, Meitz and Saikkonen (2006) argued that Assumption 6 is possible to be even checked by examining merely the conditional variance model.

The above Assumptions are required for the proof of the Q-geometric ergodicity of the Markov chain and under appropriate initial distributions the process is -mixing and there exists a stationary initial distribution such that and have moments of orders and , respectively, if Assumption 5(a) holds (or and , respectively, with an unknown , if Assumption 5(b) holds instead) (Meitz and Saikkonen (2006)).

3.2.4 Verifying the conditions

Now we will consider our suggested models and we will show that the above results apply to our suggested models as well. Since the first condition holds by assumption, it suffices to discuss only Assumptions 2-6

For the ExpAR model of order s, we have


where , and is a smooth function with range . Hence, this model satisfies Assumptions 2, as it can be written in the form of Assumption 2 and the function is bounded and smooth. A sufficient condition for Assumption 3 is (Chen and Tsay (1993), Meitz and Saikkonen (2006)).

Regarding Assumptions 4-6, it is adequate to check only the conditional variance model. Obviously the ARCH and GARCH models consist of smooth functions.

If is as in Assumption 1 and is generated by e.g. a GARCH(1,1) model, then either , or and , in order for Assumptions 4-6 to hold (see Meitz and Saikkonen (2006) for proof).

Similarly, we can verify the conditions for our remaining suggested models.

3.3 Estimation

One proposed estimation procedure that could be used is maximum likelihood. Assuming that the sequence is identically normal distributed and conditioning on the observation at time , , the conditional log- likelihood function is


is the log-likelihood at time t, which means that the overall conditional log-likelihood function is


In the previous formulae should be replaced by


where is the parameter vector for the conditional mean model and is our specified nonlinear function every time.

Nevertheless, since the distribution of is not known in reality, can be estimated by the quasi-maximum likelihood (QML) method, in which case has the same formula, but is not conditional on the true initial values , rendering it more appropriate in practice.

3.4 Asymptotic theory

In this section we consider conditions required in order to be able to develop asymptotic theory for the estimator vector. Here we follow the analysis of Chan, McAleer and Medeiros (2011) who proved the existence, consistency and asymptotic normality of the QMLE of a general nonlinear autoregressive model with first order GARCH errors. Their results are also based on the fact that a general nonlinear autoregressive model with conditional heteroskedastic errors can be represented as a Markov chain.

3.4.1 Assumptions

In this subsection we present the conditions which are required for proving the existence, consistency and asymptotic normality of the QMLE, as given by Chan, McAleer and Medeiros (2011).

Assumption 7: The sequence of random variables is drawn from a continuous (with respect to Lebesgue measure on the real line), unimodal, positive everywhere density, and bounded in a neighbourhood of .

Assumption 8: The valued process follows the following nonlinear autoregressive process with GARCH(1,1) errors (NAR-GARCH(1,1)):




where , is the vector of parameters of the conditional mean and .

Assumption 9: The nonlinear function satisfy the following set of restrictions:

(i) is continuous in and measurable in .

(ii) is parameterised such that the parameters are well defined.

(iii) and , are independent.

(iv) .

(v) .

(vi) .

(vii) .

If is the vector of the conditional variance parameters, we can set .

Assumption 10: The true parameter vector is in the interior of , a compact and convex parameter space, where is the total number of parameters.

Under the assumptions of this subsection, the QMLE is strongly consistent for , , and if also there exists no set of cardinal 2 such that and , then




and .

For the proofs of the existence of the QMLE, its consistency and its asymptotic normality, see Chan, McAleer and Medeiros (2011).

3.4.2 Verifying the conditions

Here we shall show that the above results can also be applied to our suggested models.

Since conditions 8 and 10 hold by assumption, it suffices to check Assumption 9. For e.g. the ExpAR model of order with GARCH(1,1) errors


where , we have that obviously is 9(i) continuous in and measurable in , 9(ii) parameterised such that the parameters are well defined, and 9(iii) is independent from . In addition, since is a smooth function with range and as long as the model is stationary, Assumptions 9(iv)-9(vii) hold as well.

The conditions for our remaining suggested models can be verified accordingly.

3.5 Multivariate models

In this section the multivariate versions of our suggested models are presented. It should be noted that the following multivariate models are not used in this research, but are presented here as they could be interesting at least theoretically.

Let represent the vector of the time series of our interest with time varying conditional covariance matrix , i.e.,

where is the information set at time , is an unobservable zero mean white noise vector process (serially uncorrelated or independent), and is almost surely (a.s.) positive definite for all .

The conditional mean model of order takes the following form

where , , are coefficient matrices.

For example, a bivariate Vector ExpAR(2) model equation by equation has the form



while the simplest case of a bivariate Vector Extended ExpAR(2) model equation by equation takes the following form



The remaining suggested models can be written accordingly.

Regarding the conditional variance model, if we assume time varying conditional variances and covariances, but constant conditional correlations, as seen in Bollerslev (1990) who modeled several European U.S. dollar exchange rates, we can write every conditional variance in the case of GARCH errors as


while in the case of ARCH errors we have


We can also write every conditional variance as follows


where is a positive time invariant constant and is positive almost surely for all . In this case, we can partition as


where is the stochastic diagonal matrix with elements , and is an time invariant matrix with as elements, where


is the conditional correlation, with representing the element in .

Although Tse (2000) showed that the spot-futures and foreign exchange data he used have constant correlations, validating Bollerlev’s (1990) assumption, the correlations across the national stock market returns he used are time varying, in which case we need to model some interdependence among and for .

In order to capture completely the past information, similarly to the univariate case, there are various model specifications for the multivariate conditional variance. However, in the latter case, should contain some past information, not only from but also from .

In order to allow for such interdependence among different assets and/or markets, Ling and McAleer (2003) considered along with an ARMA specification for the conditional mean the following GARCH model for the conditional variance



and .

Accordingly, in the case of ARCH errors we have




In any case, we should test the hypothesis of constant correlations prior to specifying the multivariate GARCH-type model.

If we assume conditional normality, in the multivariate case the log-likelihood function can be written as


where is the vector of all the unknown parameters in both the conditional mean and conditional variance models and the maximum likelihood estimator can be defined as


Under standard regularity conditions the maximum likelihood estimator for is asymptotically normal and inference procedures can be developed (Bollerslev, 1990).


Bollerslev, T. (1990) Modelling the coherence in short-run nominal exchange rates: A Multivariate Generalized ARCH model. The Review of Economics and Statistics.

Chan, F., McAleer, M. J., and Medeiros, M. C. (2011) Structure and Asymptotic Theory for Nonlinear Models with GARCH Errors. Econometric Institute Research Papers, No. EI 2010-79, pp. 1-27.

Chen, R., and Tsay, R. S. (1993) Functional-coefficient autoregressive models. Journal of the American Statistical Association, 88(421), 298-308.

Ling, S. (1999) On the probabilistic properties of a double threshold ARMA conditional heteroskedastic model. Journal of Applied Probability, 36(3), 688-705.

Ling, S., and McAleer, M. (2003). Asymptotic theory for a vector ARMA-GARCH model. Econometric Theory, 19(2), 280-310.

Liu, J., Li, W. K., and Li, C. W. (1997) On a threshold autoregression with conditional heteroscedastic variances. Journal of Statistical Planning and inference, 62(2), 279-300.

Masry, E., and Tjøstheim, D. (1995) Nonparametric Estimation and Identification of Nonlinear ARCH Time Series Strong Convergence and Asymptotic Normality: Strong Convergence and Asymptotic Normality. Econometric theory, 11(02), 258-289.

Meitz, M., and Saikkonen, P. (2008) Stability of nonlinear ARâ€┬ÉGARCH models, Journal of Time Series Analysis, 29(3), 453-475.

Meyn, S. P. and, Tweedie, R.L. (1993) Markov Chains and Stochastic Stability. Springer, Berlin.

Tse, Y. K. (2000) A test for constant correlations in a multivariate GARCH model, Journal of Econometrics 98, 107-127.

To export a reference to this article please select a referencing stye below:

Reference Copied to Clipboard.
Reference Copied to Clipboard.
Reference Copied to Clipboard.
Reference Copied to Clipboard.
Reference Copied to Clipboard.
Reference Copied to Clipboard.
Reference Copied to Clipboard.

Request Removal

If you are the original writer of this essay and no longer wish to have the essay published on the UK Essays website then please click on the link below to request removal:

More from UK Essays

We can help with your essay
Find out more