Hello to everybody
Berry (1993) states a number of assumptions to be satisfied in regression analysis(underneath). My concern is assumption 8: the residuals are normally distributed. In many cases they are not.
My questions are:
A) What is the remedy to non-normal distribution of the residuals in EViews?
B) If a remedy is not necessary, what is the theoretical justification?
Regression assumptions:
1.“All independent variables (X1, X2… Xk) are quantitative or dichotomous and the dependent variable, Y, is quantitative, continuous, and unbounded. Moreover, all variables are measured without error.”
2. “All independent variables have nonzero variance (i.e., each independent variable has some variation in value.”
3. “There is not perfect multicollinearity (i.e., there is no exact linear relationship between two or more of the independent variables)”.
4. “At each set of values for the k independent variables, (X1j, X2j... Xkj), E (ɛj|X1j, X2j… Xkj) = 0 (i.e. the mean value of the error term is zero).”
5. “For each Xi, COV(Xij, ɛj) = 0 (i.e., each independent variable is uncorrelated with the error term).”
6. “For each set of values for the k independent variables, (X1j, X2j… Xkj), VAR (ɛj|X1j, X2j… Xkj) = σ2, where σ2 is a constant (i.e., the conditional variance of the error term is constant); this is known as the assumption of homoscedasticity.”
7. "For any two observations, (X1j, X2j,…, Xkj) and (X1h, X2h,…, Xkh), COV(ɛj, ɛh) = 0 (i.e., error terms for different observations are uncorrelated); this assumption is known as lack of autocorrelation.”
8. “At each set of values for the k independent variables, ɛj is normally distributed.”
Regression assumptions
Moderators: EViews Gareth, EViews Moderator
-
startz
- Non-normality and collinearity are NOT problems!
- Posts: 3796
- Joined: Wed Sep 17, 2008 2:25 pm
Re: Regression assumptions
Normality of the errors is required for the coefficients to have normal distributions in small samples. Without this assumption one has to rely on asymptotic properties. Unless the sample is small or the errors are extremely non-normal, the assumption isn't very important.
-
martingale
- Posts: 51
- Joined: Tue Jul 24, 2012 11:36 am
Re: Regression assumptions
Thanks a lot for prompt ansewr! I need some explaining:
C) What is considered to be a small sample? Can it be quantified?
D) What is considered to be extremely non-normal? Can it be quantified?
And I still need a justification on why it is not important unless C or D come into place.
C) What is considered to be a small sample? Can it be quantified?
D) What is considered to be extremely non-normal? Can it be quantified?
And I still need a justification on why it is not important unless C or D come into place.
-
startz
- Non-normality and collinearity are NOT problems!
- Posts: 3796
- Joined: Wed Sep 17, 2008 2:25 pm
Re: Regression assumptions
There's no generic answer, but a Monte Carlo can be used to see what happens in any particular case.
-
martingale
- Posts: 51
- Joined: Tue Jul 24, 2012 11:36 am
Re: Regression assumptions
Is sounds much easier to apply a remedy. Does EView has one?
-
startz
- Non-normality and collinearity are NOT problems!
- Posts: 3796
- Joined: Wed Sep 17, 2008 2:25 pm
Re: Regression assumptions
There is no generic remedy (nothing to do with EViews), and as a practical matter nonnormality is rarely a problem.
-
martingale
- Posts: 51
- Joined: Tue Jul 24, 2012 11:36 am
Re: Regression assumptions
OK. But in order to justify this assertion to other people we need to elaborate on theoretical grounds, right? Any suggestions?
-
startz
- Non-normality and collinearity are NOT problems!
- Posts: 3796
- Joined: Wed Sep 17, 2008 2:25 pm
Re: Regression assumptions
It's just (some version of) the central limit theorem.
-
martingale
- Posts: 51
- Joined: Tue Jul 24, 2012 11:36 am
Re: Regression assumptions
I'd appreciate a reference. Need it for a master thesis. Thanx a lot for your ansewrs so far.
-
EViews Gareth
- Fe ddaethom, fe welon, fe amcangyfrifon
- Posts: 13586
- Joined: Tue Sep 16, 2008 5:38 pm
-
martingale
- Posts: 51
- Joined: Tue Jul 24, 2012 11:36 am
Re: Regression assumptions
that's rather useless
-
martingale
- Posts: 51
- Joined: Tue Jul 24, 2012 11:36 am
Re: Regression assumptions
A violation of the normality assumption of the residuals is not as serious as heteroscedasticity and autocorrelation. A moderate departure from normality does not impair the conclusion when the data set is large (Bhattacharyya and Johnson 1997 p. 359). Greene (2012 pp. 64-67) states that a normal distribution of the error term is not necessary for establishing results that allow statistical inference. These results are based on the law of large numbers which concerns consistency and the central limit theorem which concerns the asymptotic distribution of the estimator.
Return to “Econometric Discussions”
Who is online
Users browsing this forum: No registered users and 2 guests
