Regression assumptions

For econometric discussions not necessarily related to EViews.

Moderators: EViews Gareth, EViews Moderator

martingale
Posts: 51
Joined: Tue Jul 24, 2012 11:36 am

Regression assumptions

Postby martingale » Tue Mar 05, 2013 7:42 am

Hello to everybody

Berry (1993) states a number of assumptions to be satisfied in regression analysis(underneath). My concern is assumption 8: the residuals are normally distributed. In many cases they are not.

My questions are:
A) What is the remedy to non-normal distribution of the residuals in EViews?
B) If a remedy is not necessary, what is the theoretical justification?


Regression assumptions:
1.“All independent variables (X1, X2… Xk) are quantitative or dichotomous and the dependent variable, Y, is quantitative, continuous, and unbounded. Moreover, all variables are measured without error.”
2. “All independent variables have nonzero variance (i.e., each independent variable has some variation in value.”
3. “There is not perfect multicollinearity (i.e., there is no exact linear relationship between two or more of the independent variables)”.
4. “At each set of values for the k independent variables, (X1j, X2j... Xkj), E (ɛj|X1j, X2j… Xkj) = 0 (i.e. the mean value of the error term is zero).”
5. “For each Xi, COV(Xij, ɛj) = 0 (i.e., each independent variable is uncorrelated with the error term).”
6. “For each set of values for the k independent variables, (X1j, X2j… Xkj), VAR (ɛj|X1j, X2j… Xkj) = σ2, where σ2 is a constant (i.e., the conditional variance of the error term is constant); this is known as the assumption of homoscedasticity.”
7. "For any two observations, (X1j, X2j,…, Xkj) and (X1h, X2h,…, Xkh), COV(ɛj, ɛh) = 0 (i.e., error terms for different observations are uncorrelated); this assumption is known as lack of autocorrelation.”
8. “At each set of values for the k independent variables, ɛj is normally distributed.”

startz
Non-normality and collinearity are NOT problems!
Posts: 3796
Joined: Wed Sep 17, 2008 2:25 pm

Re: Regression assumptions

Postby startz » Tue Mar 05, 2013 7:47 am

Normality of the errors is required for the coefficients to have normal distributions in small samples. Without this assumption one has to rely on asymptotic properties. Unless the sample is small or the errors are extremely non-normal, the assumption isn't very important.

martingale
Posts: 51
Joined: Tue Jul 24, 2012 11:36 am

Re: Regression assumptions

Postby martingale » Tue Mar 05, 2013 7:52 am

Thanks a lot for prompt ansewr! I need some explaining:

C) What is considered to be a small sample? Can it be quantified?
D) What is considered to be extremely non-normal? Can it be quantified?

And I still need a justification on why it is not important unless C or D come into place.

startz
Non-normality and collinearity are NOT problems!
Posts: 3796
Joined: Wed Sep 17, 2008 2:25 pm

Re: Regression assumptions

Postby startz » Tue Mar 05, 2013 8:13 am

There's no generic answer, but a Monte Carlo can be used to see what happens in any particular case.

martingale
Posts: 51
Joined: Tue Jul 24, 2012 11:36 am

Re: Regression assumptions

Postby martingale » Tue Mar 05, 2013 9:06 am

Is sounds much easier to apply a remedy. Does EView has one?

startz
Non-normality and collinearity are NOT problems!
Posts: 3796
Joined: Wed Sep 17, 2008 2:25 pm

Re: Regression assumptions

Postby startz » Tue Mar 05, 2013 9:24 am

There is no generic remedy (nothing to do with EViews), and as a practical matter nonnormality is rarely a problem.

martingale
Posts: 51
Joined: Tue Jul 24, 2012 11:36 am

Re: Regression assumptions

Postby martingale » Tue Mar 05, 2013 9:31 am

OK. But in order to justify this assertion to other people we need to elaborate on theoretical grounds, right? Any suggestions?

startz
Non-normality and collinearity are NOT problems!
Posts: 3796
Joined: Wed Sep 17, 2008 2:25 pm

Re: Regression assumptions

Postby startz » Tue Mar 05, 2013 9:33 am

It's just (some version of) the central limit theorem.

martingale
Posts: 51
Joined: Tue Jul 24, 2012 11:36 am

Re: Regression assumptions

Postby martingale » Tue Mar 05, 2013 9:45 am

I'd appreciate a reference. Need it for a master thesis. Thanx a lot for your ansewrs so far.

EViews Gareth
Fe ddaethom, fe welon, fe amcangyfrifon
Posts: 13586
Joined: Tue Sep 16, 2008 5:38 pm

Re: Regression assumptions

Postby EViews Gareth » Tue Mar 05, 2013 9:52 am


martingale
Posts: 51
Joined: Tue Jul 24, 2012 11:36 am

Re: Regression assumptions

Postby martingale » Tue Mar 05, 2013 10:06 am

that's rather useless

martingale
Posts: 51
Joined: Tue Jul 24, 2012 11:36 am

Re: Regression assumptions

Postby martingale » Thu Mar 07, 2013 2:39 pm

A violation of the normality assumption of the residuals is not as serious as heteroscedasticity and autocorrelation. A moderate departure from normality does not impair the conclusion when the data set is large (Bhattacharyya and Johnson 1997 p. 359). Greene (2012 pp. 64-67) states that a normal distribution of the error term is not necessary for establishing results that allow statistical inference. These results are based on the law of large numbers which concerns consistency and the central limit theorem which concerns the asymptotic distribution of the estimator.


Return to “Econometric Discussions”

Who is online

Users browsing this forum: No registered users and 2 guests