Optimization Method for Least Squares
Moderators: EViews Gareth, EViews Moderator
-
- Posts: 13
- Joined: Fri Feb 09, 2018 12:07 pm
Optimization Method for Least Squares
I noticed with some methods the convergence method is shown at the estimation output screen, but with OLS the convergence method is omitted. I checked the documentation, but couldn't find details about the convergence method of OLS. Getting OLS to converge is hardly a challenge, but I'm guessing under the hood somewhere there is a convergence method for OLS. If so, what is it?
-
- Fe ddaethom, fe welon, fe amcangyfrifon
- Posts: 13317
- Joined: Tue Sep 16, 2008 5:38 pm
Re: Optimization Method for Least Squares
Ols does not have convergence. There is nothing to converge.
Follow us on Twitter @IHSEViews
-
- Posts: 13
- Joined: Fri Feb 09, 2018 12:07 pm
Re: Optimization Method for Least Squares
You are more knowledgeable about this than myself, but from what I understand, technically OLS is still a matter of convergence, it just tends to converge after only 1 iteration. Let me try to rephrase my question.
OLS is a simple method, it doesn't need a fancy convergence method per say. However, OLS is trying to minimize the squared residuals, that can be seen as an optimization problem. The question is, what is the optimization method? What is the method eviews uses to make sure it arrives at the "line of best fit". As simple as OLS is, it still needs to be optimized right? I'm just curious. Maybe it's gradient descent? If the optimization method is in the documentation somewhere, please refer me to that.
OLS is a simple method, it doesn't need a fancy convergence method per say. However, OLS is trying to minimize the squared residuals, that can be seen as an optimization problem. The question is, what is the optimization method? What is the method eviews uses to make sure it arrives at the "line of best fit". As simple as OLS is, it still needs to be optimized right? I'm just curious. Maybe it's gradient descent? If the optimization method is in the documentation somewhere, please refer me to that.
-
- Non-normality and collinearity are NOT problems!
- Posts: 3775
- Joined: Wed Sep 17, 2008 2:25 pm
Re: Optimization Method for Least Squares
betaHat=inv(X'X)X'y
-
- Fe ddaethom, fe welon, fe amcangyfrifon
- Posts: 13317
- Joined: Tue Sep 16, 2008 5:38 pm
Re: Optimization Method for Least Squares
Its an optimization in the same sense that find the optimal value of X such that X+3=0 is an optimization.
Follow us on Twitter @IHSEViews
-
- EViews Developer
- Posts: 2672
- Joined: Wed Oct 15, 2008 9:17 am
Re: Optimization Method for Least Squares
It's an optimization, but because of the linearity of the specification, there is a closed form solution which does not require iteration. You are welcome to think of that as convergence in the sense that given the preliminary estimate, there is no improvement to be gained by perturbing the coefficients, though most people would not view the problem in those terms.
Return to “General Information and Tips and Tricks”
Who is online
Users browsing this forum: No registered users and 20 guests