Stack variables in large panel
Posted: Mon Mar 23, 2015 6:29 am
I have a panel with 1016 cross sections and total ~5 million observations. In the data set, I have 4 different series, that contains data that of the same variabel. I want to merge these 4 together, as one series in a panel.
95% of the observation are NA. There might be some overlapping, where the data should be identical. Therefore it would be ok to overwrite data, as long as the new data is not NA.
The four variables are named stack?.
My issue is that Eviews won't stack the series, either through order Stacked or Interleaved due to the workfile beeing to large. It seems that this option does not perform a simple merge of the variables, but something else.
Max observation should be 15million in one series, and the new series should only have ~5million observations when the merge is completed.
95% of the observation are NA. There might be some overlapping, where the data should be identical. Therefore it would be ok to overwrite data, as long as the new data is not NA.
The four variables are named stack?.
My issue is that Eviews won't stack the series, either through order Stacked or Interleaved due to the workfile beeing to large. It seems that this option does not perform a simple merge of the variables, but something else.
Max observation should be 15million in one series, and the new series should only have ~5million observations when the merge is completed.