Reading a large csv and converting to timetable

I have a large .csv (7179x72001) where the first column is filled with datenums and the remaining columns are numerical values. The only way I have been successful in reading this data is by using csvread() and it usually takes about 20 minutes.
I have a second .csv which contains the same values but in datetime format and I would like to compare the two.
Is it possible to convert the first column in the large file so that the values are datetimes, and then in turn convert this to a timetable?
I can do this but I only want to convert the first column, not the whole dataframe:
newtable=datetime(dataframe, 'ConvertFrom', 'datenum');

4 Comments

Did you try readtable?
Yeah, I have tried with readtable() but the problem is that in this format I get a message when I try to preview and it takes ~10 min to preview using head(table)
Cannot display summaries of variables with more than 524288 elements.
I have just tried this:
thetable=readtable(fullfile(foldername,'001Noises_5103_PSD_1sHammingWindow_50%Overlap_output.csv'));
datetime(thetable.Var1,'ConvertFrom','datenum');
head(thetable)
This doesn't give any errors but the contents of the first column remain as datenums.
Ah, I see now that it should be this:
tt.Var1=datetime(tt.Var1, 'ConvertFrom','datenum');
This works! Thanks for your help!!

Sign in to comment.

 Accepted Answer

tt.Var1=datetime(tt.Var1, 'ConvertFrom','datenum');

2 Comments

You can accept your own answer so it could help someone else

Sign in to comment.

More Answers (0)

Categories

Products

Release

R2019a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!