read from a text file

5 views (last 30 days)
bahare
bahare on 17 Jan 2012
Hi I have a very big text file containing a huge amount of data, I like to break it down to small parts and read each part separately in order to avoid the 'out of memory' error. is there any idea how to read the data?

Accepted Answer

Sven Schoeberichts
Sven Schoeberichts on 17 Jan 2012
doc textscan

More Answers (2)

bahare
bahare on 17 Jan 2012
I have already read the help for this command, how ever I did not find any thing relevant to this command, does textscan command breaks down the data in a text file?
  1 Comment
Sven Schoeberichts
Sven Schoeberichts on 17 Jan 2012
C = textscan(fid, 'format', N) reads data from the file, using the format N times, where N is a positive integer. To read additional data from the file after N cycles, call textscan again using the original fid.
So it reads N lines. If you run the function again, it takes off where it ended, so you can use a loop to run through your data.

Sign in to comment.


bahare
bahare on 18 Jan 2012
Thanks, I tried to read the text from the line 1 to the line 100000, and then from 100001 to 200000, and so on, so I wrote my code in the following way: C=textscan(fopen('aug'),'%f %s', 100000, 'delimiter',',')); so how should I write to read the line 100001 to 200000 and then from line 200001 to 300000?

Tags

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!