Best way to import millions of rows of data using ODBC to connect to AS400?

4 views (last 30 days)
I need to import large databases to matlab. Would this be possible? There are about 235 million rows and about 90 columns. Is this even possible in matlab and if not then what is the next best tool to do this? It uses an odbc connection to an as400 system. I can also have it linked to an access database.

Accepted Answer

Walter Roberson
Walter Roberson on 19 Apr 2019
Microsoft Access maximum table size: 2 gigabytes minus size of system objects
"You can link to tables in multiple database files, each of which can be as large as 2GB."
Assuming you are using double precision, 2^31/8/90 is slightly less than 3 million, so you have about 80 times too much data to put into a single access database; if you wanted to shoe-horn this into Access you would need to link to 80 database files. Sounds grotty to me.
It looks like MySQL could easily handle databases the size you need.

More Answers (0)

Products


Release

R2019a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!