Page 1 of 1

Importing large csv files

Posted: Mon Apr 09, 2018 6:50 pm
by hhngo96
Hello everyone,

I am currently working on a project that requires importing a large csv files (22489 rows x 37480 columns) which is about 2.5GB. I cannot import it to gams using the following syntax:
Table x(a1,i) text
$ondelim
$include lhs1a.csv
$offdelim;
;
Error: Non-blank character exceed 80000
Can someone help me with this problem, I greatly appreciate your advice.
Thank you,

Re: Importing large csv files

Posted: Tue Apr 10, 2018 8:21 am
by bussieck
Hi,

Have you tried csv2gdx (https://www.gams.com/latest/docs/T_CSV2GDX.html)? If that does not work I would be interested to take a closer look. Can you make the file available (or at least the first 100 or so rows)?

-Michael