Importing large csv files

Problems with modeling
Post Reply
hhngo96
User
User
Posts: 1
Joined: 6 years ago

Importing large csv files

Post by hhngo96 »

Hello everyone,

I am currently working on a project that requires importing a large csv files (22489 rows x 37480 columns) which is about 2.5GB. I cannot import it to gams using the following syntax:
Table x(a1,i) text
$ondelim
$include lhs1a.csv
$offdelim;
;
Error: Non-blank character exceed 80000
Can someone help me with this problem, I greatly appreciate your advice.
Thank you,
User avatar
bussieck
Moderator
Moderator
Posts: 1033
Joined: 7 years ago

Re: Importing large csv files

Post by bussieck »

Hi,

Have you tried csv2gdx (https://www.gams.com/latest/docs/T_CSV2GDX.html)? If that does not work I would be interested to take a closer look. Can you make the file available (or at least the first 100 or so rows)?

-Michael
Post Reply