[R] Large data set

[arun]

HI,

You can try dbLoad() from hash package.  Not sure whether it will be successful.

A.K.



----- Original Message -----
From: Lorcan Treanor <lorcan.treanor at idiro.com>
To: r-help at r-project.org
Cc: 
Sent: Monday, July 23, 2012 8:02 AM
Subject: [R] Large data set

Hi all,

Have a problem. Trying to read in a data set that has about 112,000,000
rows and 8 columns and obviously enough it was too big for R to handle. The
columns are mode up of 2 integer columns and 6 logical columns. The text
file is about 4.2 Gb in size. Also I have 4 Gb of RAM and 218 Gb of
available space on the hard drive. I tried the dumpDF function but it was
too big. Also tried bring in the data is 10 sets of about 12,000,000. Are
there are other ways of getting around the size of the data.

Regards,

Lorcan

    [[alternative HTML version deleted]]

______________________________________________
R-help at r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.