[R] ff package: reading selected columns from csv

[threshold]

*..plus I get the following message after reading the whole set (all 7
columns):*

> read.csv.ffdf(file=csvfile, header=FALSE, skip=100, first.rows=1000,
> next.rows=1e7, VERBOSE=TRUE)

read.table.ffdf 1..1000 (1000)  csv-read=0.02sec ffdf-write=0.08sec
read.table.ffdf 1001..10001000 (10000000)  csv-read=282.16sec
ffdf-write=65.01sec
read.table.ffdf 10001001..20001000 (10000000)  csv-read=240.3sec
ffdf-write=63.84sec
read.table.ffdf 20001001..30001000 (10000000)  csv-read=213.78sec
ffdf-write=149.2sec
read.table.ffdf 30001001..40001000 (10000000)  csv-read=217.36sec
ffdf-write=379.8sec
read.table.ffdf 40001001..50001000 (10000000)  csv-read=541.28secError:
cannot allocate vector of size 381.5 Mb
In addition: There were 14 warnings (use warnings() to see them)
> warnings()
Warning messages:
1: In match(levels(x), lev) :
  Reached total allocation of 7987Mb: see help(memory.size)
2: In match(levels(x), lev) :
  Reached total allocation of 7987Mb: see help(memory.size)



--
View this message in context: http://r.789695.n4.nabble.com/ff-package-reading-selected-columns-from-csv-tp4637794p4637900.html
Sent from the R help mailing list archive at Nabble.com.