How to load a big csv using ff package?

595 views Asked by At

I'm new at R. I have a big csv around 2.5 gb with 3 columns and 40 million rows. The datatypes of the column are interger, datetime and char. How to load this csv using ff package?

1

There are 1 answers

0
Aashu On

Well it will give you some idea and use existing links Save and load your bigData ,load big csv file

all <- read.csv("file.csv")
    library("ff")
    help(read.table.ffdf)
    x<- read.csv.ffdf(file="file.csv", header=TRUE, VERBOSE=TRUE, first.rows=10000, next.rows=50000, colClasses=NA)
    save.ffdf(ffdfname, dir=”/PATH/TO/STORE/FF/FILES”)
    load.ffdf(dir=”/PATH/TO/STORE/FF/FILES”)

hope it will help you.