I loaded big data files (https://www.kaggle.com/c/avazu-ctr-prediction) using the read.csv.ff command from ff package using the following command:
train = read.csv.ffdf(file="path to my big data files/train.csv",VERBOSE=TRUE)
then save it using the usual save workspace from RStudio. It created two files:
an .RData file and .ffData one which is a compressed file.
Everything worked fine but each time I restart my computer or close RStudio and open RStudio again, I'm unable to access ffdf objects from my workspace giving the error:
>train[1,]
file.access(filename, 0) == 0 is not TRUE
Or I can see the ffobject in the workspace I loaded.
What is this problem? how could I fix it?
Thanks in advance, HR
Use 'ffsave', not 'save', and then 'ffload' when you want to read it back in again. So, something like: