dealing with large dataset when creating R package

94 views Asked by At

I am trying to create an R package. I have a prebuilt r data object(model.RData) saved in data folder of my R package . But its size is huge ~30 GB. While installing the package I got the below error:

Error in utils::tar(filepath, pkgname, compression = "gzip", compression_level = 9L,  : 
  file size is limited to 8GB

I tried adding datalist using the below command but it returns NULL

tools::add_datalist("/Package/data",force = TRUE)

I have seen a couple of techniques being proposed like distributing datasets as .Rda images but not sure how to go about it. Please suggest a technique on dealing with such huge datasets when creating R packages.

0

There are 0 answers