No data was written in output source : rxDataStepXdf function

138 views Asked by At

I have executed below code for selecting rows & column from a .xdf file & creating a new .xdf file but its not working. Below is the code & message shown after execution:

S_date <- as.Date("2014-05-01")   

rxDataStepXdf(inFile = "/poc/revor/data/ext_merchant_account.xdf",
              outFile = "/poc/revor/data/ext_merchant_account_filtered.xdf",
              rowSelection = ((CUR_MER_STA_CD %in% c("A","R")) & 
                              (CLNT_MAN_CHAN_CD %in% c("I","X"," ")) & 
                              (MER_SETUP_DT < S_date)), 
              varsToKeep = c("SE_NO","SEIMS_INDUS_DS_CD"),
              transformObjects = list(S_date = S_date),
              overwrite = TRUE)

Message :

WARNING: No data was written to the output data source.

Below is the .Xdf file structure :

File name: /poc/revor/data/ext_merchant_account.xdf
Number of observations: 13529673
Number of variables: 74
Number of blocks: 136
Compression type: zlib

Just want to filter rows & column based on some criteria but the output .xdf file is not getting created.

Enviorment in which I am running the code:

Revolution R enviornment on Hadoop cluster.

Could anyone point out the mistake that I am doing over here.

Thanks for your help in Advance....:)

Cheers,

Amit

0

There are 0 answers