Can we make use of AWS S3 connectivity with HPCC Cluster without administrative access to the cluster?

80 views Asked by At

So I wanted to look on how one can develop AWS S3 connectivity with a HPCC Cluster. Tools like s3cmd and aws cli work well if I am accessing files from my S3 bucket onto my localhost cluster by getting into the directory of the landing zone, which is on my local machine in this case. However, is there a way to extract files from the S3 bucket without any administrative access, just by using ECL IDE (probably on another non-local cluster)?

There is no specific plugin for AWS S3 connectivity with HPCC Cluster, so I was a bit confused.

1

There are 1 answers

1
Richard Taylor On

Depending on exactly what you want to do, you should look at the PIPE() function.