I'm having trouble creating a new Drill Storage Plugin for AWS S3. I'm following these instructions:
- Point your browser to http://:8047
- Select the 'Storage' tab.
- A good starting configuration for S3 can be entirely the same as the dfs plugin, except the connection parameter is changed to s3://bucket. So first select the Update button for dfs, then select the text area and copy it into the clipboard (on Windows, ctrl-A, ctrl-C works).
- Press Back, then create a new plugin by typing the name into the New Storage Plugin, then press Create. You can choose any name, but a good convention is to use s3- so you can easily identify it later.
- In the configuration area, paste the configuration you just grabbed from 'dfs'. Change the line connection: "file:///" to connection: "s3://".
- Click Update. You should see a message that indicates success.
I completed the steps before this section (ie. modifying hadoop_excludes.txt
and making a core-site.xml
). In the steps posted above, I made it to step 5, but for step 6, my screen shows no "Update" button, only "Create" and "Back". (screenshot here, as I can't post images.)
If I click Create, nothing happens. If I click Back, I'm taken back to the main Storage Plugin page, and my entry isn't there. (If I click Create and then Back, it doesn't save, either.)
Here's the configuration text I'm using (copied from dfs plugin):
{
"type": "file",
"enabled": true,
"connection": "s3:///",
"workspaces": {
"root": {
"location": "/",
"writable": false,
"defaultInputFormat": null
},
"tmp": {
"location": "/tmp",
"writable": true,
"defaultInputFormat": null
}
},
"formats": {
"psv": {
"type": "text",
"extensions": [
"tbl"
],
"delimiter": "|"
},
"csv": {
"type": "text",
"extensions": [
"csv"
],
"delimiter": ","
},
"tsv": {
"type": "text",
"extensions": [
"tsv"
],
"delimiter": "\t"
},
"parquet": {
"type": "parquet"
},
"json": {
"type": "json"
},
"avro": {
"type": "avro"
}
}
}
So what am I doing wrong here? Any advice is much appreciated!
EDIT:
Problem solved - I was running the Drill Web UI in Chrome, which doesn't have Java support. When I ran in Firefox I was able to make this new Storage Plugin successfully.