Sqoop Export from HDFS to Crate.io DB With No Error/Output

Question

I'm trying to export my hdfs to Crate.io DB and I'm using Sqoop to do it. I've imported the required .jar files and my sqoop file looks like:

export
--connect
jdbc:crate://<SERVER-IP>:4200/

--driver
io.crate.client.jdbc.CrateDriver

--table
test

--export-dir
/to/file/in/hdfs

--input-fields-terminated-by
','

--columns
name, age

My sqoop operation runs without any error, but there's nothing from my hdfs getting inserted into the crate db. I've tried mentioning "doc" in the IP but still no success.

--connect
jdbc:crate://<SERVER-IP>:4200/doc

And alternatively used

--table
doc.test

I've been able to insert content into crate through the Python Library, but not through Sqoop. Any ideas what I might be doing wrong here?

Answer 1

You are using port 4200 which is exposed as HTTP port. Since Crate 0.57 you have access via postges protocol (5432). Prior 0.57 you need to use tcp 4300 for jdbc