I'm ingesting the content of a Teradata table that contains ~700,000,000 rows with JDBC FastExport.
My code (simplified) is the following:
Class.forName("com.teradata.jdbc.TeraDriver")
val url = "jdbc:teradata://xxx/database=xxx,CHARSET=UTF8,TMODE=TERA,TYPE=FASTEXPORT,RECONNECT_COUNT=50"
val connection = DriverManager.getConnection(url, "user", "pwd")
val stmt = connection.prepareStatement("SELECT * FROM MY_TABLE")
stmt.setFetchSize(100000)
val rs = stmt.executeQuery()
while (rs.next()) println(rs.getObject(1))
The driver I'm using come from "com.teradata.jdbc" % "terajdbc4" % "16.20.00.13".
The performance I'm getting is ~1,200,000 rows/min and I was wondering if I can expect more and if there's anything I can do to improve it.