Elastic Search 5 and SQL Server synchronisation

Question

I am starting a Elastic search 5 project from data that are actually in a SQL Server, so I am starting from the start:

I am thinking about how import data from my SQL Server, and especially how to synchronise my data when data are updated or added.

I saw here it is adviced to make no too frequent batch.

But how make synchronisation batchs, may I have to write it myself or is there very used tools and practices ? River and JDBC plugin feeder appears to have been really used but don't work with Elastic Search 5.*

Any help would be very welcomed.

Answer 1

I'd recommend using Logstash:

• It's easy to use and setup
• You can do your own ETL in logstash configuration files
• You can have multiple JDBC sources in one file
• You'll have figure out how to make incremental (batched) updates to sync your data. It really depends on your data model.

This is a nice blog piece to begin with:

https://www.elastic.co/blog/logstash-jdbc-input-plugin