How to declaratively manage Kafka topics?

Question

We're using Apache Kafka and have a lot of manually created topics (with custom topic config). We want to manage our topics like the rest of our infrastructure/configuration as code.

How can we programmatically and declaratively manage our topics? Whats the sane way?

Answer 1

Here is a list of tools that might fit what you are looking for. They are all focused around declaratively managing resources, such as topics and ACLs, in Kafka.

Command-line

• jikkou
• kafka-gitops
• kdef
• topicctl

Terraform

• terraform-provider-kafka