Repository files navigation

This community seeks to provide:

• Production-worthy Kafka setup for persistent (domain- and ops-) data at small scale.
• Operational knowledge, biased towards resilience over throughput, as Kubernetes manifest.
• A platform for event-driven (streaming!) microservices design using Kubernetes.

To quote@arthurk:

thanks for creating and maintaining this Kubernetes files, they're up-to-date (unlike the kubernetes contrib files, don't require helm and work great!

We suggest youapply -f manifests in the following order:

• Your choice of storage classes from./configure
• namespace
• ./rbac-namespace-default
• ./zookeeper
• ./kafka

That'll give you client "bootstrap"bootstrap.kafka.svc.cluster.local:9092.

Our only dependency iskubectl. Not because we dislike Helm or Operators, but because we think plain manifests make it easier to collaborate.If you begin to rely on this kafka setup we recommend you fork, for example to editbroker config.

Have a look at:

• ./prometheus
• ./linkedin-burrow
• or plain JMX
• what's happening in themonitoring label.
• Note that this repo is intentionally light onautomation. We think every SRE team must build the operational knowledge first.

Available for:

• Brokers

Forminikube,youkube etc:

• Scale 1
• Scale 2

• Kubernetes events to Kafka
• Container logs to Kafka
• Heapster metrics to Kafka