Deploying and Running Apache Kafka on Kubernetes
1h 44mIntermediate2021-12-16
Authors

Kate Stanley
Software Engineer at IBM
Course details
Apache Kafka has become the de-facto event-streaming platform, and its popularity is growing every year. Did you know that you can even deploy Kafka on a Kubernetes cluster? Whether you’re deploying Kafka yourself or using a tool or a managed service, there are a few key points to keep in mind. In this course, instructor Kate Stanley talks you through how to deploy Kafka on Kubernetes effectively.
Explore the platform's internals and concepts and learn more about the Kubernetes features that fit best with Kafka. Kate covers the Kafka configuration options that are essential to a successful, healthy deployment. She teaches you how to configure Kafka to make it accessible from outside the Kubernetes cluster. Examples are drawn from existing open-source projects, taking you step by step through the deployment process and giving you tips to make it easier along the way.
Explore the platform's internals and concepts and learn more about the Kubernetes features that fit best with Kafka. Kate covers the Kafka configuration options that are essential to a successful, healthy deployment. She teaches you how to configure Kafka to make it accessible from outside the Kubernetes cluster. Examples are drawn from existing open-source projects, taking you step by step through the deployment process and giving you tips to make it easier along the way.
Skills covered
KafkaKubernetesApacheDevOps ToolsData EngineeringDevOpsData ScienceOpen SourceDeep Dive (X:Y)
Concepts
0. Introduction
- 01 - Introduction to this course
1. Running a Kafka Cluster on the Command Line
- 02 - Running Apache Kafka on the command line
- 03 - Sending Apache Kafka events
2. Deploying an Apache Kafka Cluster to Kubernetes
- 04 - Apache Kafka brokers and their identity
- 05 - Kubernetes StatefulSets for brokers
- 06 - Installing Docker and Kubernetes
- 07 - Deploying an Apache Kafka StatefulSet
3. Gaining Access to Apache Kafka
- 08 - Listeners and advertised listeners
- 09 - Multi-broker Apache Kafka cluster in containers
- 10 - Multi-broker Apache Kafka cluster on Kubernetes in theory
- 11 - Multi-broker Apache Kafka cluster on Kubernetes in practice
- 12 - Deploying ZooKeeper
4. Keeping Apache Kafka on Kubernetes Healthy
- 13 - Health probes in Kubernetes
- 14 - Readiness probes in Kubernetes
- 15 - Configuring Apache Kafka health
- 16 - Configuring Apache Kafka readiness
5. Apache Kafka on Kubernetes in Production
- 17 - High availability in Kubernetes
- 18 - Automation for deploying Apache Kafka on Kubernetes
- 19 - Deploying Apache Kafka with Strimzi Operators