Stream Processing Design Patterns with Kafka Streams

Course details

Stream processing is rapidly growing in popularity, as more and more data is generated every day by websites, devices, and communications. Platforms such as Apache Kafka Streams can help you build fast, scalable stream processing applications, but big data engineers still need to design smart use cases to achieve maximum efficiency. In this course, get insight into how to solve stream processing problems with Kafka Streams in Java as you learn how to build use cases with popular design patterns. Review some of the significant features of Kafka Streams and discover four popular patterns for stream processing: streaming analytics, alerts and thresholds, leaderboards, and real-time predictions. Along the way, review example use cases, and discover how to leverage Kafka Streams, as well as key technologies like MariaDB and Redis, to implement key examples.

Concepts

Introduction

Stream processing with Kafka
Prerequisites

Stream Processing with Kafka Streams

What is stream processing
Streaming opportunities and challenges
Streaming with Kafka Streams
Kafka Streams DSL
Setting up the exercise files
Setting up Kafka
Setting up MariaDB and Redis

Streaming Analytics

Streaming analytics - Pattern
Streaming analytics - Use case design
Streaming analytics - Helper classes
Streaming analytics - Pipeline implementation
Streaming analytics - Results review

Alerts and Thresholds

Alerts and thresholds - Pattern
Alerts and thresholds - Use case design
Alerts and thresholds - Helper classes
Alerts and thresholds - Pipeline implementation
Alerts and thresholds - Review

Leaderboards

Leaderboards - Pattern
Leaderboards - Use case design
Leaderboards - Helper classes
Leaderboards - Pipeline implementation
Leaderboards - Review

Real-Time Predictions

Real-time predictions - Pattern
Real-time predictions - Use case design
Real-time predictions - Helper classes
Real-time predictions - Pipeline implementation
Real-time predictions - Review

Use Case Project

Use case definition
Design of the project
Code walk-through
Execute and analyze

Conclusion

Next steps