Professional Kafka Development

Takes a participant from no knowledge of Apache Kafka to being able to develop with it professionally. We cover Kafka and its ecosystem of technologies. It covers the concepts behind Kafka and how to write your own producers and consumers. Then, we cover the best practices for designing and architecting Kafka solutions, like Apache Avro. Finally, we cover the Kafka ecosystem with Kafka Streams, Kafka Connect, and KSQL. This class doesn’t just cover the easy or Hello World-level consideration; we go deeply into the advanced topics of Kafka.

Duration: 3 days

Intended Audience: Technical, Software Engineers, QA, Analysts

Prerequisites: Intermediate-Level Java

You Will Learn

  • How to Kafka works and important concepts behind it.
  • How to create simple and advanced producers and consumers for Kafka.
  • Why Avro is crucial to any enterprise Kafka solutions.
  • How to use Kafka Connect to bring data into and out of Kafka.
  • How to create simple and advanced solutions with Kafka Streams.
  • How to use KSQL to process and join data in real-time with SQL.
  • How to design enterprise-grade solutions with Kafka and how to integrate Kafka into the rest of the enterprise ecosystem.

Course Outline

Data At Scale
  Data Movement Concepts
  Moving Data at Scale

Kafka Concepts
  Kafka System
  Basic Concepts
  Advanced Concepts

Developing With Kafka
  Using Apache Maven
  Kafka API
  Kafka API Caveats

Advanced Kafka Development
  Advanced Consumers and Producers
  Advanced Offset Handling
  Transactions
  Multi-threading Consumers

Kafka and Avro
  Why Serialize
  Avro and Serialization Formats

Kafka Connect
  Using Kafka Connect
  Importing From JDBC
  Exporting to HDFS

Kafka Streams
  Kafka Streams
  Kafka Streams API

Advanced Kafka Streams
  KTables
  Windowing
  Advanced Streams API

KSQL
  Using KSQL

Architecting Kafka Solutions
  Productionizing Kafka
  Designing Data Pipelines
  Integrating Solutions

Enterprise Kafka
  Adding Kafka To Existing Systems
  Microservices and Containers
  Kafka And Big Data

Technologies Covered

  • Apache Kafka
  • Kafka Streams
  • Kafka Connect
  • KSQL

I want this class