Kafka Internals Course | DevelopIntelligence

Course Summary

The Kafka Internals training course is designed to teach students about the publish/subscribe messaging system with many advanced configurations. Apache Kafka is an open-source stream processing platform used to provide a unified, high-throughput, low-latency system for handling real-time data feeds from a wide range of source systems.

The course begins with covering configurations, allowing students to discover brokers, consumers, producers, and topics. Next, students will build their own Kafka cluster using Linux Academy servers. The course will conclude by looking at applying their knowledge from the course to real-world scenarios like processing real-time stock price updates from an API and consolidating that into a data lake.

Purpose

Learn to use Apache Kafka as a distributed messaging system.

Audience

Developers and developer teams looking to leverage Kafka architecture that know Java and basic Linux commands.

Role

Software Developer

Skill Level

Intermediate

Style

Workshops

Duration

2 Days

Related Technologies

Java

Linux

Download

Productivity Objectives:

Understand the Kafka architecture and describe the roles and responsibilities of various Daemons
Use producers, consumers, and brokers within Kafka
Construct a streaming ETL pipeline using Kafka Connect
Explain how and when to use Kafka developer APIs
Perform real-time analytics using KSQL

Learn About Virtual Training

Request Information

Get your team upskilled or reskilled today. Chat with one of our experts to create a custom training proposal. Fully customized at no additional cost.

If you are not completely satisfied with your training class, we'll give you your money back.

about our training

Real-World Content

Project-focused demos and labs using your tool stack and environment, not some canned "training room" lab.
Expert Practitioners

Industry experts with 15+ years of industry experience that bring their battle scars into the classroom.
Experiential Learning

More coding than lecture, coupled with architectural and design discussions.
Fully Customized

One-size-fits-all doesn't apply to training teams. That's where we come in!

What You'll Learn

In the Kafka Internals training course, you'll learn:

Kafka Fundamentals & Internals
- Logical Architecture of Kafka
- Physical Architecture of Kafka
  - Partitions
  - Topics
  - Replicas
  - Producers & Consumers
  - Brokers
- Roles and Responsibilities of various components
- Replication mechanism
- Message Delivery Semantic
- Key Terminologies
- Key configuration settings of Brokers, Producers, Consumers, etc.
- Schema Evolution Concepts
- Hands-on Exercise(s)
Zookeeper
- Role of Zookeeper
- Zookeeper Basic Operations
- Apache Kafka – Zookeeper Role
- Exploring Zookeeper
Kafka Administration
- Things to consider in Administration
- Monitoring Kafka
- Kafka Security
- Performance Tuning Kafka Cluster
Kafka Integrations
- End to End Data Pipeline using Kafka
- Why Kafka Connect?
- Architecture
- Tuning
- Build End to End Streaming ETL Pipeline
- Hands-on Exercise(s)
Kafka Core APIs
- Overview
- Producer API
  - Sync Producers
  - Async Producers
  - Message Acknowledgement
  - Batching Messages
  - Keyed and Non-Keyed Messages
  - Compression
  - Batching
- Consumer API
- Hands-on Exercise(s)
KSQL DB
- Overview
- What is KSQLDB
- Why KSQLDB
- Hands-on Exercise(s)