Skip to content

Contact sales

By filling out this form and clicking submit, you acknowledge our privacy policy.

Kafka Internals

Course Summary

The Kafka Internals training course is designed to teach students about the publish/subscribe messaging system with many advanced configurations. Apache Kafka is an open-source stream processing platform used to provide a unified, high-throughput, low-latency system for handling real-time data feeds from a wide range of source systems.

The course begins with covering configurations, allowing students to discover brokers, consumers, producers, and topics. Next, students will build their own Kafka cluster using Linux Academy servers. The course will conclude by looking at applying their knowledge from the course to real-world scenarios like processing real-time stock price updates from an API and consolidating that into a data lake.

Purpose
 Learn to use Apache Kafka as a distributed messaging system.
Audience
 Developers and developer teams looking to leverage Kafka architecture that know Java and basic Linux commands.
Role
Software Developer
Skill Level
Intermediate
Style
Workshops
Duration
2 Days
Related Technologies
Java | Linux

 

Productivity Objectives
  • Understand the Kafka architecture and describe the roles and responsibilities of various Daemons
  • Use producers, consumers, and brokers within Kafka
  • Construct a streaming ETL pipeline using Kafka Connect
  • Explain how and when to use Kafka developer APIs
  • Perform real-time analytics using KSQL

What You'll Learn:

In the Kafka Internals training course, you'll learn:
  • Kafka Fundamentals & Internals
    • Logical Architecture of Kafka
    • Physical Architecture of Kafka
      • Partitions
      • Topics
      • Replicas
      • Producers & Consumers
      • Brokers
    • Roles and Responsibilities of various components
    • Replication mechanism
    • Message Delivery Semantic
    • Key Terminologies
    • Key configuration settings of Brokers, Producers, Consumers, etc.
    • Schema Evolution Concepts
    • Hands-on Exercise(s)
  • Zookeeper
    • Role of Zookeeper
    • Zookeeper Basic Operations
    • Apache Kafka - Zookeeper Role
    • Exploring Zookeeper
  • Kafka Administration
    • Things to consider in Administration
    • Monitoring Kafka
    • Kafka Security
    • Performance Tuning Kafka Cluster
  • Kafka Integrations
    • End to End Data Pipeline using Kafka
    • Why Kafka Connect?
    • Architecture
    • Tuning
    • Build End to End Streaming ETL Pipeline
    • Hands-on Exercise(s)
  • Kafka Core APIs
    • Overview
    • Producer API
      • Sync Producers
      • Async Producers
      • Message Acknowledgement
      • Batching Messages
      • Keyed and Non-Keyed Messages
      • Compression
      • Batching
    • Consumer API
    • Hands-on Exercise(s)
  • KSQL DB
    • Overview
    • What is KSQLDB
    • Why KSQLDB
    • Hands-on Exercise(s)
real world content

Real-World Content

Project-focused demos and labs using your tool stack and environment, not some canned "training room" lab.
expert practitioners

Expert Practitioners

Industry experts that bring their battle scars into the classroom.
experiential learning

Experiential Learning

More coding than lecture, coupled with architectural and design discussions.
tailored outlines

Tailored Outlines

One-size-fits-all doesn't apply to training teams. That's where we come in!
“I appreciated the instructor's technique of writing live code examples rather than using fixed slide decks to present the material.”

VMware

Dive in and learn more

When transforming your workforce, it's important to have expert advice and tailored solutions. We can help. Tell us your unique needs and we'll explore ways to address them.

Let's chat

By filling out this form and clicking submit, you acknowledge our privacy policy.