The Real-Time Ingestion & Processing Using Kafka & Spark training course focuses on Data Ingestion and Processing using Kafka and Spark Streaming. The course covers Kafka Fundamentals, Architecture, API, Kafka Connect, Kafka Streams, Spark Micro-batch processing, and Structured Streaming Processing.
The course begins with students gaining an understanding of Kafka fundamentals and internals. The course then covers Zookeeper, integrations, and the API. The course concludes with lessons on Spark Streaming and Kafka Streams.
The course utilizes a mixture of lectures and hands-on exercises to reinforce learning. Hands-on exercises related to Kafka APIs will be in Java/Scala and Scala language will be used for Spark related exercises.
Purpose
|
Learn the knowledge and skills needed to utilize Data Ingestion and Processing using Kafka and Spark Streaming. |
Audience
|
Developers and developer teams needing to learn Real-Time Ingestion and Processing using Kafka and Spark. |
Role
| Software Developer - System Administrator |
Skill Level
| Intermediate |
Style
| Workshops |
Duration
| 2 Days |
Related Technologies
| Apache Spark | Scala | Java | Apache Kafka |
Productivity Objectives
- Use Kafka Fundamentals & Architecture, Producer & Consumer API, Kafka Connect, Kafka Streams
- Perform Spark Micro-batch processing
- Perform Structured Streaming processing