Kafka Developer

Inquire now

Kafka Developer is a practical, hands-on training program designed to help participants develop the skills needed to build scalable and reliable event-driven applications using Apache Kafka. The course covers essential Kafka concepts, including topics, partitions, brokers, producers, consumers, message delivery, data streaming, and distributed messaging. Participants will gain practical experience developing Kafka-based solutions, processing real-time data, managing event streams, and applying Kafka in modern distributed systems, microservices, and big data environments.

Course Overview:

Kafka Developer is a comprehensive, hands-on training program designed to develop practical skills in Apache Kafka, Big Data processing, distributed messaging, and Scala programming. The course begins with the fundamentals of Big Data and Kafka, introducing participants to Kafka architecture, topics, partitions, producers, consumers, brokers, and ZooKeeper.

Participants will progress into advanced Kafka concepts, including broker configuration and tuning, replication, persistence, offsets, partition management, MirrorMaker, serializers, security, and Producer and Consumer APIs. Through practical exercises, they will learn how to build Kafka producers and consumers using Scala and implement reliable publish-subscribe messaging solutions.

The program also provides a strong foundation in Scala programming and functional programming, covering collections, functions, higher-order functions, classes, objects, traits, inheritance, pattern matching, exception handling, and other core Scala concepts required for Kafka development. Participants will gain the knowledge and hands-on experience needed to develop scalable event-streaming solutions and work effectively with Kafka in modern Big Data and distributed application environments.

 

Course Objectives:

  • Traits
    • Traits in Scala
    • Mixing traits into Objects
    • Layered Traits
    • Traits for Rich Interfaces
    • Scala class hierarchy
  • Functions & Procedures
    • Local functions
    • First class functions
    • Partially applied functions
    • Currying
    • Default & Named Arguments
    • Varargs
    • Procedures
    • Closures
  • Classes in Scala
    • Simple Classes and Parameter less Methods
    • Access modifiers and rules
    • Type parameters
    • Object-Private Fields
    • Auxiliary Constructors
    • The Primary Constructor
    • Nested Classes
  • Higher Order functions in Collections
  • Anonymous Functions (aka Function Literals)
  • Pattern Matching in Depth
    • Using the match keyword to return a value
    • Using case classes for pattern matching
    • Adding pattern guards to match conditions
    • Partially specifying matches with wildcards
    • Deep matching using case constructors
    • Matching against collections of items
  • Using extractors instead of case classes
  • Exception Handling

 

Pre-requisites:

  • Software Development
  • Unix and Hadoop

 

Target Audience:

  • Hadoop Developers
  • Data Engineers
  • Integration Engineers
  • Architects
  • Data Steward

 

Course Duration:

  • 35 hours – 5 days

 

Course Content:

Phase 1: Understanding Big Data and Kafka (Day1)

  • What is Big Data & Dimensions of Big Data
  • Big Data in Advertising, Banking, Telecom, eCommerce, Healthcare, Defense
  • Input options of Big Data
  • Associated Challenges
  • Introduction to Kafka
  • Why Kafka
  • Kafka Use Cases
  • Introduction to Zookeeper
  • Zookeeper: Distributed Applications and Challenges
  • Zookeeper: Handling Partial Failures
  • Zookeeper: Leader Election
  • Aggregating User Activity Using Kafka
  • Zookeeper for Kafka
  • Kafka Architecture
  • What is Kafka Data Model?
  • What is a topic
  • What is a partition and Partition Distribution
  • What is a producer
  • What is a consumer

Phase 2: Kafka Deep Dive (Day 2 and 3)

  • Zookeeper Architecture
  • Zookeeper watcher
  • Kafka broker tuning parameters
  • Kafka Mirror Maker
  • Kafka Brokers
  • Kafka Replication
  • Persistence and Offsets
  • The Kafka broker property list
  • Customer Key and Value Serializer
  • Replication and Partition management in Kafka
  • Writing Producers– The Scala producer API
  • Creating a Scala producer with custom partitioning and Serializers The Kafka producer property list
  • Writing Consumers Kafka consumer APIs
  • Simple Scala consumers Reading messages from a topic and printing them
  • Publish-Subscribe System
  • Configuring Producers with Scala
  • Security options in Kafka

Phase 3: Understanding Scala Programming (Day 4 and 5)

  • Introduction to Functional Programming
  • Introduction to Scala
  • Scala Fundamentals
  • Functions & Procedures
  • Collections
    • Sets
    • Maps
    • Lists
    • Tuples
    • Arrays
  • Higher Order Functions on Collections
  • Objects in Scala oSingletons
    • Companion Objects
    • Objects Exten ding a Class or Trait
    • Application Objects
  • Inheritance
    • Extending a Class
    • Method Overriding
    • Protected Fields and Methods
    • Overriding
    • Anonymous Subclasses
    • Abstract Classes
    • Abstract Fields
    • Inheritance Hierarchy
    • Object Equality
    • Value Classes

 

 

Course Customization Options

To request a customized training for this course, please contact us to arrange.

Inquire now

Best selling courses

Duration: 5 days – 35 hrs   Overview The “SOC Network and Threat Detection and Analysis” training course is designed to equip Security Operations Center (SOC) analysts and IT security professionals with the skills and knowledge required to detect, analyze, and respond to network threats effectively. This comprehensive course covers essential topics such as threat...

Duration 1 day – 7 hrs   Overview   This 1-day training builds upon basic warehouse operations knowledge and introduces key logistics concepts involved in the movement and coordination of goods—especially wet and dry food items—within and outside the warehouse. Participants will explore transport logistics, inbound and outbound coordination, documentation practices, and cold chain considerations,...

Duration 2 days – 14 hrs   Overview   This hands-on course provides an introduction to Splunk, a powerful platform for searching, monitoring, and analyzing machine-generated data. The training focuses on how developers and QA professionals can leverage Splunk to gain insights from logs and metrics, improve application observability, detect anomalies, and support test validation....

Duration 3 days – 21 hrs   Overview.   This course is designed for fresh graduates aspiring to build a career in Data Science. It introduces the fundamentals of data science, focusing on data analysis, visualization, and basic machine learning concepts using Python. The course provides hands-on practice with real-world datasets, equipping participants with the...

Duration 5 days – 35 hrs   Overview   The Microsoft Certified: Azure Administrator Associate (AZ-104) Training Course is designed for IT professionals who want to develop expertise in managing Microsoft Azure environments. This course provides hands-on training on deploying, managing, and monitoring Azure services, including virtual machines, networking, storage, identity, and security.   Objectives...

ARTIFICIAL INTELLIGENCE / MACHINE LEARNING / DEEP LEARNING

Capstone Workshop: Build Your Own GenAI Toolkit TECH AI

GenAI Toolkit Training is a practical, hands-on capstone workshop designed to help participants bring their generative AI knowledge together into a personalized toolkit of AI tools, prompts, workflows, and practical solutions. Rather than simply learning individual AI platforms, participants will learn how to select and combine the right tools to address real-world technical and professional...

In this course, you will gain practical foundation level training that enables immediate and effective participation in big data and other analytics projects. Learn ways of storing data that allow for efficient processing and analysis, and gain the skills you need to store, manage, process, and analyze massive amounts of unstructured data to create an appropriate data lake.

Advanced Laravel Engineering Scalable Architecture, Performance, Testing, Queues & DevOps equips developers with the skills to design scalable Laravel applications, optimize performance, implement automated testing, manage queues, and integrate DevOps practices for reliable, production-ready deployments.   Duration 5 Days – 35 hrs   Overview This advanced-level bootcamp is designed for teams building large-scale or mission-critical...

// BG EARTH WHEN NOT PLAYING

We use cookies on our website to personalize your experience by storing your preferences and recognizing repeat visits. By clicking “Accept”, you agree to the use of all cookies. You can also select “Cookie Settings” to adjust your preferences and provide more specific consent. Cookie Policy