Enterprise Apache Kafka for Platform & Infrastructure Systems Support

Inquire now

Duration 3 days – 21 hrs

 

Overview

 

This course equips IT professionals with the foundational and operational knowledge to support Apache Kafka, the leading open-source distributed event streaming platform used by enterprises for real-time data pipelines, event-driven architectures, and microservices. The training focuses on architecture, installation, configuration, performance tuning, and high-availability support of Kafka clusters. It also covers Kafka ecosystem components like Kafka Connect, Kafka Streams, Schema Registry, and monitoring tools essential for platform and infrastructure support teams.

 

Objectives

  • Understand the architecture and design principles of Apache Kafka.
  • Deploy and configure Kafka in single-node and multi-node environments.
  • Set up and manage Kafka brokers, topics, partitions, producers, and consumers.
  • Configure Kafka for high availability, fault tolerance, and performance tuning.
  • Use Kafka Connect for data integration and Kafka Streams for stream processing.
  • Implement monitoring, alerting, and troubleshooting practices for Kafka clusters.
  • Apply security best practices (SSL, SASL, ACLs) for enterprise Kafka deployments.
  • Integrate Kafka with enterprise data systems and DevOps pipelines.

 

Audience

 

  • Platform Engineers
  • Infrastructure Support Teams
  • DevOps and SRE Engineers
  • System Administrators
  • Middleware Engineers
  • Cloud Infrastructure Teams
  • Data Engineering Teams supporting real-time platforms

 

Pre-requisites

  • Basic knowledge of Linux system administration
  • Familiarity with distributed systems and networking concepts
  • Basic understanding of data pipelines or messaging systems
  • Experience with Docker or cloud platforms is a plus

Course Content

 

Module 1: Introduction to Apache Kafka

 

  • What is Kafka?
  • Kafka Use Cases: Real-time analytics, stream processing, microservices
  • Kafka Architecture Overview: Topics, Partitions, Brokers, Producers, Consumers
  • ZooKeeper vs. KRaft Mode (KRaft Overview in Kafka 3.x+)

 

Module 2: Installing and Running Kafka

 

  • Kafka Installation Methods: Binary, Docker, Cloud
  • Setting up Kafka and ZooKeeper (or KRaft Mode)
  • Kafka CLI Tools and Configuration Files
  • Hands-on: Deploy a Single-node Kafka Setup

 

Module 3: Kafka Core Concepts

 

  • Topics, Partitions, Offsets
  • Producers and Consumers
  • Consumer Groups and Offset Management
  • Retention Policies and Cleanup Strategies
  • Hands-on: Publish and Subscribe to Kafka Topics

 

Module 4: Kafka Cluster Management

 

  • Scaling Brokers and Adding Partitions
  • Kafka Broker Configuration Best Practices
  • Cluster Metadata and Controller Election
  • Hands-on: Deploy and Configure a Multi-node Kafka Cluster

 

Module 5: Kafka Connect and Data Integration

 

  • Introduction to Kafka Connect
  • Source and Sink Connectors
  • Running and Monitoring Connectors
  • Hands-on: Building a Connector Pipeline (e.g., MySQL to Kafka to Elasticsearch)

 

Module 6: Kafka Streams and KSQL

 

  • Stream Processing with Kafka Streams
  • Introduction to KSQL and ksqlDB
  • Stateless and Stateful Transformations
  • Hands-on: Basic Streaming App with Kafka Streams API

 

Module 7: Monitoring and Observability

 

  • Kafka Metrics and Logs
  • Monitoring Tools: Prometheus, Grafana, Confluent Control Center
  • Lag Monitoring with Burrow/Kafka Lag Exporter
  • Hands-on: Set Up Kafka Monitoring Dashboard

 

Module 8: Kafka Security

 

  • Encryption in Transit with SSL
  • Authentication with SASL (PLAIN, SCRAM, Kerberos)
  • Authorization with ACLs
  • Best Practices for Securing Kafka in Enterprise Environments

 

Module 9: Kafka Performance and Tuning

 

  • Tuning Producer and Consumer Performance
  • Broker Configuration for Throughput and Latency
  • Compression, Batching, and Buffering
  • Hands-on: Benchmark and Tune Kafka Performance

 

Module 10: Kafka in Production & DevOps Integration

 

  • Backup and Recovery
  • Kafka with Kubernetes (Helm, Operators, StatefulSets)
  • CI/CD Pipelines with Kafka (GitLab, Jenkins, etc.)
  • Kafka on AWS/GCP/Azure: Managed vs. Self-hosted
  • Case Study: Kafka in a Microservices-based Infrastructure

 

Inquire now

Best selling courses

Duration: 5 days – 35 hrs   Overview The “SOC Network and Threat Detection and Analysis” training course is designed to equip Security Operations Center (SOC) analysts and IT security professionals with the skills and knowledge required to detect, analyze, and respond to network threats effectively. This comprehensive course covers essential topics such as threat...

Duration 1 day – 7 hrs   Overview   This 1-day training builds upon basic warehouse operations knowledge and introduces key logistics concepts involved in the movement and coordination of goods—especially wet and dry food items—within and outside the warehouse. Participants will explore transport logistics, inbound and outbound coordination, documentation practices, and cold chain considerations,...

Duration 2 days – 14 hrs   Overview   This hands-on course provides an introduction to Splunk, a powerful platform for searching, monitoring, and analyzing machine-generated data. The training focuses on how developers and QA professionals can leverage Splunk to gain insights from logs and metrics, improve application observability, detect anomalies, and support test validation....

Duration 3 days – 21 hrs   Overview.   This course is designed for fresh graduates aspiring to build a career in Data Science. It introduces the fundamentals of data science, focusing on data analysis, visualization, and basic machine learning concepts using Python. The course provides hands-on practice with real-world datasets, equipping participants with the...

Duration 5 days – 35 hrs   Overview   The Microsoft Certified: Azure Administrator Associate (AZ-104) Training Course is designed for IT professionals who want to develop expertise in managing Microsoft Azure environments. This course provides hands-on training on deploying, managing, and monitoring Azure services, including virtual machines, networking, storage, identity, and security.   Objectives...

ARTIFICIAL INTELLIGENCE / MACHINE LEARNING / DEEP LEARNING

Capstone Workshop: Build Your Own GenAI Toolkit TECH AI

GenAI Toolkit Training is a practical, hands-on capstone workshop designed to help participants bring their generative AI knowledge together into a personalized toolkit of AI tools, prompts, workflows, and practical solutions. Rather than simply learning individual AI platforms, participants will learn how to select and combine the right tools to address real-world technical and professional...

In this course, you will gain practical foundation level training that enables immediate and effective participation in big data and other analytics projects. Learn ways of storing data that allow for efficient processing and analysis, and gain the skills you need to store, manage, process, and analyze massive amounts of unstructured data to create an appropriate data lake.

Advanced Laravel Engineering Scalable Architecture, Performance, Testing, Queues & DevOps equips developers with the skills to design scalable Laravel applications, optimize performance, implement automated testing, manage queues, and integrate DevOps practices for reliable, production-ready deployments.   Duration 5 Days – 35 hrs   Overview This advanced-level bootcamp is designed for teams building large-scale or mission-critical...

// BG EARTH WHEN NOT PLAYING

We use cookies on our website to personalize your experience by storing your preferences and recognizing repeat visits. By clicking “Accept”, you agree to the use of all cookies. You can also select “Cookie Settings” to adjust your preferences and provide more specific consent. Cookie Policy