Hadoop Development 0 to 100

Inquire now

Hadoop Development 0 to 100 is a comprehensive, hands-on training program designed to take participants from the fundamentals of Apache Hadoop and big data development to practical implementation of distributed data processing solutions.

Course Overview:

Hadoop Development, Administration and BI Program is a one-stop course that introduces you to the domain of Hadoop Development as well as gives you technical know-how of the same.

 

Course Objectives:

By the end of this course, participants will be able to:

  • Understand the fundamentals of Big Data, Apache Hadoop, and distributed data processing.
  • Explain how Hadoop and its ecosystem support large-scale data storage and processing.
  • Work with HDFS and execute essential Hadoop file system operations.
  • Develop and run MapReduce programs for processing large datasets.
  • Use Hadoop ecosystem tools including Sqoop, Oozie, Hive, Pig, and Flume.
  • Develop data processing applications using Apache Spark.
  • Work with RDDs, transformations, actions, Pair RDDs, Spark SQL, and DataFrames.
  • Build and understand basic Spark Streaming applications.
  • Analyze and manage data using Hive, Impala, and Pig.
  • Understand the role of NoSQL databases in big data environments.
  • Gain practical exposure to HBase, Cassandra, and MongoDB.
  • Understand Hadoop cluster administration and use Cloudera Manager for cluster setup and management.
  • Apply Hadoop and Spark technologies to practical big data development and analytics scenarios.

 

Pre-requisites:

  • Typically, professionals with basic knowledge of software development, programming languages, and databases will find this course helpful. Basic knowledge should be enough to succeed at this course
  • Not For: Students who are absolute beginners at software development as a discipline will find it difficult to follow the course

 

Target Audience:

  • Developers

 

Course Duration:

  • 35 hours – 5days

 

Course Content:

Phase 1: Hadoop Fundamentals with multinode setup (Day 1,2)

Laying the foundation

Big Data

  • What is Big Data
  • Dimensions of Big Data
  • Big Data in Advertising
  • Big Data in Banking
  • Big Data in Telecom
  • Big Data in eCommerce
  • Big Data in Healthcare
  • Big Data in Defense
  • Processing options of Big Data
  • Hadoop as an option

Hadoop

  • What is Hadoop
  • How Hadoop Works
  • HDFS
  • Mapreduce Deep Dive
  • How Hadoop has an edge

Hadoop Ecosystem

  • Sqoop
  • Oozie
  • Pig
  • Hive
  • Flume

Hadoop Hands On

  • Running HDFS commands
  • Running your Mapreduce program
  • Running Sqoop Import and Sqoop Export
  • Creating Hive tables directly from Sqoop
  • Creating Hive tables
  • Querying Hive tables
  • Running an Oozie workflow

 

Phase 2: Hadoop Development (Day 3)

Become a Pro developer

Apache Spark

  • What is Spark?
  • Using Spark Shell
  • RDD Fundamentals
  • Functional Programming
  • Program

RDD in Depth

  • RDDs
  • Creating RDDs from files
  • Creating RDDs for another RDDs
  • RDD operations
  • Actions
  • Transformations
  • Pair RDDs
  • Joins using RDD

Spark platforms

  • Spark local mode
  • Spark standalone mode
  • Spark on YARN
  • Spark on Mesos

Spark Hands On

  • Python Spark Shell
  • Scala Spark Shell
  • Basic operations on RDDs
  • Pair RDD Hands On

Spark SQL & Dataframes

  • Spark SQL and the SQL Context
  • Creating Dataframes
  • Dataframe Queries and Transformations
  • Saving Dataframes
  • Dataframes and RDDs

Spark Dataframes Hands On

  • Dataframes on a JSON file
  • Dataframes on hive tables
  • Dataframes on JSON
  • Querying operations dataframes

Spark SQL & Dataframes

  • What is Spark Streaming
  • How it works
  • DStreams
  • Developing Spark Streaming Applications

 

Phase 3: Hadoop BI (Day 4) Analyze data using Pig and Hive

Hive

  • Introduction
  • Basic Data Analysis with Hive
  • Hive Data Management
  • Text Processing with Hive
  • Transformations in Hive
  • Optimizing Hive
  • Hive Hands On
  • Extending Hive

Impala

  • Introduction
  • Basic Data Analysis with Impala
  • Text Processing with Impala
  • Optimizing Impala
  • Impala Hands On

Pig

  • Introduction
  • How Pig works
  • Pig Hands On

 

Phase 4: NoSQL and Cluster Walkthrough (Day 5) Cluster Administration

NoSQL Databases

  • Why NoSQL
  • What is NoSQL Databases
  • Types of NoSQL Databases
  • Introduction to Cassandra and MongoDB and Hbase
  • Hbase Hands On

Cloudera Manager Setup

  • Why Cluster Manager software
  • Cloudera Manager
  • Using Cloudera Manager to setup cluster
  • Cluster walkthrough

Final Test

 

 

Course Customization Options

To request a customized training for this course, please contact us to arrange.

 

Inquire now

Best selling courses

Duration: 5 days – 35 hrs   Overview The “SOC Network and Threat Detection and Analysis” training course is designed to equip Security Operations Center (SOC) analysts and IT security professionals with the skills and knowledge required to detect, analyze, and respond to network threats effectively. This comprehensive course covers essential topics such as threat...

Duration 1 day – 7 hrs   Overview   This 1-day training builds upon basic warehouse operations knowledge and introduces key logistics concepts involved in the movement and coordination of goods—especially wet and dry food items—within and outside the warehouse. Participants will explore transport logistics, inbound and outbound coordination, documentation practices, and cold chain considerations,...

Duration 2 days – 14 hrs   Overview   This hands-on course provides an introduction to Splunk, a powerful platform for searching, monitoring, and analyzing machine-generated data. The training focuses on how developers and QA professionals can leverage Splunk to gain insights from logs and metrics, improve application observability, detect anomalies, and support test validation....

Duration 3 days – 21 hrs   Overview.   This course is designed for fresh graduates aspiring to build a career in Data Science. It introduces the fundamentals of data science, focusing on data analysis, visualization, and basic machine learning concepts using Python. The course provides hands-on practice with real-world datasets, equipping participants with the...

Duration 5 days – 35 hrs   Overview   The Microsoft Certified: Azure Administrator Associate (AZ-104) Training Course is designed for IT professionals who want to develop expertise in managing Microsoft Azure environments. This course provides hands-on training on deploying, managing, and monitoring Azure services, including virtual machines, networking, storage, identity, and security.   Objectives...

ARTIFICIAL INTELLIGENCE / MACHINE LEARNING / DEEP LEARNING

Capstone Workshop: Build Your Own GenAI Toolkit TECH AI

GenAI Toolkit Training is a practical, hands-on capstone workshop designed to help participants bring their generative AI knowledge together into a personalized toolkit of AI tools, prompts, workflows, and practical solutions. Rather than simply learning individual AI platforms, participants will learn how to select and combine the right tools to address real-world technical and professional...

In this course, you will gain practical foundation level training that enables immediate and effective participation in big data and other analytics projects. Learn ways of storing data that allow for efficient processing and analysis, and gain the skills you need to store, manage, process, and analyze massive amounts of unstructured data to create an appropriate data lake.

Advanced Laravel Engineering Scalable Architecture, Performance, Testing, Queues & DevOps equips developers with the skills to design scalable Laravel applications, optimize performance, implement automated testing, manage queues, and integrate DevOps practices for reliable, production-ready deployments.   Duration 5 Days – 35 hrs   Overview This advanced-level bootcamp is designed for teams building large-scale or mission-critical...

// BG EARTH WHEN NOT PLAYING

We use cookies on our website to personalize your experience by storing your preferences and recognizing repeat visits. By clicking “Accept”, you agree to the use of all cookies. You can also select “Cookie Settings” to adjust your preferences and provide more specific consent. Cookie Policy