Hadoop Administration Course | DevelopIntelligence

Course Summary

The Hadoop Administration training course provides students with a comprehensive understanding of all the steps necessary to operate and maintain a Hadoop cluster. From installation and configuration through load balancing and tuning. Students will get experience with some of the most common and challenging scenarios Hadoop administrators see in the real world and become familiar with the most up-to-date details of the platform.

The course begins with an introduction to Hadoop including a brief history,, core components, and fundamental concepts. Next, the course dives into planning Hadoop clusters, Hadoop Distributed File System (HDFS), and MapReduce. The course also includes Hadoop installation and configuration, clients, security, and managing and scheduling jobs. The course concludes with advanced cluster configuration, cluster maintenance, monitoring and troubleshooting.

Purpose

Learn how to maintain and operate a Hadoop cluster.

Audience

Anyone that is in charge of installing and managing a Hadoop cluster. Basic Unix skills recommended.

Role

Software Developer - System Administrator - Technical Manager

Skill Level

Intermediate

Style

Workshops

Duration

4 Days

Related Technologies

Hadoop

Apache

Download

Productivity Objectives:

Discover the fundamentals of standing up a Hadoop cluster.
Identify how to configure Hadoop for high availability.
Relate solid fundamental configurations for maximizing Hadoop operations.

Get Quote

Get your team upskilled or reskilled today. Chat with one of our experts to create a custom training proposal. Fully customized at no additional cost.

If you are not completely satisfied with your training class, we'll give you your money back.

What You'll Learn

In the Hadoop Administration training course, you'll learn:

Hadoop Introduction
- A Brief History of Hadoop
- Core Hadoop Components
- Fundamental Concepts
Planning Your Hadoop Cluster
- General Planning Considerations
- Choosing Hardware
- Network Considerations
- Configuring Nodes
- Planning for Cluster Management
HDFS
- HDFS Features
- Writing and Reading Files
- NameNode Considerations
- HDFS Security
- Namenode Web UI
- Hadoop File Shell
Getting Data into HDFS
- Pulling data from External Sources with Flume
- Importing Data from Relational Databases with Sqoop
- REST Interfaces
- Best Practices
MapReduce
- MapReduce overview
- Features of MapReduce
- Architectural Overview
- YARN – MapReduce Version 2
- Failure Recovery
- The JobTracker Web UI
Hadoop Installation and Initial Configuration
- Configuration & Deployment Types
- Installing Hadoop
- Specifying the Hadoop Configuration
- Initial HDFS & MapReduce Configuration
- Log Files
Installing/Configuring Hive, Impala, and Pig
- Hive
- Impala
- Pig
Hadoop Clients
- What is a Hadoop Client?
- Installing and Configuring Hadoop Clients
- Installing and Configuring Hue
- Hue Authentication and Configuration
Advanced Cluster Configuration
- Advanced Configuration Parameters
- Configuring Hadoop Ports
- Explicitly Including and Excluding Hosts
- Configuring HDFS for Rack Awareness & HDFS High Availability
Hadoop Security
- Why Hadoop Security Is Important
- Hadoop’s Security System Concepts
- What Kerberos Is and How it Works
- Securing a Hadoop Cluster with Kerberos
Managing and Scheduling Jobs
- Managing Running Jobs
- Scheduling Hadoop Jobs
- Configuring the FairScheduler
Cluster Maintenance
- Checking HDFS Status
- Copying Data Between Clusters
- Adding/Removing Cluster Nodes
- Rebalancing the Cluster
- NameNode Metadata Backup
- Cluster Upgrades
Cluster Monitoring and Troubleshooting
- General System Monitoring
- Managing Hadoop’s Log Files
- Monitoring the Clusters
- Common Troubleshooting Issues