HADOOP AND BIG DATA

HADOOP AND BIG DATA

Course Overview: This course jumps into the world of Hadoop ecosystem components and its tools in a simplified manner, and provides you with the skills to utilize them effectively for faster and effective development of Hadoop projects.

What you’ll learn: Starting with the concepts of Hadoop YARN, MapReduce, HDFS, and other Hadoop ecosystem components, you will soon learn many exciting topics such as MapReduce, YARN, and HDFS. You will also get acquainted with many Hadoop ecosystem components tools such as Hive, HBase, Pig, Sqoop, Flume, and Spark.

By the end of the course, you will be confident to begin working with Hadoop straightaway and implement the knowledge gained in all your real-world scenarios.

1. Introduction
   1. Big Data Case Studies
   2. Brief History of Hadoop
   3. Need for Hadoop
   4. Hadoop Architecture
   5. RDBMS vs Hadoop
   6. Vendor Comparison
   7. Hardware Recommendations
   8. Hadoop Installation
2. HDFS
   1. HDFS Basics
   2. HDFS Architecture
   3. Data Read and Write Process
   4. HDFS Permissions
   5. Data Replication
   6. HDFS Accessibility
   7. HDFS Filesystem Operations
   8. HDFS Interfaces
   9. Heartbeats
   10. Rack Awareness
   11. distcp
3. MapReduce
   1. MapReduce Basics
   2. MapReduce Workflow
   3. MapReduce Framework
   4. Hadoop Data Types
   5. MapReduce Internals
   6. Job Formats
   7. Debugging and Profiling
   8. Distributed Cache
   9. Combiner Functions
   10. MapReduce Streaming
   11. MapReduce Counters, Sorting and Joins
4. YARN
   1. YARN Infrastructure
   2. YARN ResourceManager
   3. YARN ApplicationMaster
   4. YARN NodeManager
   5. YARN Container
5. Apache Pig
   1. Pig Architecture
   2. Pig Installation and Modes
   3. Grunt and Pig Script
   4. Pig Latin Commands
   5. UDF and Data Processing Operator
6. HBase
   1. HBase Architecture
   2. HBase Installation
   3. HBase Configuration
   4. HBase Schema Design
   5. HBase Commands
   6. MapReduce Integration
   7. HBase Security
7. Sqoop
8. Flume
9. Hive
   1. Hive Architecture
   2. Hive shell
   3. Hive Data Types
   4. HiveQL
10. Hadoop Workflow
11. Hadoop Cluster Management
    1. Cluster Planning
    2. Cluster Installation and Configuration
    3. Cluster Testing
    4. Cluster Benchmarking
    5. Cluster Monitoring
12. Hadoop Administration
    1. dfsadmin, fsck and balancer
    2. Hadoop Logging
    3. Hadoop Data Backup
    4. Addition and removal of nodes
13. Hadoop Security
    1. Authentication
    2. Data Confidentiality
    3. Configuration
14. NextGen Hadoop
    1. HDFS HA
    2. HDFS Federation