Big-Data Architects

Hourse

Module Description

Module Title

10

• Make yourself comfortable with the Linux OS
• Understand basic concepts of virtual machines
• Create and run virtual machines in the cloud

Preparatory

5

• Our roadmap
• Big data basic concepts
• Hadoop basics

Introduction to Big Data

30

• HDFS, YARN and MapReduce (5)
  • Basic HDFS concepts
  • Working with the HDFS
  • Yarn components
  • MapReduce workflow
• Securing the Cluster Using Kerberos and Sentry (5)
  • Hadoop’s security system concepts
  • What is kerberos and how it works
  • Securing the cluster using kerberos
  • Sentry basic concepts
• Analyzing Data using Apache Hive and Impala (10)
  • Hive and Impala – Introduction and use-cases
  • Data types
  • Creating databases, tables, and partitions
• Working with Apache Pig (5)
  • Pig – Introduction and use-cases
  • Pig’s data model
  • Pig Latin
• Working with HBase (5)
• Introduction to Hbase for processing huge tables
• Hbase data model
• Hbase vs. RDBMS
• Client API (CRUD, queries and batch operations)
• Interactive REST clients

Hadoop Eco System Basics

5

• Introduction to Oozie
• Workflow scheduler
• Alerts and Notifications

Workflow and Automation

10

• Working with Flume
• Kafka basic concepts
• Using Sqoop

Transporting Data

35

• Introduction to Python (10)
• Working with PySpark (25)
  • Basics
  • RDD Operations
  • Caching
  • Spark Streaming
  • Spark SQL and DataFrames

Spark

10

• What is statistical programming
• The need for Big-Data
• R statistical language
• introduction to R
• installation
• Basic usage & general statistics with R
• Data mining using R
• Hadoop-R

Statistical programming Using R

10

This module, unique of its kind in Israel, focuses on complex queries, and entirely composed of advanced “real-world” problems and solutions.

This training is based on a decade of experience working with various databases, challenging job interviews questions, and many complex SQL problems. In this course, students learn many different practical applications and “real-world” problems.

Advanced SQL

5

• Graph database concepts
• Basic querying – Nodes and Relationships

Working with Neo4j

5

• Introduction to MongoDB
• Core concepts
• Environments
• CRUD and the MongoDB Shell

Working with MongoDB