Spark (Hadoop) Developer Course

scala-spark

DURATION:
6 weeks
ID:
HDPCD01

Address

Oralogic Education Systems   View map

Categories

Oralogic Education Systems provide best training with project based hands-on expertise on Hadoop technology framework. Our aim is to provide the quality teaching and developing the industry standard hands-on skill set of our students.

SCALA

  • Installation
  • Basic (Overview, Literals, Values, Variable, Types & String)
  • If Else, Loop (For & While) &
  • Function
  • List, Set, Collection
  • Map, Filter & Reduce
  • File Operations and Processing

Python

  • Installation
  • Basic (Overview, Variable, Data Types, Input  & Output)
  • If Else, & Loop
  • Function
  • List, Dictionary & Array
  • Map, Filter & Reduce
  • File Operations and Processing
  • Numpy, Pandas & Data Visualization (Graph)

Spark using Scala & Python

  • Installation of Spark with scala in hadoop cluster
  • Environment Configuration and Initialize Jobs
  • Resilient Distributed Data Sets
  • Preview & Filtering Data
  • Accumulators
  • Converting Key Value Pairs
  • Joining Data sets
  • ReduceByKay & AggregateByKay
  • Execution Life Cycle
  • Broadcast Variables
  • Sorting Data
  • Saving Data in HDFS

Spark SQL

  • Spark SQL and Objectives
  • Create database and tables of text file and ORC file format
  • Run Queries using Scala – Spark Shell
  • SQL Language Operations
  • Windowing (Analytical) Function
  • Data Frames and Temp Tables
  • Spark Application – Processing Data using Spark SQL
  • Spark Application – Saving Data Frame to Hive Tables
  • Data Frame Operations

Other Information: 

Course # HDPCD01
Instructor Industry Professional
Course HDP Certified Apache Spark Developer
Version Stable releases of Hadoop, Hive, Scala
Duration 6 Weeks
Class Duration 2 hours
Medium In-Class, Online

 

CONTACT US

Email: [email protected]
Cell: 03170001206, 03334906811
Address: 29 Civic Center, Barkat Market, New Garden Town, Lahore

ABOUT US

Oralogic is a next generation IT education platform. Our goal is to provide professional and complete set of skills to technology seeking people through most experienced IT professional resources in Market.
TOP