Spark (Hadoop) Developer Course

Oralogic Education Systems provide best training with project based hands-on expertise on Hadoop technology framework. Our aim is to provide the quality teaching and developing the industry standard hands-on skill set of our students.

SCALA

• Installation
• Basic (Overview, Literals, Values, Variable, Types & String)
• If Else, Loop (For & While) &
• Function
• List, Set, Collection
• Map, Filter & Reduce
• File Operations and Processing

Python

• Installation
• Basic (Overview, Variable, Data Types, Input  & Output)
• If Else, & Loop
• Function
• List, Dictionary & Array
• Map, Filter & Reduce
• File Operations and Processing
• Numpy, Pandas & Data Visualization (Graph)

Spark using Scala & Python

• Installation of Spark with scala in hadoop cluster
• Environment Configuration and Initialize Jobs
• Resilient Distributed Data Sets
• Preview & Filtering Data
• Accumulators
• Converting Key Value Pairs
• Joining Data sets
• ReduceByKay & AggregateByKay
• Execution Life Cycle
• Broadcast Variables
• Sorting Data
• Saving Data in HDFS

Spark SQL

• Spark SQL and Objectives
• Create database and tables of text file and ORC file format
• Run Queries using Scala – Spark Shell
• SQL Language Operations
• Windowing (Analytical) Function
• Data Frames and Temp Tables
• Spark Application – Processing Data using Spark SQL
• Spark Application – Saving Data Frame to Hive Tables
• Data Frame Operations

Other Information: