Real World Spark 2 – ScalaIDE Spark Core 2 Developer

Build a Vagrant box, walk through Spark 2 Core Code via sbt and ScalaIDE. The modern cluster computation engine.

Created by: Toyin Akin
Big Data Engineer, Capital Markets FinTech Developer

What Will I Learn?

• Simply run a single command on your desktop, go for a coffee, and come back with a running distributed environment for cluster deployment
• Code in Scala against Spark. Transformation, Actions and Spark Monitoring
• Debug Spark Code within ScalaIDE

Requirements

• Basic programming or scripting experience is required.
• You will need a desktop PC and an Internet connection. The course is created with Windows in mind.
• The software needed for this course is freely available
• Optional : This course is based on top of my previous course - "Real World Vagrant - Build an Apache Spark Development - Toyin Akin"
• You will require a computer with a Virtualization chipset support - VT-x. Most computers purchased over the last five years should be good enough
• Optional : Some exposure to Linux and/or Bash shell environment
• 64-bit Windows operating system required (Would recommend Windows 7 or above)
• This course is not recommened if you have no desire to work with/in distributed computing

Target audience

• Software engineers who want to expand their skills into the world of distributed computing
• Developers who want to write/test their code against Scala / Spark