Real World Hadoop – Automating Hadoop install with Python!

Deploy a Hadoop cluster (Zookeeper, HDFS, YARN, Spark) with Cloudera Manager's Python API. Hands on.

Created by: Toyin Akin
Big Data Engineer, Capital Markets FinTech Developer

What Will I Learn?

• Simply run a single command on your desktop, go for a coffee, and come back with a running distributed environment for cluster deployment
• Quickly build an environment where Cloudera and Hadoop software can be installed.
• Ability to automate the installation of software across multiple Virtual Machines

Requirements

• Basic programming or scripting experience is required.
• You will need a desktop PC and an Internet connection. The course is created with Windows in mind.
• The software needed for this course is freely available
• You will require a computer with a Virtualization chipset support - VT-x. Most computers purchased over the last five years should be good enough
• Optional : Some exposure to Linux and/or Bash shell environment
• 64-bit Windows operating system required (Would recommend Windows 7 or above)
• This course is not recommened if you have no desire to work with/in distributed computing
• This course is built on top of - "Real World Vagrant - Automate a Cloudera Manager Build"

Target audience

• Software engineers who want to expand their skills into the world of distributed computing
• System Engineers that want to expand their skillsets beyond the single server
• Developers who want to write/test their code against a valid distributed enviroment